Hostname: page-component-cd9895bd7-q99xh Total loading time: 0 Render date: 2024-12-23T14:45:46.138Z Has data issue: false hasContentIssue false

Who benefits from individual placement and support? A meta-analysis

Published online by Cambridge University Press:  11 July 2022

Lars de Winter*
Affiliation:
Phrenos Center of Expertise for Severe Mental Illnesses, Utrecht, the Netherlands
Chrisje Couwenbergh
Affiliation:
Phrenos Center of Expertise for Severe Mental Illnesses, Utrecht, the Netherlands
Jaap van Weeghel
Affiliation:
Phrenos Center of Expertise for Severe Mental Illnesses, Utrecht, the Netherlands
Sarita Sanches
Affiliation:
Phrenos Center of Expertise for Severe Mental Illnesses, Utrecht, the Netherlands
Harry Michon
Affiliation:
Movisie Netherlands Centre for Social Development, Utrecht, the Netherlands
Gary R. Bond
Affiliation:
Westat, Lebanon, NH, USA
*
Author for correspondence: Lars de Winters, E-mail: [email protected]
Rights & Permissions [Opens in a new window]

Abstract

Aims

Individual placement and support (IPS) is an evidence-based service model to support people with mental disorders in obtaining and sustaining competitive employment. IPS is increasingly offered to a broad variety of service users. In this meta-analysis we analysed the relative effectiveness of IPS for different subgroups of service users both based on the diagnosis and defined by a range of clinical, functional and personal characteristics.

Methods

We included randomised controlled trials that evaluated IPS for service users diagnosed with any mental disorder. We examined effect sizes for the between-group differences at follow-up for three outcome measures (employment rate, job duration and wages), controlling for methodological confounders (type of control group, follow-up duration and geographic region). Using sensitivity analyses of subgroup differences, we analysed moderating effects of the following diagnostic, clinical, functional and personal characteristics: severe mental illness (SMI), common mental disorders (CMD), schizophrenia spectrum disorders, mood disorders, duration of illness, the severity of symptoms, level of functioning, age, comorbid alcohol and substance use, education level and employment history.

Results

IPS is effective in improving employment outcomes compared to the control group in all subgroups, regardless of any methodological confounder. However, IPS was relatively more effective for service users with SMIs, schizophrenia spectrum disorders and a low symptom severity. Although IPS was still effective for people with CMD and with major depressive disorder, it was relatively less effective for these subgroups. IPS was equally effective after both a short and a long follow-up period. However, we found small, but clinically not meaningful, differences in effectiveness of IPS between active and passive control groups. Finally, IPS was relatively less effective in European studies compared to non-European studies, which could be explained by a potential benefits trap in high welfare countries.

Conclusions

IPS is effective for all different subgroups, regardless of diagnostic, clinical, functional and personal characteristics. However, there might be a risk of false-positive subgroup outcomes and results should be handled with caution. Future research should focus on whether, and if so, how the IPS model should be adapted to better meet the vocational needs of people with CMD and higher symptom severity.

Type
Original Article
Creative Commons
Creative Common License - CCCreative Common License - BY
This is an Open Access article, distributed under the terms of the Creative Commons Attribution licence (http://creativecommons.org/licenses/by/4.0/), which permits unrestricted re-use, distribution and reproduction, provided the original article is properly cited.
Copyright
Copyright © The Author(s), 2022. Published by Cambridge University Press

Introduction

Employment is key to improve community functioning and mental health in people with mental illnesses (Drake and Wallach, Reference Drake and Wallach2020). Work fosters a sense of pride and self-esteem, offers financial independence, provides coping strategies for psychiatric symptoms and ultimately facilitates the process of recovery (Dunn et al., Reference Dunn, Wewiorski and Rogers2008). However, depending on the diagnosis, only between 14 and 33% of the working-age adults (18–65 years old) with mental illnesses are employed, which is substantially lower than the general population (Marwaha et al., Reference Marwaha, Johnson, Bebbington, Stafford, Angermeyer, Brugha, Kilian, Hansen and Toumi2007; Kozma et al., Reference Kozma, Dirani, Canuso and Mao2010; Hakulinen et al., Reference Hakulinen, Elovainio, Arffman, Lumme, Suokas, Pirkola, Keskimäki, Manderbacka and Böckerman2020). Therefore, ongoing support in obtaining and sustaining competitive employment is needed for people with mental illnesses to create a strong and inclusive labour market. Individual placement and support (IPS) is the most effective rehabilitation programme to help people with mental illnesses into competitive employment (Modini et al., Reference Modini, Tan, Brinchmann, Wang, Killackey, Glozier, Mykletun and Harvey2016; Metcalfe et al., Reference Metcalfe, Drake and Bond2018a).

IPS was originally developed to support people with severe mental illness (SMI) in achieving competitive employment. IPS is based on eight basic principles (Becker and Drake, Reference Becker and Drake2003; See Box 1). The overall effectiveness of IPS is well-established for people with SMI (Modini et al., Reference Modini, Tan, Brinchmann, Wang, Killackey, Glozier, Mykletun and Harvey2016; Metcalfe et al., Reference Metcalfe, Drake and Bond2018a). Because of its success, IPS is also increasingly offered to people with other diagnoses, such as common mental disorders (CMD), affective disorders, post-traumatic stress disorders (PTSD) and substance use disorders (SUD) (Bond et al., Reference Bond, Drake and Pogue2019). Results indicated the beneficial effects of IPS for people with PTSD and SUD (Bond et al., Reference Bond, Drake and Pogue2019). However, mixed indications of the effectiveness of IPS for people with CMD (including affective disorders) were found (Hellström et al., Reference Hellström, Pedersen, Christensen, Wallstroem, Bojesen, Stenager, Bejerholm, Van Busschbach, Michon and Eplov2021; Probyn et al., Reference Probyn, Engedahl, Rajendran, Pincus, Naeem, Mistry, Underwood and Froud2021). The reasons for the diminished effectiveness of IPS for CMD are unclear, because a consistent definition of CMD is lacking. Diagnostic criteria for labelling CMD differ between studies, but most studies define CMD to include affective and/or anxiety disorders, of varying duration of illness (Vollebergh et al., Reference Vollebergh, Iedema, Bijl, de Graaf, Smit and Ormel2001; Steel et al., Reference Steel, Marnane, Iranpour, Chey, Jackson, Patel and Silove2014; De Vries et al., Reference De Vries, Ten Have, van Dorsselaer, van Wezep, Hermans and de Graaf2016).

Box 1. The eight basic principles of IPS (Becker and Drake, Reference Becker and Drake2003)

Employment outcomes in IPS programmes also vary between service users with different clinical, functional and personal characteristics, such as symptom severity, substance use, involuntary hospitalisation, social functioning, work experience, education level, duration of illness, age and age of onset of psychiatric disorder (Catty et al., Reference Catty, Lissouba, White, Becker, Drake, Fioritti, Knapp, Lauber, Rössler, Tomov, Van Busschbach and Wiersma2008; Marwaha et al., Reference Marwaha, Johnson, Bebbington, Angermeyer, Brugha, Azorin, Kilian, Hansen and Toumi2009; Campbell et al., Reference Campbell, Bond, Drake, McHugo and Xie2010; Luciano et al., Reference Luciano, Bond and Drake2014; Fyhn et al., Reference Fyhn, Øverland and Reme2020; Christensen et al., Reference Christensen, Wallstrøm, Bojesen, Nordentoft and Eplov2021). However, these moderating effects have been inconsistent across studies, resulting in ambiguity about the effectiveness of IPS in different subgroups. As IPS has been increasingly expanded to different populations, it is timely to investigate how well the effectiveness of IPS generalises to new target groups.

Therefore, in this meta-analysis we analysed the relative effectiveness of IPS for different subgroups of service users as reported in randomised controlled trials of IPS. We assessed the relative effectiveness of IPS by examining study-level outcomes for subgroups of studies with different diagnostic, clinical, functional and personal characteristics using sensitivity analyses of subgroup differences (Borenstein and Higgins, Reference Borenstein and Higgins2013). This is the first meta-analysis that specifically focused on the relative effectiveness of IPS in different target groups with a focus on both target groups with and without SMI. This gives some unique insights into the relative effectiveness of IPS, and valuable addition to the recent contributions about this topic in comparable reviews (i.e. Bond et al., Reference Bond, Drake and Pogue2019; Probyn et al., Reference Probyn, Engedahl, Rajendran, Pincus, Naeem, Mistry, Underwood and Froud2021). The meta-analysis addressed the following research questions:

  1. 1. How does the effectiveness of IPS differ between subgroups of service users with distinct clinical, functional and personal characteristics?

  2. 2. What is the relative effectiveness of IPS for specific diagnostic subgroups of service users with CMD, SMI, schizophrenia spectrum disorders and mood disorders?

Materials and methods

Our meta-analysis followed the latest PRISMA guidelines (Page et al., Reference Page, McKenzie, Bossuyt, Boutron, Hoffmann, Mulrow, Shamseer, Tetzlaff, Akl, Brennan, Chou, Glanville, Grimshaw, Hróbjartsson, Lalu, Li, Loder, Mayo-Wilson, McDonald, McGuinness, Stewart, Thomas, Tricco, Welch, Whiting and Moher2021). Our protocol was preregistered in PROSPERO (CRD42020220080).

Search strategy

We identified records through searches in PubMed, PsycInfo and Cochrane of peer-reviewed journals until July 2019. The search was based on terms related to specific primary diagnoses (e.g., schizophrenia, mood disorder, anxiety disorder, but also CMD and SMI), IPS and other vocational rehabilitation programmes and competitive employment (see online Supplementary materials 1). We found additional references through reference lists of identified studies and systematic reviews.

Study selection process

The included studies meet the following criteria:

Participant population

We included studies that investigated people who were diagnosed with any mental disorder, as determined by DSM-III to DSM-5 (American Psychiatric Association, Reference Bond, Becker, Drake and Vogler1997, 2000, 2013) or ICD 10–11 criteria (World Health Organization, 2016, 2019). Participants without mental disorders or at risk of developing mental health problems were excluded from the meta-analysis.

Study design

We included all randomised controlled trials that evaluated the effectiveness of IPS compared to at least one control condition in the meta-analysis.

Intervention

We included studies investigating a treatment arm comprised of IPS as a stand-alone intervention, not augmented with another active intervention, such as cognitive remediation or social skills training, confirmed by an IPS fidelity assessment, receiving at least ‘fair’ fidelity. For studies investigating the effectiveness of both IPS and IPS augmented with another intervention, we only included the IPS-only arm in the analyses and excluded the IPS augmented with another intervention- arm from the analysis.

Comparison

The control group could be any other vocational service or a passive control group (i.e., service as usual or waiting list).

Outcomes

The study reported competitive employment outcomes.

Two authors (LdW & CC) independently executed study selection, including both title and abstract screening and full-text screening. Disagreements of the full-text selection process were resolved by consensus.

Data extraction

We extracted study details, participant characteristics, treatment variable, outcomes and study design data from all studies in this meta-analysis. Author LdW executed data extraction and discussed and resolved uncertainties with CC. Details about the data-extraction are presented in online Supplementary materials 2.

Data synthesis

Assessment of outcomes

The included studies reported a variety of competitive employment outcomes. Therefore, we focused on three outcome measures of competitive employment that were reported by at least ten studies, the minimum number to provide outcomes with sufficient statistical power in meta-analyses (Jackson and Turner, Reference Jackson and Turner2017; Borenstein et al., Reference Borenstein, Hedges, Higgins and Rothstein2021): (1) Competitive employment rate (i.e., the proportion of participants competitively employed for at least one day during the study period); (2) Job duration (i.e., days, weeks or months competitive employed during the study period); (3) Wages (i.e., total earnings from competitive employment during the study period).

Assessment of study design and region

The included studies also differed in study design, which might affect outcomes: studies compared IPS with a variety of control groups and outcomes were analysed over different follow-up periods. Furthermore, previous research also indicated regional differences (i.e., European versus non-European studies) in the effectiveness of IPS (Drake et al., Reference Drake, Becker and Bond2019). Therefore, we analysed the study outcomes within specific subgroups based on these three confounding factors as follows: (1) type of control group: studies with an active control group encompassing treatment as usual combined with any other vocational services versus studies with a passive control group with treatment as usual and no primary focus on improvement of vocational functioning; (2) follow-up duration: an assessment period of 12 months or less versus more than 12 months; (3) Region: European studies versus non-European studies.

Assessment of moderators of outcomes

In order to answer our two research questions, we selected moderators of study outcomes from the included studies. The selection was based on the identification of relevant moderators analysed in previous studies and the availability of extractable raw data of these moderators in at least ten of our included studies (Borenstein et al., Reference Borenstein, Hedges, Higgins and Rothstein2021).

Assessment of diagnostic subgroups . For this study, we assessed subgroups of SMI or CMD based on diagnosis, duration of illness and inclusion criteria of studies (see Table 1). These three criteria were partly based on previous literature (i.e., Steel et al., Reference Steel, Marnane, Iranpour, Chey, Jackson, Patel and Silove2014; De Vries et al., Reference De Vries, Ten Have, van Dorsselaer, van Wezep, Hermans and de Graaf2016). However, due to the lack of a consistent definition of CMD, we pragmatically translated these criteria based on the availability of data in the included studies. If studies met none of the three criteria we labelled them as ‘unclear’ and did not include these studies in the analysis. We were also able to include SSD and major depressive disorder as separate moderators. We divided these moderators into subgroups of studies in which the majority (i.e., >50%) of the study sample was diagnosed with the specific diagnosis and subgroups of studies in which the minority was diagnosed with the specific disorder (see Table 1).

Table 1. Operationalisations of moderators

a BPRS, Brief Psychiatric Rating Scale; CAPS-IV, Administered PTSD Scale for DSM-IV; DSM-IV or −5, Diagnostic and Statistical Manual 4 or 5; DTS, Davidson Trauma Scale; GAF, Global Assessment of Functioning; GAS, Global Assessment Scale; HADS, Hamilton Anxiety and Depression Scale; HDRS, Hamilton Depression Rating Scale; ICD-10, International Classification of Diseases – 10; MADRS, Montgomery-Åsberg Depression Self Rating Scale; MHI-5, Mental Health Inventory – 5; MINI, Mini-International Neuropsychiatric Interview; PANSS, Positive and Negative Symptom Scale; PCL-5, PTSD checklist for DSM-5; SANS, Scale for the Assessment of Negative Symptoms; SAS-II, Simpson Angus Scale – II; SCAN, Structured Clinical Assessment in Neuropsychiatry; SCID, The Structured Clinical Interview for DSM-5; SOFAS, Social and Occupational Functioning Assessment Scale; SF-12, Short Form Health Survey 12; UPSA, UCSD performance-based skills assessment; WHO-DAS 2.0, World Health Organization Disability Assessment Scale 2.0.

Clinical, functional and personal characteristics . We identified eight other moderators of outcomes: duration of illness, the severity of symptoms, level of functioning, age, comorbid alcohol and substance use, education level and employment history. We assessed these moderators at baseline and operationalised those into subgroups. Subgroups were generally assessed based on the available data in the included studies in this meta-analysis, in order to achieve equally distributed subgroups. Criteria for the operationalisation into subgroups of each moderator are described in Table 1.

Risk of bias assessment

We assessed the risk of bias for each study through the Cochrane Collaboration risk of the bias assessment tool (Higgins and Green, Reference Higgins and Green2008). Potential bias (i.e., high, low or unclear) is assessed as a judgment for individual elements from five domains (selection, performance, attrition, reporting and other bias). Author LdW rated all studies and CC independently rated the risk of bias of 50% of all studies. The inter-rater reliability (Cohen's kappa; McHugh, Reference McHugh2012) was substantial (κ = 0.61; Landis and Koch, Reference Landis and Koch1977) and disagreements were resolved through consensus.

Statistical analysis

Meta-analytic procedure

Meta-analyses were conducted using RevMan 5.3 (The Nordic Cochrane Centre, 2014). We assessed the effectiveness of IPS by analysing differences between IPS and the control group over the study period by calculating the standardised mean difference (d) for continuous outcomes (i.e., job duration and wages) and the odds ratio (OR) for categorical outcomes (i.e., employment rate). For studies reporting multiple outcome assessments for related outcome measures, we pooled the effect sizes into an overall effect size. We used random-effects models, weighted by the method of inverse variance (Higgins and Green, Reference Higgins and Green2008). The magnitude of effect sizes was assessed based on the criteria described by Chinn (Reference Chinn2000). Statistical heterogeneity was assessed by calculating the I2 statistic (Higgins and Thompson, Reference Higgins and Thompson2002). We performed the overall meta-analysis within separate subgroups based on the type of control group, follow-up duration and geographical region. We controlled for the potential influence of these factors using an analysis of subgroup differences (Borenstein and Higgins, Reference Borenstein and Higgins2013). One study had both an active and passive control group (Mueser et al., Reference Mueser, Clark, Haines, Drake, McHugo, Bond, Essock, Becker, Wolfe and Swain2004), and multiple studies both followed service users after ⩽ 12 months and >12 months of follow-up. For the overall meta-analysis we pooled the effect sizes for all control groups or follow-up assessments within the study into one overall effect size, but we analysed both effect sizes separately during the analysis of subgroup differences, controlling for methodological confounders.

Calculating moderating effects

We analysed moderating effects through a sensitivity analysis of subgroup differences (Borenstein and Higgins, Reference Borenstein and Higgins2013), in which we compared subgroup outcomes with high levels or presence of the moderator versus those with low levels or absence of the moderator (see Table 1). Furthermore, the positive or negative influence of specific subgroups on employment outcomes was assessed by investigating which subgroups' confidence intervals of treatment effect exceeded the upper (‘positive’ influence) or lower (‘negative’ influence) bound of the confidence interval of the overall effect size of treatment effect.

Outliers and publication bias

We addressed the potential influence of outliers (i.e., if the confidence interval [CI] of an individual study outcome exceeded the CI of the overall effect size) by comparing the overall effect size of the outcome, including the outliers, with the overall effect size when outliers are removed through an analysis of subgroup differences. Potential publication bias was detected by visual inspection of funnel plots.

Results

Study flow

Of the 1333 records retrieved through database search and reference tracking, 1170 records were excluded after the title and abstract screening. Of the remaining 163 reports, 115 reports were excluded after full-text selection (see Fig. 1 for reasons of exclusion). The remaining 48 reports reported the results of 32 studies.

Fig. 1. Flow chart selection studies conform Prisma guidelines.

Study characteristics

As shown in Table 2, the 32 studies included 3818 participants receiving IPS and 3847 participants receiving a control intervention. The mean age of the aggregated sample (n = 7665) was 38.9 years (study range: 20.4–51.0); 44.1% of the participants were female. A total of 3454 (45.1%) participants were diagnosed with a schizophrenia spectrum disorder (SSD), and 2587 (33.8%) had a main diagnosis of major depressive disorder (MDD). The remaining 1624 (21.2%) had other diagnoses, such as anxiety disorder, PTSD, SUD or personality disorders. Twenty studies met the criteria for SMI and five studies met the criteria for CMD.

Table 2. Characteristics of included studies

a References of reports of included studies: A. Areberg and Bejerholm (Reference Areberg and Bejerholm2013); B. Bejerholm et al. (Reference Bejerholm, Areberg, Hofgren, Sandlund and Rinaldi2015); C. Bejerholm et al. (Reference Bejerholm, Larsson and Johanson2017); D. Bond et al. (Reference Bond, Salyers, Dincin, Drake, Becker, Fraser and Haines2007); E. Bond et al. (Reference Bond, Campbell and Becker2013); F. Bond et al. (Reference Bond, Kim, Becker, Swanson, Drake, Krzos, Fraser, O'Neill and Frounfelker2015); G. Burns et al. (Reference Burns, Catty, Becker, Drake, Fioritti, Knapp, Lauber, Rössler, Tomov, Van Busschbach, White and Wiersma2007); H. Burns and Cathy (Reference Burns and Catty2008); I. Kilian et al. (Reference Kilian, Lauber, Kalkan, Dorn, Rössler, Wiersma, Van Buschbach, Fioritti, Tomov, Catty, Burns and Becker2012); J. Drake et al. (Reference Drake, McHugo, Becker, Anthony and Clark1996); K. Christensen et al. (Reference Christensen, Wallstrøm, Stenager, Bojesen, Gluud, Nordentoft and Eplov2019); L. Clark et al. (Reference Clark, Xie, Becker and Drake1998); M. Davis et al. (Reference Davis, Leon, Toscano, Drebing, Ward, Parker, Kashner and Drake2012); N. Davis et al. (Reference Davis, Pilkinton, Poddar, Blansett, Toscano and Parker2014); O. Davis et al. (Reference Davis, Kyriakides, Suris, Ottomanelli, Drake, Parker, Mueller, Resnick, Toscano, Blansett, McCall and Huang2018a); P. Davis et al. (Reference Davis, Kyriakides, Suris, Ottomanelli, Mueller, Parker, Resnick, Toscano, Scrymgeour and Drake2018b); Q. Drake et al. (Reference Drake, McHugo, Bebout, Becker, Harris, Bond and Quimby1999); R. Dixon et al. (Reference Dixon, Hoch, Clark, Bebout, Drake, McHugo and Becker2002); S. Drake et al. (Reference Drake, Frey, Bond, Goldman, Salkever, Miller, Moore, Riley, Karakus and Milfort2013); T. Metcalfe et al. (Reference Metcalfe, Riley, McGurk, Hale, Drake and Bond2018b); U. Erickson et al. (Reference Erickson, Roes, DiGiacomo and Burns2021); V. Gold et al. (Reference Gold, Meisler, Santos, Carnemolla, Williams and Keleher2006); W. Hellström et al. (Reference Hellström, Bech, Hjorthøj, Nordentoft, Lindschou and Eplov2017); X. Howard et al. (Reference Howard, Heslin, Leese, McCrone, Rice, Jarrett, Spokes, Huxley and Thornicroft2010); Y. Heslin et al. (Reference Heslin, Howard, Leese, McCrone, Rice, Jarrett, Spokes, Huxley and Thornicroft2011); Z. Hoffmann et al. (Reference Hoffmann, Jäckel, Glauser and Kupper2012); AA. Hoffmann et al. (Reference Hoffmann, Jäckel, Glauser, Mueser and Kupper2014); AB. Jäckel et al. (Reference Jäckel, Kupper, Glauser, Mueser and Hoffmann2017); AC. Killackey et al. (Reference Killackey, Jackson and McGorry2008); AD. Killackey et al. (Reference Killackey, Allott, Jackson, Scutella, Tseng, Borland, Proffitt, Hunt, Kay-Lambkin, Chinnery, Baksheev, Alvarez-Jimenez, McGorry and Cotton2019); AE. Latimer et al. (Reference Latimer, Lecomte, Becker, Drake, Duclos, Piat, Lahaie, St-Pierre, Therrien and Xie2006); AF. Lehman et al. (Reference Lehman, Goldberg, Dixon, McNary, Postrado, Hackman and McDonnell2002); AG. Lones et al. (Reference Lones, Bond, McGovern, Carr, Leckron-Myers, Hartnett and Becker2017); AH. Michon et al. (Reference Michon, van Busschbach, Stant, Van Vugt, van Weeghel and Kroon2014); AI. Mueser et al. (Reference Mueser, Becker and Wolfe2001); AJ. Mueser et al. (Reference Mueser, Clark, Haines, Drake, McHugo, Bond, Essock, Becker, Wolfe and Swain2004); AK. Mueser et al. (Reference Mueser, Bond, Essock, Clark, Carpenter-Song, Drake and Wolfe2014); AL. Oshima et al. (Reference Oshima, Sono, Bond, Nishio and Ito2014); AM. Poremski et al. (Reference Poremski, Rabouin and Latimer2017); AN. Reme et al. (Reference Reme, Monstad, Fyhn, Sveinsdottir, Løvvik, Lie and Øverland2019); AO. Tsang et al. (Reference Tsang, Chan, Wong and Liberman2009); AP. Tsang et al. (Reference Tsang2011); AQ. Twamley et al. (Reference Twamley, Vella, Burton, Becker, Bell and Jeste2012); AR. Viering et al. (Reference Viering, Jäger, Bärtsch, Nordt, Rössler, Warnke and Kawohl2015); AS. Waghorn et al. (Reference Waghorn, Dias, Gladman, Harris and Saha2014); AT. Wong et al. (Reference Wong, Chiu, Tang, Mak, Liu and Chiu2008); AU. Zhang et al. (Reference Zhang, Tsui, Lu, Yu, Tsang and Li2017)

b A, active control group; E, excellent fidelity; F, Fair fidelity; G, good fidelity; NR, Not Reported; P, Passive control group;.

c IPS-15 item scale (Bond et al., Reference Bond, Becker, Drake and Vogler1997): item scale range: 15–75; Fidelity ratings: <55 = No IPS; 56–65 = Fair fidelity (F); >65 = Good fidelity (G); IPS-25 item scale (Bond, Peterson, Becker and Drake, Reference Bond, Peterson, Becker and Drake2012): item scale range: 25–125; Fidelity ratings: <74 = No IPS; 74–99 = Fair fidelity (F); 100–114 = Good fidelity (G); 115–125 = Exemplary fidelity (E).

Twenty-one studies compared IPS with an active control group and 12 studies compared IPS with a passive control group (including one study with both a passive and active control group). The overall study attrition rate (i.e., lost to follow-up) was 16.3% and only two studies reached a ‘high’ attrition rate exceeding 40%. Instruments for fidelity assessment differed between studies (see Table 2), but the majority of the studies (75.0%) achieved at least ‘good’ IPS programme fidelity.

Quality assessment

Quality assessment is reported in Fig. 2. Overall we found low levels of selection and attrition bias, but relatively higher levels of performance and detection bias. The majority of studies (81.3%) reported a low risk of selection bias (i.e., random sequence generation and allocation concealment). In the majority of studies (53.1%) the participants and personnel were not blinded or information about blinding was unclear (43.4%). However, given the nature of the intervention and the study design, it was generally not feasible to achieve proper blinding of participants, so a certain level of performance bias was inevitable. In nine studies (29.0%) the outcome assessors were not blinded, indicating a high risk of detection bias. This is a relatively large number of studies with a high risk of detection bias, compared with the other risk of bias domains. However, the outcomes we used in our meta-analysis (i.e., employment rate, job duration and wages) are objective outcome measures and not sensitive for the interpretation of the outcome assessor. Therefore, this might not have a large influence on the study outcomes. In most studies (67.7%) we found a low risk of attrition bias (i.e., incomplete outcome data). Five studies reported other sources of bias: three studies reported baseline differences between IPS and the control group that potentially influenced outcomes and one study indicated the potential influence of allegiance bias because specialists favoured one intervention over the other and one study had a low fidelity score during the first part of the study which may have negatively influenced study outcomes at the start of the study. There were no indications of selective outcome reporting in any of the 32 studies.

Fig. 2. Cochrane risk of bias assessment.

Overall meta-analysis

Thirty-one studies reported employment rate outcomes (see Table 3). A higher percentage of IPS participants (48.8%) than control group participants (28.3%) were employed during follow-up, showing small effect sizes (OR  =  2.62 [2.37–2.89], p < 0.01). Outcomes were moderately heterogeneous (I2 = 74% [67–80%]; p < 0.01). The overall effect sizes of the employment rate were not influenced by the follow-up duration. However, we did find more favourable employment rate outcomes for IPS in non-European studies compared with European studies (χ2 = 10.54; p < 0.01) and in studies that compared IPS with an active control group compared with a passive control group (χ2 = 10.77; p < 0.01).

Table 3. Overall meta-analysis of outcomes

a Some studies have used multiple follow-up assessments or have multiple treatment arms. Therefore, some studies are included in the analysis of both follow-up subgroups and one study compared IPS with both an active and passive control group. Therefore, the total amount of studies and sample sizes analysed in each comparison is sometimes lower than the sum of studies analysed in both follow-up subgroups.

b Summary statistics for each of the three employment outcomes are assessed as follows: Employment rate: number and percentage of people in competitive employment at the follow-up assessment; Job duration: percentage of time within the study period that participants are employed; Wages: monthly salary in euros during the study period.

c d > 0 and OR > 1 indicates outcomes are beneficial for IPS compared to the control group; d < 0 and OR < 1 indicates outcomes are beneficial for the control group compared to IPS.

d Magnitude of effect (Chinn, Reference Chinn2000): Not clinically relevant [N]: d > −0.2 – <0.2; OR > 0.67 – <1.5; Small effect [S]: d ⩽ −0.20 and >−0.50 – ⩾0.20 and <0.50; OR ⩽ 0.67 and >0.29 – ⩾1.5 and <3.5; Medium effect [M]: d ⩽ −0.50 and >−0.80 – ⩾0.50 and <0.80; OR ⩽ 0.29 and >0.20 – ⩾3.5 and <5; Large effect [L]: d < −0.80 – >0.80; OR < 0.20 – >5.

Twenty-three studies reported job duration outcomes. Results indicated that IPS participants were longer employed than those in the control group during follow-up, showing small effect sizes (d = 0.41 [0.30–0.52], p < 0.01). Outcomes were moderately heterogeneous (I2 = 77% [69–83%]; p < 0.01). The overall effect sizes of job duration were not influenced by the type of control group, follow-up duration or region.

Fifteen studies reported outcomes of wages. Results indicated that IPS participants earned more wages during the study period than those in the control group, though effect sizes were small (d = 0.31 [0.19–0.44], p < 0.01). Outcomes were moderately heterogeneous (I2 = 65% [51–76%]; p < 0.01). The overall effect sizes of wages were not influenced by the type of control group, follow-up duration or region.

Moderating effects on overall outcomes

Sensitivity analysis outcomes were reported in Table 4 and Fig. 3. We excluded some moderators in the sensitivity analysis of job duration and wages, because these moderators were reported in less than ten studies.

Fig. 3. Overview effect sizes of outcomes for each moderator.

Table 4. Sensitivity analysis of moderating effects on the outcomes

a d > 0 and OR > 1 indicates outcomes are beneficial for IPS compared to the control group; d < 0 and OR < 1 indicates outcomes are beneficial for the control group compared to IPS.

b Underlined moderators were significant moderators of outcome.

c Magnitude of effect: Not clinically relevant [N]: d > −0.2 – <0.2; OR > 0.67 – <1.5; Small effect [S]: d ⩽ −0.20 and >−0.50 – ⩾0.20 and <0.50; OR ⩽ 0.67 and >0.29 – ⩾1.5 and <3.5; Medium effect [M]: d ⩽ −0.50 and >−0.80 – ⩾0.50 and <0.80; OR ⩽ 0.29 and >0.20 – ⩾3.5 and <5; Large effect [L]: d < −0.80 – >0.80; OR < 0.20 – >5.

d Summary statistics for each of the three employment outcomes are assessed as follows: Employment rate: number and percentage of people in competitive employment at the follow-up assessment; Job duration: percentage of time within the study period employed that participants are employed; Wages: monthly salary in euros during the study period.

We found significant favourable employment rate outcomes in the IPS group compared with the control group in all subgroups. However, IPS showed more favourable outcomes in studies targeting participants with SMI than studies targeting CMD (χ 2 = 10.79; df = 1; p < 0.01). These differences between both subgroups were specifically explained by differences in employment rates in the control group (i.e., 38.3% in the CMD subgroup versus 23.9% in the SMI subgroup; χ 2 = 28.84; df = 1; p < 0.01). We also found more favourable outcomes for IPS in subgroups with a majority diagnosed with SSD (χ 2 = 18.24; df = 1; p < 0.01), as well as in subgroups with a minority diagnosed with MDD (χ 2 = 5.36; df = 1; p < 0.05), and in subgroups with a lower baseline level of symptoms (χ 2 = 20.48; df = 1; p < 0.01).

Figure 3 shows all subgroup outcomes. Subgroups with SMI, the majority diagnosed with SSD, low symptom severity, and low comorbid alcohol and substance use problems at baseline had a positive influence on the relative effectiveness of IPS.

None of the potential moderators included in the sensitivity analysis had significant effects on either job duration and wages.

As the type of control group and the region in which the study is executed significantly influenced employment rate outcomes, above-mentioned moderating effects might be explained by an overrepresentation of a specific moderator in one of the subgroups based on the region or type of control group. However, chi-square analyses did not find any indications of overrepresentation in any of these subgroups. We could therefore not explain any moderating effects by regional differences or type of control group.

Assessment of outliers and publication bias

We found two negative outliers and six positive outliers for employment rate, three negative outliers and three positive outliers for job duration and one negative and one positive outlier for wages. Removing these outliers did not positively or negatively influence the study outcomes.

The funnel plots are presented in online Supplementary materials 3. For all outcomes (employment rate, job duration and wages) we found no indications of publication bias.

Discussion

This meta-analysis investigated the relative effectiveness of IPS for different subgroups based on diagnostic, clinical, functional and personal characteristics. Overall, we found that IPS is effective in improving employment outcomes regardless of sample characteristics. However, we did find that IPS was relatively less effective in supporting service users into competitive employment in European studies and in studies comparing IPS to a passive control group. Furthermore, we found that IPS was relatively more effective for people with SMIs, compared with CMD. We also found more favourable outcomes of IPS in subgroups in which the majority was diagnosed with a schizophrenia spectrum disorder (SSD), in which the minority was diagnosed with major depressive disorder (MDD), subgroups with a low baseline symptom severity, and subgroups with a low baseline level of substance and alcohol use problems. These subgroup effects could not be explained by an overrepresentation of non-European studies or an active control group within any subgroup. Despite the fact that we found overall effectiveness of IPS for all subgroups, the issue remains that in many studies the majority of service users that received IPS remain unemployed. This highlights the need for continuous refinement of the IPS model.

The fact that IPS was less effective on employment rate outcomes in European studies is most probably explained by the relatively extensive welfare systems with a disability benefit structure in most European countries. The risk of losing steady income from disability benefits after finding competitive employment (i.e., the ‘benefits trap’) might discourage service users from seeking employment (Burns and Cathy, Reference Burns and Catty2008; Metcalfe et al., Reference Metcalfe, Drake and Bond2018a).

We also found that IPS was relatively more effective on employment rate outcomes when compared with an active control group than when compared with a passive control group. We found a slightly larger employment rate in the IPS group (i.e., 50.1% vs 48.3%) but a slightly smaller employment rate in the control group (i.e., 26.7% vs. 29.4%) when IPS was compared with an active control group. However, differences in both IPS and control groups were negligible and therefore we could not give any clinical meaningful explanations for the differences between both types of the control groups.

Our findings that IPS is relatively more effective for people with SMI and SSD and relatively less effective for people with MDD and CMD are in line with previous research (Hellström et al., Reference Hellström, Pedersen, Christensen, Wallstroem, Bojesen, Stenager, Bejerholm, Van Busschbach, Michon and Eplov2021). The main explanation for differences in the effectiveness of IPS between CMD and SMI subgroups is that employment rate outcomes in the control group were larger in the CMD subgroup, whereas the outcomes were equal in the IPS group. Previous research found even more favourable employment outcomes in the control group for people with mood disorders or less severe thought disorders (Campbell et al., Reference Campbell, Bond, Drake, McHugo and Xie2010; Jonsdottir and Waghorn, Reference Jonsdottir and Waghorn2015). This may indicate that people with CMD also benefit from other vocational rehabilitation interventions. Nevertheless, our meta-analysis indicates that IPS leads to more favourable employment outcomes for people with CMD compared to any control group, and these indications of effectiveness were also found in another recently published meta-analysis (Probyn et al., Reference Probyn, Engedahl, Rajendran, Pincus, Naeem, Mistry, Underwood and Froud2021).

Another possible explanation for the differences between CMD and SMI subgroups is the fact that IPS is originally developed for people with SMI who are generally supported by professionals working in integrated treatment teams, whereas service users with CMD are often supported in different healthcare settings. Previous research indicated that the level of organisational characteristics, such as the type of clinical practice, service intensity and quality of mental health treatment could be an important prerequisite for successful implementation (Lockett et al., Reference Lockett, Waghorn and Kydd2018). This explanation is supported by two studies that conducted IPS for service users with CMD (Hellström et al., Reference Hellström, Bech, Hjorthøj, Nordentoft, Lindschou and Eplov2017; Poremski et al., Reference Poremski, Rabouin and Latimer2017) in another healthcare setting for this group. These differences can also partially be explained by the fidelity scores. Only fifty per cent of all studies that evaluated the effectiveness of IPS for people with CMD reached a fair fidelity. In contrast, 89% of the studies that evaluated the effectiveness of IPS for people with SMI achieved good or excellent fidelity. Given the fact that better fidelity scores lead to better outcomes in IPS (Bond et al., Reference Bond, Peterson, Becker and Drake2012; Kim et al., Reference Kim, Bond, Becker, Swanson and Langfitt-Reese2015; Lockett et al., Reference Lockett, Waghorn, Kydd and Chant2016; De Winter et al., Reference De Winter, Couwenbergh, van Weeghel, Bergmans and Bond2020), this might be an important explanation for the differences in outcomes between SMI and CMD subgroups. In addition to fidelity, other important factors, such as the quality of healthcare services and the intensity of employment support might also be relevant topics for further investigation. Therefore, poorer outcomes for people with CMD compared to people SMI might partially be explained by specific challenges in the implementation of IPS in a different healthcare setting, which underlines our recommendation to adapt implementation for specific subgroups.

We also found more favourable indications of the effectiveness of IPS for people with lower symptom severity and lower comorbid substance and alcohol use problems at the start of IPS. This is in line with previous studies which also indicated that lower symptom severity increased the odds of being employed for people who received any type of vocational rehabilitation (Michon et al., Reference Michon, van Weeghel, Kroon and Schene2005; Campbell et al., Reference Campbell, Bond, Drake, McHugo and Xie2010; Nygren et al., Reference Nygren, Markström, Bernspång, Svensson, Hansson and Sandlund2013). This might be explained by the fact that a lower symptom severity frees up more time for and focus on the adequate job support, because less focus on symptom stabilisation and intensive treatment programmes is needed.

The positive influence of low symptom severity on the effectiveness of IPS may contradict the superior outcomes of IPS for people with SMI compared with CMD, as SMIs are generally associated with higher symptom severity. However, four out of the five studies (80%) that reported outcomes of IPS for people with CMD had a high symptom severity at baseline. Therefore, symptom severity and the severity of illness are not interrelated in this meta-analysis.

This meta-analysis had several limitations. First, all our findings were analysed on a study level and subgroups were based on aggregated scores or percentages of the whole study sample. This analysis provides an overarching overview of the influence of specific service users' characteristics on the effectiveness of IPS, but does not reflect on the specific variability of individual client level characteristics or outcomes. However, despite this limitation, this meta-analysis gives valuable insights toward better understanding of making effective adaptations in the implementation of IPS in real-world settings. Analysis of outcomes on a study level inevitably leads to heterogeneity of outcomes because the context and setting in which the studies are executed differ (Ioannidis, Reference Ioannidis2008). Furthermore, this meta-analysis only focused on the effectiveness of IPS as a stand-alone intervention within a mental health population, in order to achieve a relatively homogeneous sample of studies. As a consequence, we did not include a number of relevant studies that exclusively investigating IPS with an add-on intervention (e.g., McGurk et al., Reference McGurk, Mueser, Xie, Welsh, Kaiser, Drake, Becker, Bailey, Fraser, Wolfe and McHugo2015; Tsang et al., Reference Tsang, Bell, Cheung, Tam and Yeung2016) or studies focused on populations with a high risk of developing mental disorders (e.g., Sveinsdottir et al., Reference Sveinsdottir, Lie, Bond, Eriksen, Tveito, Grasdal and Reme2019). This also partially explained the lack of available study data to investigate the influence of other relevant moderators (such as cognitive functioning). Second, some of our sensitivity analyses, in which we investigated moderating effects, were based on a relatively low number of studies. This might have limited the generalisability of outcomes for subgroups based on a small number of studies. Another limitation is that 12 (37.5%) of our included studies are conducted more than 10 years ago. During that time IPS was executed in a societal setting, that was applicable at that time, with most probably other welfare policies or treatment practices than implemented nowadays. Another potential limitation is the fact that the broad variety of studies might influence the interpretation and representativeness of some moderating effects. Our included studies investigated target groups with different diagnoses and clinical characteristics and were therefore in some cases using different assessment instruments. This was specifically the case in the moderating effects of the severity of symptoms and level of functioning. We tried to solve this issue by using normative data based on representative target groups that matches with each included study. However, this inevitably leads to heterogeneity in the outcomes. Interpretation of the findings on the influence of symptom severity and level of functioning on employment should therefore be handled with caution. Finally, we have executed a relatively high number of sensitivity analyses based on a relatively low number of studies. This increases the chance of false-positive outcomes and alpha inflation (Wang et al., Reference Wang, Sparks, Gonzales, Hess and Ledgerwood2017). We should therefore consider the results of this meta-analysis as exploratory and the findings suggesting potentially valuable trends for improving IPS for different target groups.

Overall this meta-analysis has shown that IPS is implemented for a wide variety of service users: IPS is effective for different subgroups, regardless of distinct diagnostic, clinical, functional and personal characteristics. However, future research should focus on the implementation of IPS for people with CMD and higher symptom severity. It is important to investigate whether, and if so, how to make more effective adaptations in the implementation of IPS to better meet the vocational needs of these groups.

Supplementary material

The supplementary material for this article can be found at https://doi.org/10.1017/S2045796022000300

Availability of data and materials

The majority of relevant data and materials are presented in the tables and online Supplementary materials, as well as partially available in the review protocol that is submitted in PROSPERO (CRD42020220080). All other raw data is not available online. Further questions and requests about the availability of the data could be sent to the corresponding authors (Lars de Winter; ).

Conflict of interest

All authors gave final approval to the submitted manuscript and contributed to the draft, conception and design of the manuscript. Furthermore, all authors report no competing interests or financial relationships with commercial interests.

References

American Psychiatric Association (2000) Diagnostic and Statistical Manual of Mental Disorders, 4th ed., text rev. Washington, DC: American Psychiatric Association.Google Scholar
American Psychiatric Association (1980) Diagnostic and Statistical Manual of Mental Disorders, 3rd ed., Washington, DC: American Psychiatric Association.Google Scholar
American Psychiatric Association (2013) Diagnostic and Statistical Manual of Mental Disorders, 5th ed., Washington, DC: American Psychiatric Association.Google Scholar
Areberg, C and Bejerholm, U (2013) The effect of IPS on participants' engagement, quality of life, empowerment, and motivation: a randomized controlled trial. Scandinavian Journal of Occupational Therapy 20, 420428.CrossRefGoogle ScholarPubMed
Becker, DR and Drake, RE (2003) A Working Life for People with Severe Mental Illness. New York: Oxford University Press.Google Scholar
Bejerholm, U, Areberg, C, Hofgren, C, Sandlund, M and Rinaldi, M (2015) Individual placement and support in Sweden – a randomized controlled trial. Nordic Journal of Psychiatry 69, 5766.CrossRefGoogle ScholarPubMed
Bejerholm, U, Larsson, ME and Johanson, S (2017) Supported employment adapted for people with affective disorders – A randomized controlled trial. Journal of Affective Disorders 207, 212220.CrossRefGoogle ScholarPubMed
Bond, GR, Becker, DR, Drake, RE and Vogler, KM (1997) A fidelity scale for the individual placement and support model of supported employment. Rehabilitation Counseling Bulletin 40, 265284.Google Scholar
Bond, GR, Salyers, MP, Dincin, J, Drake, RE, Becker, DR, Fraser, VV and Haines, M (2007) A randomized controlled trial comparing two vocational models for persons with severe mental illness. Journal of Consulting and Clinical Psychology 75, 968.Google ScholarPubMed
Bond, GR, Peterson, AE, Becker, DR and Drake, RE (2012) Validation of the revised individual placement and support fidelity scale (IPS-25). Psychiatric Services 63, 758763.CrossRefGoogle Scholar
Bond, GR, Campbell, K and Becker, DR (2013) A test of the occupational matching hypothesis for rehabilitation clients with severe mental illness. Journal of Occupational Rehabilitation 23, 261269.Google ScholarPubMed
Bond, GR, Kim, SJ, Becker, DR, Swanson, SJ, Drake, RE, Krzos, IM, Fraser, VV, O'Neill, S and Frounfelker, RL (2015) A controlled trial of supported employment for people with severe mental illness and justice involvement. Psychiatric Services 66, 10271034.CrossRefGoogle ScholarPubMed
Bond, GR, Drake, RE and Pogue, JA (2019) Expanding individual placement and support to populations with conditions and disorders other than serious mental illness. Psychiatric Services 70, 488498.CrossRefGoogle ScholarPubMed
Borenstein, M and Higgins, JP (2013) Meta-analysis and subgroups. Prevention Science 14, 134143.Google ScholarPubMed
Borenstein, M, Hedges, LV, Higgins, JP and Rothstein, HR (2021) Introduction to Meta-Analysis. Hoboken, USA: John Wiley & Sons.CrossRefGoogle Scholar
Burns, T and Catty, J (2008) IPS in Europe: the EQOLISE trial. Psychiatric Rehabilitation Journal 31, 313317.CrossRefGoogle ScholarPubMed
Burns, T, Catty, J, Becker, T, Drake, RE, Fioritti, A, Knapp, M, Lauber, C, Rössler, W, Tomov, T, Van Busschbach, J, White, S, Wiersma, D and EQOLISE Group (2007) The effectiveness of supported employment for people with severe mental illness: a randomised controlled trial. The Lancet 370, 11461152.Google ScholarPubMed
Campbell, K, Bond, GR, Drake, RE, McHugo, GJ and Xie, H (2010) Client predictors of employment outcomes in high-fidelity supported employment: a regression analysis. Journal of Nervous and Mental Disease 198, 556563.CrossRefGoogle ScholarPubMed
Catty, J, Lissouba, P, White, S, Becker, T, Drake, RE, Fioritti, A, Knapp, M, Lauber, C, Rössler, W, Tomov, T, Van Busschbach, J, Wiersma, D and EQOLISE Group (2008) Predictors of employment for people with severe mental illness: results of an international six-centre randomised controlled trial. The British Journal of Psychiatry 192, 224231.CrossRefGoogle ScholarPubMed
Chinn, S (2000) A simple method for converting an odds ratio to effect size for use in meta-analysis. Statistics in Medicine 19, 31273131.Google ScholarPubMed
Christensen, TN, Wallstrøm, IG, Stenager, E, Bojesen, AB, Gluud, C, Nordentoft, M and Eplov, LF (2019) Effects of individual placement and support supplemented with cognitive remediation and work-focused social skills training for people with severe mental illness: a randomized clinical trial. JAMA Psychiatry 76, 12321240.Google ScholarPubMed
Christensen, TN, Wallstrøm, IG, Bojesen, AB, Nordentoft, M and Eplov, LF (2021) Predictors of work and education among people with severe mental illness who participated in the Danish individual placement and support study: findings from a randomized clinical trial. Social Psychiatry and Psychiatric Epidemiology 56, 16691677.CrossRefGoogle ScholarPubMed
Clark, RE, Xie, H, Becker, DR and Drake, RE (1998) Benefits and costs of supported employment from three perspectives. The Journal of Behavioral Health Services & Research 25, 2234.Google ScholarPubMed
Davis, LL, Leon, AC, Toscano, R, Drebing, CE, Ward, LC, Parker, PE, Kashner, MT and Drake, RE (2012) A randomized controlled trial of supported employment among veterans with posttraumatic stress disorder. Psychiatric Services 63, 464470.CrossRefGoogle ScholarPubMed
Davis, LL, Pilkinton, P, Poddar, S, Blansett, C, Toscano, R and Parker, PE (2014) Impact of social challenges on gaining employment for veterans with posttraumatic stress disorder: an exploratory moderator analysis. Psychiatric Rehabilitation Journal 37, 107109.CrossRefGoogle ScholarPubMed
Davis, LL, Kyriakides, TC, Suris, A, Ottomanelli, L, Drake, RE, Parker, PE, Mueller, L, Resnick, SG, Toscano, R, Blansett, CM, McCall, KP and Huang, GD (2018a) Veterans individual placement and support towards advancing recovery: methods and baseline clinical characteristics of a multisite study. Psychiatric Rehabilitation Journal 41, 5566.CrossRefGoogle Scholar
Davis, LL, Kyriakides, TC, Suris, AM, Ottomanelli, LA, Mueller, L, Parker, PE, Resnick, SG, Toscano, R, Scrymgeour, AA and Drake, RE (2018b) Effect of evidence-based supported employment vs transitional work on achieving steady work among veterans with posttraumatic stress disorder: a randomized clinical trial. JAMA Psychiatry 75, 316324.CrossRefGoogle Scholar
De Vries, S, Ten Have, M, van Dorsselaer, S, van Wezep, M, Hermans, T and de Graaf, R (2016) Local availability of green and blue space and prevalence of common mental disorders in the Netherlands. BJPsych Open 2, 366372.Google ScholarPubMed
De Winter, L, Couwenbergh, C, van Weeghel, J, Bergmans, C and Bond, GR (2020) Fidelity and IPS: does quality of implementation predict vocational outcomes over time for organizations treating persons with severe mental illness in the Netherlands? Social Psychiatry and Psychiatric Epidemiology 55, 16071617.Google ScholarPubMed
Dixon, L, Hoch, JS, Clark, R, Bebout, R, Drake, R, McHugo, G and Becker, D (2002) Cost-effectiveness of two vocational rehabilitation programs for persons with severe mental illness. Psychiatric Services 53, 11181124.CrossRefGoogle ScholarPubMed
Drake, RE and Wallach, MA (2020) Employment is a critical mental health intervention. Epidemiology and Psychiatric Sciences 29, e178, 1–3. https://doi.org/10.1017/S2045796020000906.CrossRefGoogle ScholarPubMed
Drake, RE, McHugo, GJ, Becker, DR, Anthony, WA and Clark, RE (1996) The New Hampshire study of supported employment for people with severe mental illness. Journal of Consulting and Clinical Psychology 64, 391399.CrossRefGoogle ScholarPubMed
Drake, RE, McHugo, GJ, Bebout, RR, Becker, DR, Harris, M, Bond, GR and Quimby, E (1999) A randomized clinical trial of supported employment for inner-city patients with severe mental disorders. Archives of General Psychiatry 56, 627633.CrossRefGoogle ScholarPubMed
Drake, RE, Frey, W, Bond, GR, Goldman, HH, Salkever, D, Miller, A, Moore, TA, Riley, J, Karakus, M and Milfort, R (2013) Assisting social security disability insurance beneficiaries with schizophrenia, bipolar disorder, or major depression in returning to work. American Journal of Psychiatry 170, 14331441.CrossRefGoogle ScholarPubMed
Drake, RE, Becker, DR and Bond, GR (2019) Introducing individual placement and support (IPS) supported employment in Japan. Psychiatry and Clinical Neurosciences 73, 4749.CrossRefGoogle ScholarPubMed
Dunn, EC, Wewiorski, NJ and Rogers, ES (2008) The meaning and importance of employment to people in recovery from serious mental illness: results of a qualitative study. Psychiatric Rehabilitation Journal 32, 5962.CrossRefGoogle ScholarPubMed
Erickson, DH, Roes, MM, DiGiacomo, A and Burns, A (2021) “individual placement and support” boosts employment for early psychosis clients, even when baseline rates are high. Early Intervention in Psychiatry 15, 662668.CrossRefGoogle ScholarPubMed
Fyhn, T, Øverland, S and Reme, SE (2020) Predictors of employment in people with moderate to severe mental illness participating in a randomized controlled trial of individual placement and support (IPS). International Journal of Social Psychiatry 67, 150157.CrossRefGoogle Scholar
Gold, PB, Meisler, N, Santos, AB, Carnemolla, MA, Williams, OH and Keleher, J (2006) Randomized trial of supported employment integrated with assertive community treatment for rural adults with severe mental illness. Schizophrenia Bulletin 32, 378395.CrossRefGoogle ScholarPubMed
Hakulinen, C, Elovainio, M, Arffman, M, Lumme, S, Suokas, K, Pirkola, S, Keskimäki, I, Manderbacka, K and Böckerman, P (2020) Employment status and personal income before and after onset of a severe mental disorder: a case-control study. Psychiatric Services 71, 250255.CrossRefGoogle ScholarPubMed
Hellström, L, Bech, P, Hjorthøj, C, Nordentoft, M, Lindschou, J and Eplov, LF (2017) Effect on return to work or education of individual placement and support modified for people with mood and anxiety disorders: results of a randomised clinical trial. Occupational and Environmental Medicine 74, 717725.CrossRefGoogle ScholarPubMed
Hellström, L, Pedersen, P, Christensen, TN, Wallstroem, IG, Bojesen, AB, Stenager, E, Bejerholm, U, Van Busschbach, J, Michon, H and Eplov, LF (2021) Vocational outcomes of the individual placement and support model in subgroups of diagnoses, substance abuse, and forensic conditions: a systematic review and analysis of pooled original data. Journal of Occupational Rehabilitation 31, 699710.CrossRefGoogle ScholarPubMed
Heslin, M, Howard, L, Leese, M, McCrone, PAUL, Rice, C, Jarrett, M, Spokes, T, Huxley, P and Thornicroft, G (2011) Randomized controlled trial of supported employment in England: 2 year follow-up of the Supported Work and Needs (SWAN) study. World Psychiatry 10, 132137.CrossRefGoogle ScholarPubMed
Higgins, JPT and Thompson, SG (2002) Quantifying heterogeneity in a meta-analysis. Statistics in Medicine 21, 15391558.CrossRefGoogle ScholarPubMed
Higgins, JPT and Green, S (2008) Cochrane Handbook for Systematic Reviews of Interventions. Chichester, Hoboken, NJ, England: Wiley Blackwell.CrossRefGoogle Scholar
Hoffmann, H, Jäckel, D, Glauser, S and Kupper, Z (2012) A randomised controlled trial of the efficacy of supported employment. Acta Psychiatrica Scandinavica 125, 157167.CrossRefGoogle ScholarPubMed
Hoffmann, H, Jäckel, D, Glauser, S, Mueser, KT and Kupper, Z (2014) Long-term effectiveness of supported employment: 5-year follow-up of a randomized controlled trial. American Journal of Psychiatry 171, 11831190.CrossRefGoogle ScholarPubMed
Howard, LM, Heslin, M, Leese, M, McCrone, P, Rice, C, Jarrett, M, Spokes, T, Huxley, P and Thornicroft, G (2010) Supported employment: randomised controlled trial. The British Journal of Psychiatry 196, 404411.CrossRefGoogle ScholarPubMed
Ioannidis, JP (2008) Interpretation of tests of heterogeneity and bias in meta-analysis. Journal of Evaluation in Clinical Practice 14, 951957.CrossRefGoogle ScholarPubMed
Jäckel, D, Kupper, Z, Glauser, S, Mueser, KT and Hoffmann, H (2017) Effects of sustained competitive employment on psychiatric hospitalizations and quality of life. Psychiatric Services 68, 603609.CrossRefGoogle ScholarPubMed
Jackson, D and Turner, R (2017) Power analysis for random-effects meta-analysis. Research Synthesis Methods 8, 290302.CrossRefGoogle ScholarPubMed
Jonsdottir, A and Waghorn, G (2015) Psychiatric disorders and labour force activity. Mental Health Review Journal 20, 1327.CrossRefGoogle Scholar
Kilian, R, Lauber, C, Kalkan, R, Dorn, W, Rössler, W, Wiersma, D, Van Buschbach, JT, Fioritti, A, Tomov, T, Catty, J, Burns, T and Becker, T (2012) The relationships between employment, clinical status, and psychiatric hospitalisation in patients with schizophrenia receiving either IPS or a conventional vocational rehabilitation programme. Social Psychiatry and Psychiatric Epidemiology 47, 13811389.CrossRefGoogle ScholarPubMed
Killackey, E, Jackson, HJ and McGorry, PD (2008) Vocational intervention in first-episode psychosis: individual placement and support v. treatment as usual. The British Journal of Psychiatry 193, 114120.CrossRefGoogle ScholarPubMed
Killackey, E, Allott, K, Jackson, HJ, Scutella, R, Tseng, YP, Borland, J, Proffitt, T, Hunt, S, Kay-Lambkin, F, Chinnery, G, Baksheev, G, Alvarez-Jimenez, M, McGorry, PD and Cotton, SM (2019) Individual placement and support for vocational recovery in first-episode psychosis: randomised controlled trial. The British Journal of Psychiatry 214, 7682.CrossRefGoogle ScholarPubMed
Kim, SJ, Bond, GR, Becker, DR, Swanson, SJ and Langfitt-Reese, S (2015) Predictive validity of the individual placement and support fidelity scale (IPS-25): a replication study. Journal of Vocational Rehabilitation 43, 209216.CrossRefGoogle Scholar
Kozma, C, Dirani, R, Canuso, C and Mao, L (2010) Change in employment status over 52 weeks in patients with schizophrenia: an observational study. Current Medical Research and Opinion 27, 327333.CrossRefGoogle ScholarPubMed
Landis, JR and Koch, GG (1977). The measurement of observer agreement for categorical data. Biometrics 33, 159174.CrossRefGoogle ScholarPubMed
Latimer, EA, Lecomte, T, Becker, DR, Drake, RE, Duclos, I, Piat, M, Lahaie, N, St-Pierre, M, Therrien, C and Xie, H (2006) Generalisability of the individual placement and support model of supported employment: results of a Canadian randomised controlled trial. The British Journal of Psychiatry 189, 6573.CrossRefGoogle ScholarPubMed
Lehman, AF, Goldberg, R, Dixon, LB, McNary, S, Postrado, L, Hackman, A and McDonnell, K (2002) Improving employment outcomes for persons with severe mental illnesses. Archives of General Psychiatry 59, 165172.Google ScholarPubMed
Lockett, H, Waghorn, G, Kydd, R and Chant, D (2016) Predictive validity of evidence-based practices in supported employment: a systematic review and meta-analysis. Mental Health Review Journal 21, 261281.CrossRefGoogle Scholar
Lockett, H, Waghorn, G and Kydd, R (2018) A framework for improving the effectiveness of evidence-based practices in vocational rehabilitation. Journal of Vocational Rehabilitation 49, 1531.CrossRefGoogle Scholar
Lones, CE, Bond, GR, McGovern, MP, Carr, K, Leckron-Myers, T, Hartnett, T and Becker, DR (2017) Individual placement and support (IPS) for methadone maintenance therapy patients: a pilot randomized controlled trial. Administration and Policy in Mental Health and Mental Health Services Research 44, 359364.CrossRefGoogle ScholarPubMed
Luciano, A, Bond, GR and Drake, RE (2014) Does employment alter the course and outcome of schizophrenia and other severe mental illnesses? A systematic review of longitudinal research. Schizophrenia Research 159, 312321.CrossRefGoogle ScholarPubMed
Marwaha, S, Johnson, S, Bebbington, P, Stafford, M, Angermeyer, MC, Brugha, T, Kilian, R, Hansen, K and Toumi, M (2007) Rates and correlates of employment in people with schizophrenia in the UK, France and Germany. The British Journal of Psychiatry 191, 3037.CrossRefGoogle ScholarPubMed
Marwaha, S, Johnson, S, Bebbington, PE, Angermeyer, MC, Brugha, TS, Azorin, JM, Kilian, R, Hansen, K and Toumi, M (2009) Predictors of employment status change over 2 years in people with schizophrenia living in Europe. Epidemiology and Psychiatric Sciences 18, 344351.CrossRefGoogle ScholarPubMed
McGurk, SR, Mueser, KT, Xie, H, Welsh, J, Kaiser, S, Drake, RE, Becker, DR, Bailey, E, Fraser, G, Wolfe, R and McHugo, GJ (2015) Cognitive enhancement treatment for people with mental illness who do not respond to supported employment: a randomized controlled trial. American Journal of Psychiatry 172, 852861.CrossRefGoogle Scholar
McHugh, ML (2012) Interrater reliability: the kappa statistic. Biochemia Medica 22, 276282.CrossRefGoogle ScholarPubMed
Metcalfe, JD, Drake, RE and Bond, GR (2018a) Economic, labor, and regulatory moderators of the effect of individual placement and support among people with severe mental illness: a systematic review and meta-analysis. Schizophrenia Bulletin 44, 2231.CrossRefGoogle Scholar
Metcalfe, JD, Riley, J, McGurk, S, Hale, T, Drake, RE and Bond, GR (2018b) Comparing predictors of employment in individual placement and support: a longitudinal analysis. Psychiatry Research 264, 8590.CrossRefGoogle Scholar
Michon, HW, van Weeghel, J, Kroon, H and Schene, AH (2005) Person-related predictors of employment outcomes after participation in psychiatric vocational rehabilitation programmes. Social Psychiatry and Psychiatric Epidemiology 40, 408416.CrossRefGoogle ScholarPubMed
Michon, H, van Busschbach, JT, Stant, AD, Van Vugt, MD, van Weeghel, J and Kroon, H (2014) Effectiveness of individual placement and support for people with severe mental illness in The Netherlands: a 30-month randomized controlled trial. Psychiatric Rehabilitation Journal 37, 129136.CrossRefGoogle ScholarPubMed
Modini, M, Tan, L, Brinchmann, B, Wang, MJ, Killackey, E, Glozier, N, Mykletun, A and Harvey, SB (2016) Supported employment for people with severe mental illness: systematic review and meta-analysis of the international evidence. The British Journal of Psychiatry 209, 1422.CrossRefGoogle ScholarPubMed
Mueser, T, Becker, DB and Wolfe, RK (2001) Supported employment, job preferences, job tenure and satisfaction. Journal of Mental Health 10, 411417.Google Scholar
Mueser, KT, Clark, RE, Haines, M, Drake, RE, McHugo, GJ, Bond, GR, Essock, SM, Becker, DR, Wolfe, R and Swain, K (2004) The Hartford study of supported employment for persons with severe mental illness. Journal of Consulting and Clinical Psychology 72, 479490.CrossRefGoogle ScholarPubMed
Mueser, KT, Bond, GR, Essock, SM, Clark, RE, Carpenter-Song, E, Drake, RE and Wolfe, R (2014) The effects of supported employment in Latino consumers with severe mental illness. Psychiatric Rehabilitation Journal 37, 113122.CrossRefGoogle ScholarPubMed
Nygren, U, Markström, U, Bernspång, B, Svensson, B, Hansson, L and Sandlund, M (2013) Predictors of vocational outcomes using individual placement and support for people with mental illness. Work 45, 3139.Google ScholarPubMed
Oshima, I, Sono, T, Bond, GR, Nishio, M and Ito, J (2014) A randomized controlled trial of individual placement and support in Japan. Psychiatric Rehabilitation Journal 37, 137.CrossRefGoogle ScholarPubMed
Page, MJ, McKenzie, JE, Bossuyt, PM, Boutron, I, Hoffmann, TC, Mulrow, CD, Shamseer, L, Tetzlaff, JM, Akl, EA, Brennan, SE, Chou, R, Glanville, J, Grimshaw, JM, Hróbjartsson, A, Lalu, MM, Li, T, Loder, EW, Mayo-Wilson, E, McDonald, S, McGuinness, LA, Stewart, LA, Thomas, J, Tricco, AC, Welch, VA, Whiting, P and Moher, D (2021) The PRISMA 2020 statement: an updated guideline for reporting systematic reviews. International Journal of Surgery 88, 105906.CrossRefGoogle ScholarPubMed
Poremski, D, Rabouin, D and Latimer, E (2017) A randomised controlled trial of evidence based supported employment for people who have recently been homeless and have a mental illness. Administration and Policy in Mental Health and Mental Health Services Research 44, 217224.CrossRefGoogle ScholarPubMed
Probyn, K, Engedahl, MS, Rajendran, D, Pincus, T, Naeem, K, Mistry, D, Underwood, M and Froud, R (2021) The effects of supported employment interventions in populations of people with conditions other than severe mental health: a systematic review. Primary Health Care Research & Development 22, e79.CrossRefGoogle ScholarPubMed
Reme, SE, Monstad, K, Fyhn, T, Sveinsdottir, V, Løvvik, C, Lie, SA and Øverland, SN (2019) A randomized controlled multicenter trial of individual placement and support for patients with moderate-to-severe mental illness. Scandinavian Journal of Work, Environment & Health 45, 3341.CrossRefGoogle ScholarPubMed
Steel, Z, Marnane, C, Iranpour, C, Chey, T, Jackson, JW, Patel, V and Silove, D (2014) The global prevalence of common mental disorders: a systematic review and meta-analysis 1980–2013. International Journal of Epidemiology 43, 476493.CrossRefGoogle ScholarPubMed
Sveinsdottir, V, Lie, SA, Bond, GR, Eriksen, HR, Tveito, TH, Grasdal, A and Reme, SE (2019) Individual placement and support for young adults at risk of early work disability (the SEED trial). A randomized controlled trial. Scandinavian Journal of Work, Environment & Health 46, 5059.CrossRefGoogle ScholarPubMed
The Nordic Cochrane Centre (2014) Review Manager (RevMan) [Computer Program]. Version 5.3. Copenhagen: The Nordic Cochrane Centre, The Cochrane Collaboration.Google Scholar
Tsang, HW (2011) Supported employment versus traditional vocational rehabilitation for individuals with severe mental illness: a three-year study. Hong Kong Medical Journal = Xianggang yi xue za zhi 17, 1317.Google ScholarPubMed
Tsang, HW, Chan, A, Wong, A and Liberman, RP (2009) Vocational outcomes of an integrated supported employment program for individuals with persistent and severe mental illness. Journal of Behavior Therapy and Experimental Psychiatry 40, 292305.CrossRefGoogle ScholarPubMed
Tsang, HW, Bell, MD, Cheung, V, Tam, KL and Yeung, WS (2016) Integrated supported employment plus cognitive remediation training for people with schizophrenia. Hong Kong Medical Journal 22(suppl. 2), S15S18.Google ScholarPubMed
Twamley, EW, Vella, L, Burton, CZ, Becker, DR, Bell, MD and Jeste, DV (2012) The efficacy of supported employment for middle-aged and older people with schizophrenia. Schizophrenia Research 135, 100104.CrossRefGoogle ScholarPubMed
Viering, S, Jäger, M, Bärtsch, B, Nordt, C, Rössler, W, Warnke, I and Kawohl, W (2015) Supported employment for the reintegration of disability pensioners with mental illnesses: a randomized controlled trial. Frontiers in Public Health 3, 237. https://doi.org/10.3389/fpubh.2015.00237.CrossRefGoogle ScholarPubMed
Vollebergh, WA, Iedema, J, Bijl, RV, de Graaf, R, Smit, F and Ormel, J (2001) The structure and stability of common mental disorders: the NEMESIS study. Archives of General Psychiatry 58, 597603.CrossRefGoogle ScholarPubMed
Waghorn, G, Dias, S, Gladman, B, Harris, M and Saha, S (2014) A multi-site randomised controlled trial of evidence-based supported employment for adults with severe and persistent mental illness. Australian Occupational Therapy Journal 61, 424436.CrossRefGoogle ScholarPubMed
Wang, YA, Sparks, J, Gonzales, JE, Hess, YD and Ledgerwood, A (2017) Using independent covariates in experimental designs: quantifying the trade-off between power boost and Type I error inflation. Journal of Experimental Social Psychology 72, 118124.CrossRefGoogle Scholar
Wong, KK, Chiu, R, Tang, B, Mak, D, Liu, J and Chiu, SN (2008) A randomized controlled trial of a supported employment program for persons with long-term mental illness in Hong Kong. Psychiatric Services 59, 8490.CrossRefGoogle Scholar
World Health Organization (2016) International Statistical Classification of Diseases and Related Health Problems, 10th Edition. Geneva, Switzerland: World Health Organization https://icd.who.int/browse10/2016/en.Google Scholar
World Health Organization (2019) International Statistical Classification of Diseases and Related Health Problems, 11th Edition. Geneva, Switzerland: World Health Organization. https://icd.who.int.Google Scholar
Zhang, GF, Tsui, CM, Lu, AJB, Yu, LB, Tsang, HWH and Li, D (2017) Integrated supported employment for people with schizophrenia in mainland China: a randomized controlled trial. American Journal of Occupational Therapy 71, 7106165020p17106165020p8.CrossRefGoogle ScholarPubMed
Figure 0

Table 1. Operationalisations of moderators

Figure 1

Fig. 1. Flow chart selection studies conform Prisma guidelines.

Figure 2

Table 2. Characteristics of included studies

Figure 3

Fig. 2. Cochrane risk of bias assessment.

Figure 4

Table 3. Overall meta-analysis of outcomes

Figure 5

Fig. 3. Overview effect sizes of outcomes for each moderator.

Figure 6

Table 4. Sensitivity analysis of moderating effects on the outcomes

Supplementary material: File

de Winter et al. supplementary material

de Winter et al. supplementary material

Download de Winter et al. supplementary material(File)
File 72.2 KB