Hostname: page-component-cd9895bd7-mkpzs Total loading time: 0 Render date: 2024-12-23T08:13:53.918Z Has data issue: false hasContentIssue false

Who benefits from indirect prevention and treatment of depression using an online intervention for insomnia? Results from an individual-participant data meta-analysis

Published online by Cambridge University Press:  12 March 2024

Janika Thielecke*
Affiliation:
Department of Sports and Health Sciences, Technical University of Munich, Munich, Germany Department of Clinical Psychology and Psychotherapy, Institute of Psychology, Friedrich-Alexander-University Erlangen-Nürnberg, Erlangen, Germany Unit Healthy Living & Work, TNO (The Netherlands Organization for Applied Scientific Research), Leiden, Netherlands
Paula Kuper
Affiliation:
Department of Sports and Health Sciences, Technical University of Munich, Munich, Germany Institute of Social Medicine and Health Systems Research, Faculty of Medicine, Otto von Guericke University Magdeburg, Magdeburg, Germany
Dirk Lehr
Affiliation:
Department of Health Psychology and Applied Biological Psychology, Institute for Sustainability, Education & Psychology, Leuphana University Luneburg, Luneburg, Germany
Lea Schuurmans
Affiliation:
Department of Sports and Health Sciences, Technical University of Munich, Munich, Germany
Mathias Harrer
Affiliation:
Department of Sports and Health Sciences, Technical University of Munich, Munich, Germany GET.ON Institute for Online Health Trainings GmbH, Berlin, Germany
David D. Ebert
Affiliation:
Department of Sports and Health Sciences, Technical University of Munich, Munich, Germany
Pim Cuijpers
Affiliation:
Department of Clinical, Neuro and Developmental Psychology, VU University, Amsterdam, Netherlands Amsterdam Public Health, Amsterdam University Medical Centers, Amsterdam, Netherlands
Dörte Behrendt
Affiliation:
Department of Health Psychology and Applied Biological Psychology, Institute for Sustainability, Education & Psychology, Leuphana University Luneburg, Luneburg, Germany
Hanna Brückner
Affiliation:
Department of Health Psychology and Applied Biological Psychology, Institute for Sustainability, Education & Psychology, Leuphana University Luneburg, Luneburg, Germany
Hanne Horvath
Affiliation:
GET.ON Institute for Online Health Trainings GmbH, Berlin, Germany
Heleen Riper
Affiliation:
Department of Clinical, Neuro and Developmental Psychology, VU University, Amsterdam, Netherlands Amsterdam Public Health, Amsterdam University Medical Centers, Amsterdam, Netherlands Department of Psychiatry, VU University Medical Center, Amsterdam, Netherlands
Claudia Buntrock
Affiliation:
Institute of Social Medicine and Health Systems Research, Faculty of Medicine, Otto von Guericke University Magdeburg, Magdeburg, Germany
*
Corresponding author: Janika Thielecke; Email: [email protected]
Rights & Permissions [Opens in a new window]

Abstract

Background

Major depressive disorder (MDD) is highly prevalent and burdensome for individuals and society. While there are psychological interventions able to prevent and treat MDD, uptake remains low. To overcome structural and attitudinal barriers, an indirect approach of using online insomnia interventions seems promising because insomnia is less stigmatized, predicts MDD onset, is often comorbid and can outlast MDD treatment. This individual-participant-data meta-analysis evaluated the potential of the online insomnia intervention GET.ON Recovery as an indirect treatment to reduce depressive symptom severity (DSS) and potential MDD onset across a range of participant characteristics.

Methods

Efficacy on depressive symptom outcomes was evaluated using multilevel regression models controlling for baseline severity. To identify potential effect moderators, clinical, sociodemographic, and work-related variables were investigated using univariable moderation and random-forest methodology before developing a multivariable decision tree.

Results

IPD were obtained from four of seven eligible studies (N = 561); concentrating on workers with high work-stress. DSS was significantly lower in the intervention group both at post-assessment (d = −0.71 [95% CI−0.92 to −0.51]) and at follow-up (d = −0.84 [95% CI −1.11 to −0.57]). In the subsample (n = 121) without potential MDD at baseline, there were no significant group differences in onset of potential MDD. Moderation analyses revealed that effects on DSS differed significantly across baseline severity groups with effect sizes between d = −0.48 and −0.87 (post) and d = − 0.66 to −0.99 (follow-up), while no other sociodemographic, clinical, or work-related characteristics were significant moderators.

Conclusions

An online insomnia intervention is a promising approach to effectively reduce DSS in a preventive and treatment setting.

Type
Original Article
Creative Commons
Creative Common License - CCCreative Common License - BY
This is an Open Access article, distributed under the terms of the Creative Commons Attribution licence (http://creativecommons.org/licenses/by/4.0/), which permits unrestricted re-use, distribution and reproduction, provided the original article is properly cited.
Copyright
Copyright © The Author(s), 2024. Published by Cambridge University Press

Introduction

Major depressive disorder (MDD) is a highly prevalent disorder (Gutiérrez-Rojas, Porras-Segovia, Dunne, Andrade-González, & Cervilla, Reference Gutiérrez-Rojas, Porras-Segovia, Dunne, Andrade-González and Cervilla2020) associated with great individual (Ferrari et al., Reference Ferrari, Charlson, Norman, Patten, Freedman, Murray and Whiteford2013) and societal burden (World Health Organization, 2022). Psychological treatments such as cognitive behavioral therapy (CBT) are the first-line treatments for depression (National Institute for Health and Care Excellence, Reference National Institute for Health and Care Excellence2022) and have the potential to prevent MDD onset (Cuijpers et al., Reference Cuijpers, Pineda, Quero, Karyotaki, Struijs, Figueroa and Muñoz2021b). However, the uptake of psychological interventions remains low, even in high-income countries, where only 28% of individuals in need of treatment receiving it (Chisholm et al., Reference Chisholm, Sweeny, Sheehan, Rasmussen, Smit, Cuijpers and Saxena2016) and less than 1% use indicated preventive interventions (Cuijpers, van Straten, Warmerdam, & van Rooy, Reference Cuijpers, van Straten, Warmerdam and van Rooy2010). New approaches to increase the uptake of mental health interventions are required to reduce the overall depression burden (Cuijpers, Reference Cuijpers2021).

Structural barriers to healthcare access can be addressed using the internet (Ebert et al., Reference Ebert, Van Daele, Nordgreen, Karekla, Compare, Zarbo and Baumeister2018), but especially in high-income countries, attitudinal barriers, including a common preference to solve one's own problems and the perceived stigma of mental illness, are important barriers for treatment uptake (Andrade et al., Reference Andrade, Alonso, Mneimneh, Wells, Al-Hamzawi, Borges and Kessler2014; Clement et al., Reference Clement, Schauman, Graham, Maggioni, Evans-Lacko, Bezborodovs and Thornicroft2015). An indirect approach to depression prevention and treatment (Cuijpers, Reference Cuijpers2021) using (guided) online self-help interventions may be a promising alternative to overcome these barriers. Instead of focusing on depression, the idea of an indirect approach is to target mental health problems contributing to depression or that are frequently comorbid, such as low self-esteem, procrastination (Cuijpers et al., Reference Cuijpers, Smit, Aalten, Batelaan, Klein, Salemink and Karyotaki2021c), and stress (Harrer et al., Reference Harrer, Apolinário-Hagen, Fritsche, Salewski, Zarski, Lehr and Ebert2021; Weisel et al., Reference Weisel, Lehr, Heber, Zarski, Berking, Riper and Ebert2018), or that are less stigmatizing, such as insomnia (van der Zweerde, van Straten, Effting, Kyle, & Lancee, Reference van der Zweerde, van Straten, Effting, Kyle and Lancee2019). By addressing these problems, depressive symptom severity (DSS) may be reduced but interventions might face more acceptance and match participants' perceived needs better. Insomnia is a particularly promising target as it is an impairing and burdensome disorder even in the absence of depressive symptoms (Morin et al., Reference Morin, Drake, Harvey, Krystal, Manber, Riemann and Spiegelhalder2015; Roach et al., Reference Roach, Juday, Tuly, Chou, Jena and Doghramji2021; Wade, Reference Wade2010) and can be effectively treated with specialized CBT for insomnia in person or via the internet (henceforth termed iCBT-I) (Feng, Han, Li, Geng, & Miao, Reference Feng, Han, Li, Geng and Miao2020; Simon et al., Reference Simon, Steinmetz, Feige, Benz, Spiegelhalder and Baumeister2023; Ye et al., Reference Ye, Chen, Chen, Liu, Lin, Liu and Jiang2016). Insomnia is also a predictor of new and recurrent depressive episodes (Baglioni et al., Reference Baglioni, Battagliese, Feige, Spiegelhalder, Nissen, Voderholzer and Riemann2011; Li, Wu, Gan, Qu, & Lu, Reference Li, Wu, Gan, Qu and Lu2016), is comorbid in 38%– 83% of depression cases (Bjorvatn, Olufsen, & Sørensen, Reference Bjorvatn, Olufsen and Sørensen2019; Staner, Reference Staner2010; Stewart et al., Reference Stewart, Besset, Bebbington, Brugha, Lindesay, Jenkins and Meltzer2006), and often persists after depression treatment (Vargas & Perlis, Reference Vargas and Perlis2020).

Emerging evidence shows that iCBT-I can effectively reduce DSS in insomnia patients with subthreshold depression (Batterham et al., Reference Batterham, Christensen, Mackinnon, Gosling, Thorndike, Ritterband and Griffiths2017; Cheng et al., Reference Cheng, Luik, Fellman-Couture, Peterson, Joseph, Tallent and Drake2019a; Christensen et al., Reference Christensen, Batterham, Gosling, Ritterband, Griffiths, Thorndike and Mackinnon2016; van der Zweerde et al., Reference van der Zweerde, van Straten, Effting, Kyle and Lancee2019) and in cases with comorbid clinical depression (Blom et al., Reference Blom, Jernelöv, Kraepelien, Bergdahl, Jungmarker, Ankartjärn and Kaldo2015; Blom, Jernelöv, Rück, Lindefors, & Kaldo, Reference Blom, Jernelöv, Rück, Lindefors and Kaldo2017). However, evidence that iCBT-I can prevent onset of new depressive episodes is ambiguous. One study found a preventive effect of iCBT-I on self-reported depression onset after 12 months compared to sleep education (Cheng et al., Reference Cheng, Kalmbach, Kalmbach, Tallent, Joseph, Espie and Drake2019a), but another did not find a preventive effect at 6-month follow-up compared to an active control group (internet-based placebo control program) using diagnostic interviews (Christensen et al., Reference Christensen, Batterham, Gosling, Ritterband, Griffiths, Thorndike and Mackinnon2016). Only one study investigated treatment moderators and identified baseline depression severity but no sociodemographic variables as moderators (Cheng et al., Reference Cheng, Luik, Fellman-Couture, Peterson, Joseph, Tallent and Drake2019b).

More insight of the potential of this indirect approach in prevention and treatment can be gained from focusing on one specific intervention (with well-known components) (Riley, Lambert, & Abo-Zaid, Reference Riley, Lambert and Abo-Zaid2010) used in different populations to allow for a greater precision and guide recommendations for researchers and clinicians by revealing who might profit most from it by reveling subgroups based on participant characteristics. Therefore, we performed an individual-participant-data (IPD) meta-analysis that focuses on the web-based insomnia intervention GET.ON Recovery, which is based on classic CBT-I components (e.g., sleep hygiene and sleep restriction) and enhanced by behavioral activation and a variety of methods to reduce hyperarousal. This program emphasizes detachment from work-related thoughts by including techniques to counter worry and rumination (Thiart et al., Reference Thiart, Lehr, Ebert, Sieland, Berking and Riper2013). It was originally developed and evaluated in teachers (Ebert et al., Reference Ebert, Thiart, Laferton, Berking, Riper, Cuijpers and Lehr2015; Thiart, Lehr, Ebert, Berking, & Riper, Reference Thiart, Lehr, Ebert, Berking and Riper2015; Thiart et al., Reference Thiart, Lehr, Ebert, Sieland, Berking and Riper2013) but has since been adapted and evaluated in the general employee population (Behrendt, Ebert, Spiegelhalder, & Lehr, Reference Behrendt, Ebert, Spiegelhalder and Lehr2020, Brückner et al., Reference Brückner, Wallot, Horvath, Ebert and Lehr2024), where it has been shown to reduce insomnia complaints (Behrendt et al., Reference Behrendt, Ebert, Spiegelhalder and Lehr2020; Ebert et al., Reference Ebert, Thiart, Laferton, Berking, Riper, Cuijpers and Lehr2015; Thiart et al., Reference Thiart, Lehr, Ebert, Berking and Riper2015). Further adaptations and (pilot) tests have been conducted among farmers (Braun et al., Reference Braun, Titzler, Ebert, Buntrock, Terhorst, Freund and Baumeister2019), international students (Spanhel et al., Reference Spanhel, Burdach, Pfeiffer, Lehr, Spiegelhalder, Ebert and Sander2021), and refugees (Spanhel et al., Reference Spanhel, Burdach, Pfeiffer, Lehr, Spiegelhalder, Ebert and Sander2021). All of these groups might profit from an indirect treatment approach since stigma of mental health problems is associated with different fears depending on the context, such as assumed workplace difficulties among employees (Brohan & Thornicroft, Reference Brohan and Thornicroft2010), loss of community support among refugees (Satinsky, Fuhr, Woodward, Sondorp, & Roberts, Reference Satinsky, Fuhr, Woodward, Sondorp and Roberts2019; Shannon, Wieling, Simmelink-McCleary, & Becher, Reference Shannon, Wieling, Simmelink-McCleary and Becher2015), and academic performance, finances, and career anxiety among college students (Cooper, Gin, & Brownell, Reference Cooper, Gin and Brownell2020; Ebert et al., Reference Ebert, Mortier, Kaehlke, Bruffaerts, Baumeister and Auerbach2019).

The aim of the current analysis is to (1) evaluate the efficacy of GET.ON Recovery on DSS reduction in individuals with subclinical or clinical depressive symptoms across different populations as well as potential MDD onset compared to a waiting-list control group (WLC) and to (2) identify possible moderating effects of various participant, clinical and intervention-related characteristics, and combinations thereof.

Methods

This study was designed as an IPD meta-analysis to investigate the efficacy of GET.ON Recovery training or an adapted version thereof on depressive symptom outcomes. The intervention is described in detail in the original study's protocol (Thiart et al., Reference Thiart, Lehr, Ebert, Sieland, Berking and Riper2013). The study was preregistered using the OSF (https://osf.io/xcus5) and follows the Preferred Reporting Items for Systematic Review and Meta-Analyses of IPD (PRISMA-IPD, see online Supplement 1) statement (Stewart et al., Reference Stewart, Clarke, Rovers, Riley, Simmonds, Stewart and Tierney2015) where applicable. For details and rationale for all deviations from the registration, see online Supplement 2.

Identification and selection of studies

Randomized controlled trials investigating a version of the GET.ON Recovery training (intervention group, IG) in comparison to any kind of control group (CG) among adult populations, which assessed DSS at post-treatment and/or follow-up were eligible for inclusion. Studies were identified through the scientific advisors at GET.ON institute (DDE) and by searching the German Clinical Trial Registry (DRKS) using the keyword ‘GET.ON Recovery’ in November 2021. The authors of the eligible studies were contacted and invited to provide IPD.

Risk-of-bias assessment

The revised version of the Cochrane risk-of-bias tool for randomized trials (RoB2; Sterne et al., Reference Sterne, Savović, Page, Elbers, Blencowe, Boutron and Higgins2019) and the related excel tool (Higgins, Savović, Page, & Sterne, Reference Higgins, Savović, Page and Sterne2019) were used to assess the quality of included studies, focusing on the intention-to-treat data available for DSS at post-treatment and/or follow-up. The RoB2 assesses possible bias in five domains: ‘randomization process,’ ‘deviations from interventions,’ ‘missing data,’ ‘outcome measurement,’ and ‘selective reporting.’ Each domain is rated as either ‘low risk,’ ‘some concern,’ or ‘high risk.’ We followed the proposed algorithm to reach an overall judgment, which reflected at least the lowest assessment of an individual domain. Published papers and/or the clinical trial registrations were used for the assessments which were conducted independently by two researchers (PK & JT) who were not involved in the original studies. Disagreements were resolved by discussion.

Depressive outcomes

All depressive symptom outcomes were based on the German version of the Center for Epidemiological Studies Depression Scale (CES-D, Hautzinger, Bailer, Hofmeister, and Keller, Reference Hautzinger, Bailer, Hofmeister and Keller2012). This self-reporting scale consists of 20 items, each rated 0–3, yielding a total score from 0 to 60 with higher scores indicating more severe depressive symptoms. Psychometric properties of the CES-D are well established with a Cronbach's α = 0.89 (Hautzinger et al., Reference Hautzinger, Bailer, Hofmeister and Keller2012). As a primary objective, we focused on DSS at post-treatment and follow-up. Additionally, we examined the following secondary outcomes at post-treatment and follow-up assessments: (1) reliable improvement and deterioration according to the reliable change index (RCI) by Jacobson and Truax (Reference Jacobson and Truax1991), (2) anchor-based clinically relevant change reflecting a 33% change in CES-D score as recommended by the German guideline for treating depression (Bundesärztekammer, Kassenärztliche Bundesvereinigung, & Arbeitsgemeinschaft der Wissenschaftlichen Medizinischen Fachgesellschaften, Reference Bundesärztekammer2022), (3) close-to-symptom-free status defined as a CES-D score <16, and (4) onset of potential MDD (CES-D ⩾16) based on participant self-report(in individuals below cut-off at baseline).

Potential moderators of the intervention effect

Given the limited knowledge of potential moderators, we included a wide range of variables in multivariable analyses. For sociodemographic variables sex, age, relationship status, ethnicity, children, education, and employment, were sought from the original studies. For clinical characteristics, baseline DSS (CES-D), insomnia severity (Insomnia Severity Index, ISI, range: 0–28; Dieck, Morin, and Backhaus, Reference Dieck, Morin and Backhaus2018), and previous experience with psychotherapy and/or health training were selected. After obtaining IPD and inventorying available measures, the following work-related variables were available for all studies and were included as potential moderators in the exploratory analysis: the Effort-Reward Imbalance Scale – Short form (ERI-S; Siegrist, Wege, Pühlhofer, & Wahrendorf, Reference Siegrist, Wege, Pühlhofer and Wahrendorf2009) with subscales effort (range 3–15) and reward (range 7–35) used to calculate an effort-reward ratio (>0.715 indicating imbalance, Lehr, Koch, & Hillert, Reference Lehr, Koch and Hillert2010) and work engagement (Utrecht Work Engagement Scale, UWES; Schaufeli & Bakker, Reference Schaufeli and Bakker2004) with subscales vigor, dedication, and absorption (score range for each: 0–6).

Statistical analyses

The obtained IPD were harmonized by trained personnel according to established coding guidelines (Harrer & Ebert, Reference Harrer and Ebert2023). For all analyses, the significance level was set to α = 0.05 (two-sided) and adjusted for 10 multiple comparisons using the Bonferroni method (Emerson, Reference Emerson2020).

Missing data

This study followed an intention-to-treat approach. Missing post-treatment and follow-up data were estimated separately using the mice package (van Buuren & Groothuis-Oudshoorn, Reference van Buuren and Groothuis-Oudshoorn2011) for multivariate imputation by chained equations in R (R Core Team, 2022) under a missing at random assumption. This assumption provides a plausible starting point for RCTs (van Buuren, Reference van Buuren and van Buuren2018) Stratification by treatment was implemented using the bygroup function in miceadds (Robitzsch & Grund, Reference Robitzsch and Grund2022), which generates imputations separately for intervention and control conditions. Two-level predictive mean matching (2 l.pmm) from the miceadds package was used to account for data clustering. Trial means of baseline DSS were used in the prediction of post-treatment and follow-up symptom severity outcomes (online Supplement 3). A total of 50 imputed datasets were created for each time point. Parameters of interest were estimated from each corresponding imputed data set and were combined using Rubin's rules (Little & Rubin, Reference Little and Rubin2002; Rubin, Reference Rubin1987).

Depression efficacy

To evaluate depression outcomes, we used a one-step IPD approach to better account for the small number of participants/events in the included studies (Riley et al., Reference Riley, Debray, Fisher, Hattle, Marlin, Hoogland and Ensor2020). Separate linear mixed models (LMMs) were specified for each outcome. All models included a random intercept for trial and random slope for the treatment effect and were adjusted for baseline DSS. To calculate the between-study heterogeneity variance in intercept and treatment effect, τ 2 was used. Fixed model parameters are reported with 95% confidence intervals (CIs). LMMs predicting continuous outcomes are reported with model-based Cohen's d values directly estimated by standardizing the outcome using the pooled standard deviation of each group. Parameters for categorical outcomes were estimated from the imputed data using generalized linear mixed models (GLMMs) with a binomial logit link to calculate Odds Ratios (ORs) as the effect size measure of the treatment effect. Numbers-needed-to-treat (NNTs) were calculated as the inverted absolute risk difference and absolute numbers are given for all dichotomous depressive outcomes. Since not all original studies provided relevant variables to calculate the treatment effect on DSS, effects in the individual studies were estimated by separate models in the appropriate imputed data subsets.

Moderation analysis

A multistep approach was used to investigate potential univariable and multivariable moderating effects. First, potential moderators were separately included in the ‘unconditional’ GLMMs. Following the recommendations of Riley et al. (Reference Riley, Debray, Fisher, Hattle, Marlin, Hoogland and Ensor2020), we centered all moderators by their trial-specific mean and included the mean as a level-two predictor to avoid amalgamation of within- and across-trial information. Second, we investigated multivariable treatment-by-moderator interactions. Putative moderators were first ranked for their relevance by calculating the variable permutation importance using the model-based random-forest method (Garge, Bobashev, & Eggleston, Reference Garge, Bobashev and Eggleston2013) in an aggregated dataset as Rubin's rules are not directly applicable for non-parametric approaches. With this method, DSS at post-treatment and follow-up times were regressed on the treatment indicator using 300 bootstrapped samples. All potential moderators were introduced as partitioning variables (i.e. variables to define a subset) on their raw scale using the mobforest package (Garge et al., Reference Garge, Bobashev and Eggleston2013). Variables were ranked by relative importance according to the frequency with which they served as a splitting variable in the trees (termed the ‘permutation accuracy method’).

In the final model-based tree analysis to evaluate possible multivariable moderation, all variables with significant interaction with the treatment effect in univariable models and/or that yielded variable importance values >0 in the random-forest model were included as partitioning variables. Model-based recursive partitioning allows incorporation of machine learning approaches, specifically recursive partitioning, into a parametric model. The result is an easy to interpret decision tree describing subgroups based on distinct values of algorithmically selected variables which have differential treatment effects. The tree was operationalized using the R package glmertree (Zeileis, Hothorn, & Hornik, Reference Zeileis, Hothorn and Hornik2008). In the models for post-treatment and follow-up, DSS was regressed on the treatment indicator in the aggregated data. The nested structure of the patients within the studies was accounted for by specifying a random trial intercept and random treatment effect. Treatment effects in the subgroups were estimated separately to receive model-based Cohen's d as described above. Since the model-based tree analysis approach is prone to overfitting, we reported an optimism-adjusted R 2 obtained by bootstrap bias correction (Harrell, Lee, & Mark, Reference Harrell, Lee and Mark1996; Smith, Seaman, Wood, Royston, & White, Reference Smith, Seaman, Wood, Royston and White2014).

Quasi-Bayesian approach

Between-trial heterogeneity was deemed highly plausible, but the small number of included studies led to an increased risk of improperly estimated heterogeneity variances of zero (singular fits). Therefore, a ‘quasi-Bayesian’ approach was applied using the functionality of the blme package (Chung, Rabe-Hesketh, Dorie, Gelman, & Liu, Reference Chung, Rabe-Hesketh, Dorie, Gelman and Liu2013) throughout imputation, one-stage IPD analyses, and decision-tree building. A weakly informative Wishart prior with df = 4 and a scale matrix multiplied by 0.05 (adapted to 0.01 or 0.075 in case of convergence problems) was used. The prior helped to avoid boundary-fit issues while remaining largely uninformative itself.

Sensitivity analysis

Analysis was repeated as pre-registered in a complete case subsample and additionally in the total sample while excluding the sleep item from the CES-D scores to evaluate the robustness of our results. We decided not to conduct moderation analysis using the complete case sample due to the reduced sample size and power, which would increase the chance for spurious effects in multiple testing.

Results

Study selection and IPD obtained

A total of eight studies evaluating GET.ON Recovery (or a modified version) was identified, of which seven were deemed eligible and the authors of six were asked to contribute IPD. One study was deemed ineligible because it did not assess DSS (unpublished, trial registration: DRKS00017737), while the authors of one eligible study were not asked to contribute IPD because the online training was used only in a small subsample (15/150) of participants who could choose from a portfolio of online training programs (Braun et al., Reference Braun, Titzler, Terhorst, Freund, Thielecke, Ebert and Baumeister2021a, Reference Braun, Titzler, Terhorst, Freund, Thielecke, Ebert and Baumeister2021b). The IPD from two studies (Spanhel et al., Reference Spanhel, Burdach, Pfeiffer, Lehr, Spiegelhalder, Ebert and Sander2021, Reference Spanhel, Hovestadt, Lehr, Spiegelhalder, Baumeister, Bengel and Sander2022) were unavailable because no formal data sharing agreement could be reached. Ultimately, the IPD from four studies was included in the meta-analysis, and no integrity concerns were raised based on inspecting randomization, pre-registered outcomes, data consistency, and completeness, (Fig. 1). Since the study by Ebert et al. (Reference Ebert, Thiart, Laferton, Berking, Riper, Cuijpers and Lehr2015) did not assess follow-up data in the control group due to a shorter waiting-list time, this study was excluded from analysis at follow-up. In total, data from 561 participants in four trials were analyzed for DSS at post-treatment (8 weeks post-randomization) and 433 participants from three trials were analyzed at follow-up (24 weeks post-randomization).

Figure 1. Flowchart of study selection and inclusion.

Study and participant characteristics

All four included studies assessed the effects of GET.ON Recovery training on DSS among employees with high work-related rumination or without clear separation of work and private life and used a waiting-list control group (Table 1). Most participants were female (68%, n = 381/561), in a relationship (70%, n = 395/561), and had achieved more than high school education (76%, n = 429/561). Mean age was 47 years (s.d. = 9.73). The majority had clinically relevant insomnia (ISI⩾15, 76%, n = 425/563) and 78% (n = 440/563) reported clinically relevant levels of depression (CES-D⩾16). Work engagement was considered average (subscale means 3.02–3.38), and the effort-reward ratio suggested an imbalance (M = 1.41, s.d. = 0.40). For more details, see online Supplement 4.

Table 1. Characteristics of the included studies investigating the efficacy of GET.ON recovery on insomnia severity

IG, intervention group; CG, control group; WLC, waiting-list control; IS-CI, Cognitive Irritation Scale (Mohr, Rigotti, & Müller, Reference Mohr, Rigotti and Müller2005); ISI, Insomnia Severity Index (Dieck et al. Reference Dieck, Morin and Backhaus2018); T0, baseline assessment; T1, post-treatment assessment (weeks); T2, follow-up assessment (weeks); segmentation supplies: Subscale from the workplace segmentation preferences and supplies (Kreiner, Reference Kreiner2006); ‘ * ’in IG only; Risk-of-bias assessment: ‘ + ’ low–risk of bias, ‘−’ some concern, ‘x’ high risk, ‘?’ not enough information to assess; Rand, randomization process; Int Dev, deviations from interventions; Out Mis, missing data; Out Meas, outcome measurement; Sel Rep, selective reporting.

Risk-of-bias assessment

All included studies were conservatively judged to have a high risk-of-bias, mainly due to unblinded participants reporting on the outcome by self-report.

Effects on depressive symptom outcomes

All depression-related outcomes are presented in Table 2. Sensitivity analyses confirmed the robustness of the results (online Supplements 5 and 6).

Table 2. Overview of depression outcomes at post-treatment (8 weeks post-randomization) and at follow-up (24 weeks post-randomization) based on multiple imputed data

CES-D, Center for Epidemiological Studies Depression Scale; MDD, major depressive disorder; RCI, reliable change index; IG, intervention group; CG, control group; NNT, number-needed-to-treat; n T0, case number at baseline assessment; n T0, case number with outcome post-treatment or at follow-up; τ int, intercept variance; τ group, slope variance for the treatment effect.

Note: Analysis based on multiple imputation.

a Subgroup exceeding the cut-off for clinically relevant depressive symptoms at baseline (CES-D⩾16).

b Subgroup considered close-to-symptom-free at baseline (CES-D < 16).

DSS

Depression symptom severity was significantly reduced in the intervention group (post-treatment: M = 13.86, s.d. = 7.12; follow-up: M = 14.23, s.d. = 6.73) compared to the control group (post-treatment: M = 19.70, s.d. = 8.19; follow-up: M = 21.13, s.d. = 8.47) both at post-treatment (ß = −5.99 [95% CI: −7.68 to −4.29], T(419.9) = −6.93, p adjusted<0.0001) and at follow-up (ß = −7.28 [95% CI −9.61 to 4.95], T(229.2) = − 6.93, p adjusted<0.0001). The standardized effects estimated in the individual studies and the overall pooled average effects on DSS at post-treatment (d = −0.71 [95% CI −0.92 to −0.51]) and at follow-up (d = −0.84 [95% CI −1.11 to −0.57]) are presented in Fig. 2. The effects were only slightly lower when excluding the sleep item before the analysis (see online Supplement 5), both at post-treatment (M IG = 12.68, s.d.IG = 6.87 v. M CG = 17.81, s.d.CG = 7.89; (ß = −5.28 [95% CI −6.96 to −3.59], T(353.5) = −6.14, p adjusted<0.0001, τ 2 = 1.07, R 2 = 0.35) and follow-up (M IG = 12.98, s.d.IG = 6.48 v. M CG = 19.08, s.d.CG = 8.28; (ß = −6.46 [95% CI −8.59 to −4.33], T(257.5) = −5.97, p adjusted<0.0001, τ 2 = 1.27, R 2 = 0.32).

Figure 2. Forest plot summarizing the estimated effects estimated in individual studies (based on multiple imputation) and the average pooled effect from a one-stage IPD analysis.

Reliable change index

A statistically significant greater proportion of participants in IG than in CG exhibited reliable symptom improvement at post-treatment (159/280, 56.8% v. 65/281, 23.1%; OR  0.19 [95% CI 0.12–0.29], T(411) = −7.39, p adjusted<0.001;) and at follow-up (121/216, 56.0% v. 34/217, 15.7%; OR 0.11 [95% CI 0.05–0.22], T(175.6) = −6.09, p adjusted<0.001;). Additionally, fewer participants in the IG than the control group demonstrated reliable deterioration at post-treatment (7/280, 2.5% v. 21/281, 7.5%; OR 2.83 [95% CI 1.15–6.95], T(308.6) = 2.27, p adjusted=0.284) and at follow-up (7/216, 3.2% v. 24/217, 11.1%; OR 2.95 [95% CI 1.15–7.57], T(194.3) = 2.26, p adjusted = 0.297) but without statistical significance.

Anchor-based clinically relevant change

A 33% reduction in CES-D score was associated with an average point decrease of 7.30 (s.d. = 2.64). A statistically significant greater proportion of participants in IG than in CG reported anchor-based clinically relevant improvement at post-treatment (180/280, 64.3% v. 56/281, 19.9%; OR 0.17 [95% CI 0.11–0.27], T(396.1) = −7.54, p adjusted<0.001) and at follow-up (139/216, 64.4% v. 30/217, 13.8%; OR 0.13 [95% CI 0.07–0.23], T(196.6) = −6.51, p adjusted<0.001).

Close-to-symptom-free status

A statistically significant greater proportion of participants in IG than in CG attained close-to-symptom-free status at post-assessment (152/224, 67.9% v. 41/216, 19.0%; OR 0.16 [95% CI 0.09–0.28], T(306.1) = −6.72, p adjusted<0.001;) and at follow-up (118/173, 68.2% v. 21/163, 12.9%; OR 0.13 [95% CI 0.06–0.25], T(158.6) = −5.86, p adjusted<0.001).

Potential onset of depression

Within the subsample without clinically relevant depressive symptoms at baseline (n = 121), a lower proportion of participants in IG (7/56, 12.5%) than in CG (20/65, 30.8%) exhibited potential onset of MDD after 8 weeks, but the difference did not reach statistical significance (OR 2.13 [95%-CI 0.72–6.32], T(80.0) = 1.38, p = 0.17, p adjusted = 1.00). Similarly, a smaller proportion of participants in IG than in CG exhibited potential MDD onset after 24 weeks (n = 8/43, 18.6% v. n = 22/54, 40.47%), but the difference did not reach statistical significance (OR 2.00 [95% CI 0.68–5.85], T(67.9) = 1.28, p = 0.20, p adjusted = 1.00; 4.5 [95% CI 2.5–21.7]).

Moderation of the treatment effect

Based on the available IPD, ethnicity, employment, and intervention-level variables were excluded as potential moderators due to a lack of variance, while effort-reward imbalance and work engagement were included in addition to sociodemographic and clinical variables. Univariable moderation analysis (online Supplement 7) identified baseline depressive symptom severity as the only significant moderator of follow-up symptom severity (ß = −0.30 [−0.56 to −0.03], p = 0.02). Additionally, based on the model-based random-forest analysis (online Supplement 8), the following variables were included as partitioning variables in the final tree-models at both post-treatment and follow-up: baseline symptoms of depression and insomnia, previous psychotherapy, vigor, dedication, and reward. Relationship status and effort were included in the post-treatment model and age, absorption, and effort-reward ratio were included in the model for follow-up.

In the final tree-based models, only baseline DSS predicted heterogeneous treatment responses. For post-treatment, the first split divided the sample at 21 points with a second split occurring at 13 and 28 points in the two branches, respectively (Fig. 3a). Optimism-corrected R 2 was reduced by 0.11 to R 2adjusted = 0.30. Statistically significant treatment effects were observed in three of the four terminal nodes with differences in the effect magnitude between subgroups based on partitioning the dataset by baseline CES-D scores of ⩽13, >13 but ⩽21, >21 but ⩽28, and >28. Effects were highest for participants with a baseline score >28 (d = −0.87 [95% CI −1.25 to −0.48], n = 122) and smallest without statistical significance in the small group of participants with baseline scores ⩽13 (d = −0.48 [95% CI −0.97, 0.01], n = 77)

Figure 3. Tree model for depressive symptoms (CES-D) post-treatment (a) and at follow-up (b) derived from model-based recursive partitioning in aggregated data.

Similarly, in the follow-up model, only baseline DSS explained the heterogeneity in treatment effect (Fig. 3b). Two splits were identified, the first split at 24 points on the CES-D and the second at 19 points in the subgroup with baseline CES-D scores ⩽24. Optimism-corrected R 2 was reduced by 0.11 to R 2adjusted = 0.27. Treatment effects were significant in all terminal node models, with the biggest effect size in participants with baseline CES-D scores >19 but ⩽24 (d = −0.99 [95% CI −1.33 to −0.64]) and lowest in participants with baseline scores >24 (d = −0.66 [95% CI −0.95 to −0.36]).

Discussion

The aim of the study was to investigate the efficacy of internet-based CBT for insomnia (iCBT-I) as an indirect approach in the prevention and treatment of MDD. The analyses confirmed the superiority of iCBT-I compared to WLC in reducing depressive symptom severity (DSS) with an average pooled intervention effect of iCBT-I of d = −0.71 [95% CI −0.92 to −0.51] at post-treatment and d = −0.84 [95% CI −1.11 to −0.57] at follow-up. These effects were robust in sensitivity analyses with study completers (post-treatment: d = −0.70 [95% CI −0.51 to −0.89]; follow-up: d = −0.80 [95% CI −0.58 to −1.03] and when excluding the sleep item of the CES-D (post-treatment: d = −0.65 [95% CI −0.44 to −0.86], follow-up: d = −0.78 [95% CI −0.52 to −1.03]). Regarding different measures of clinically meaningful improvement, NNTs ranged from two to four individuals. In contrast, iCBT-I demonstrated no significant effect on possible depression onset after 8 weeks and 24 weeks respectively among the subsample (n = 121) without possible depression at baseline. The model-based decision tree revealed four (three) groups defined by their baseline DSS with differential treatment effects at post-treatment (follow-up) reaching from d = −0.48 to d = −0.87 (d = −0.66 to d = −0.99) with no other incremental sociodemographic, clinical, or work-related characteristic moderating effects.

The observed effects were comparable to what would be expected from online CBT directly intended for mild-to-moderate depression which are reported by a recent meta-analysis (Sztein, Koransky, Fegan, & Himelhoch, Reference Sztein, Koransky, Fegan and Himelhoch2018) as d = −0.74 [95% CI −0.62 to −0.86]) at post-treatment and as = −0.83 [95% CI −0.69 to −0.99] at 3–6 months follow-up (d).

The effects found for DSS at post-treatment were also comparable to what has been reported from previous studies using an indirect approach with iCBT-I in mostly subthreshold depression cases and comparing unguided iCBT-I to an active control group (Cohen's d between 0.60 and 0.64) (Batterham et al., Reference Batterham, Christensen, Mackinnon, Gosling, Thorndike, Ritterband and Griffiths2017; Cheng et al., Reference Cheng, Kalmbach, Kalmbach, Tallent, Joseph, Espie and Drake2019a; Christensen et al., Reference Christensen, Batterham, Gosling, Ritterband, Griffiths, Thorndike and Mackinnon2016). Few iCBT-I studies have reported longer follow-up times but those that did reported smaller effects at 6 months (d = 0.40; Batterham et al., Reference Batterham, Christensen, Mackinnon, Gosling, Thorndike, Ritterband and Griffiths2017; d = 0.48; Christensen et al., Reference Christensen, Batterham, Gosling, Ritterband, Griffiths, Thorndike and Mackinnon2016), while we report a slightly larger pooled effect (d = 0.81) at 6-month follow-up. Effects at post-treatment reported here were smaller compared to a study using guided iCBT-I and an active control for individuals with at least mild depressive symptoms (d = 1.05 based on the Patient Health Questionnaire [PHQ]) (van der Zweerde et al., Reference van der Zweerde, van Straten, Effting, Kyle and Lancee2019). This difference was, however, reduced when analyses without the sleep items were compared (van der Zweerde et al., Reference van der Zweerde, van Straten, Effting, Kyle and Lancee2019: d = 0.76 v. current study: d = 0.65). However, all studies in our analysis included more severely depressed individuals, compared the effect to a WLC and two studies were guided. All these factors may have impacted the reported effect sizes and made strong comparisons difficult (Furukawa et al., Reference Furukawa, Noma, Caldwell, Honyashiki, Shinohara, Imai and Churchill2014; Werntz, Amado, Jasman, Ervin, & Rhodes, Reference Werntz, Amado, Jasman, Ervin and Rhodes2023).

Comparison regarding MDD onset is limited due to the small subgroup of depression-free participants at baseline, therefore reduced power, and the relatively short observation period of 6 months. Similarly to our non-finding of a preventive effect on MDD, Christensen et al. (Reference Christensen, Batterham, Gosling, Ritterband, Griffiths, Thorndike and Mackinnon2016) found no differences in depression onset at 6 months after iCBT-I using diagnostic interviews for both study inclusion and evaluation. In contrast, Cheng et al. (Reference Cheng, Kalmbach, Kalmbach, Tallent, Joseph, Espie and Drake2019a, Reference Cheng, Luik, Fellman-Couture, Peterson, Joseph, Tallent and Drake2019b) reported that the risk for depression onset was halved in the intervention group compared to the control group (relative risk ratio = 0.51 [95% CI 0.26–0.81]) in one-year post-intervention based on cut-off scores for self-reported measurements.

Additionally, the effects are in line with a small-scale study directly comparing iCBT-I to online CBT for depression in participants with clinical insomnia (Blom et al., Reference Blom, Jernelöv, Kraepelien, Bergdahl, Jungmarker, Ankartjärn and Kaldo2015). While iCBT-I was superior for reducing sleep problems, both iCBT-I and depression CBT were equally effective in reducing depressive symptoms up to 3 years post-treatment (Blom et al., Reference Blom, Jernelöv, Rück, Lindefors and Kaldo2017).

Model-based recursive partitioning analyses suggested differential efficacy of iCBT-I among subgroups of participants that differed depending on initial depressive symptom severity. However, both likely non-clinical cases with elevated depressive symptoms (CES-D score 14–21) (Bundesärztekammer et al., Reference Bundesärztekammer2022; Radloff, Reference Radloff1977; Vilagut, Forero, Barbaglia, & Alonso, Reference Vilagut, Forero, Barbaglia and Alonso2016) and probable MDD cases (CES-D > 28) (Bundesärztekammer et al., Reference Bundesärztekammer2022) seem to benefit from iCBT-I to a similar degree.

The largest effect sizes were observed in the group of individuals scoring around the cut-off for highly likely diagnosable depression (CES-D > 28; Bundesärztekammer et al., Reference Bundesärztekammer2022). The results are in line with Cheng et al. (Reference Cheng, Luik, Fellman-Couture, Peterson, Joseph, Tallent and Drake2019b), who also identified baseline DSS as the sole moderator, with participants in the upper tertile of a mild-moderate depressed sample showing the greatest improvements.

Implications for research and practice

Our analyses add to the evidence that iCBT-I can effectively reduce depressive symptom severity and the multivariable moderation analyses additionally suggested its efficacy across different levels of baseline depressive symptom severity. Consequently, severely depressed individuals without suicidal ideation would not need to be excluded from an indirect treatment approach. The rates of reliable deterioration in IG (n = 7/280, 2.5% at post-treatment; n = 7/216, 3.24% at follow-up) are comparable to those meta-analytically reported for (in-person and online) psychotherapy for depression with an estimated RCI deterioration rate of 5% at post-treatment (Cuijpers et al., Reference Cuijpers, Karyotaki, Ciharova, Miguel, Noma and Furukawa2021a). While the studies included in this IPD meta-analysis did not include suicidal participants, other studies suggest that this indirect approach (targeting insomnia) may also be an opportunity for suicide prevention with an appropriate safety protocol (Christensen et al., Reference Christensen, Batterham, Gosling, Ritterband, Griffiths, Thorndike and Mackinnon2016; Kalmbach et al., Reference Kalmbach, Cheng, Ahmedani, Peterson, Reffi, Sagong and Drake2022; Torok et al., Reference Torok, Han, Baker, Werner-Seidler, Wong, Larsen and Christensen2020).

Given the growing evidence for the efficacy of CBT-I in the treatment of depressive symptoms (Asarnow & Manber, Reference Asarnow and Manber2019) and that the efficacy of iCBT-I on DSS did not vary across demographics in this IPD meta-analysis, iCBT-I should be more highlighted in practice and included in the associated treatment guidelines as earlier demanded by Morin et al. (Reference Morin, Bertisch, Pelayo, Watson, Winkelman, Zee and Krystal2023). Implementation science should focus on how to integrate an indirect treatment approach into routine care. However, it is still important to test the differences in the uptake of insomnia and depression interventions in a more naturalistic setting and in a sample less confounded by high work stress, which is associated with depression risk independent of sleep pathology (Siegrist, Reference Siegrist2008). In addition, patients' attitudes towards an indirect treatment approach and their naïve perception of how their symptoms relate to each other should be considered in future research as Kraepelien et al. (Reference Kraepelien, Forsell and Blom2022) revealed that depressed patients with elevated insomnia symptoms actively sought depression-focused CBT instead of iCBT-I.

Studies directly comparing depression to insomnia treatment (as in Blom et al., Reference Blom, Jernelöv, Kraepelien, Bergdahl, Jungmarker, Ankartjärn and Kaldo2015) in a preventive setting with subthreshold insomnia and depression are still warranted to inform further personalization of preventive offers. Enhancing personalization and levering effectiveness of preventive interventions mighty derive from considering individual symptoms instead of general symptom severity at baseline, given that multiple studies have identified especially problems initiating sleep as a predictor of later depression onset (Bjorøy, Jørgensen, Pallesen, & Bjorvatn, Reference Bjorøy, Jørgensen, Pallesen and Bjorvatn2020; Blanken, Borsboom, Penninx, & Van Someren, Reference Blanken, Borsboom, Penninx and Van Someren2020; Leerssen et al., Reference Leerssen, Lakbila-Kamal, Dekkers, Ikelaar, Albers, Blanken and Van Someren2021).

With regard to maintaining treatment effects and relapse prevention it would be positive if treatment experience encourage future help-seeking intentions if needed, but it is unclear to what extent an indirect approach can support this. Studies thus far have mainly assessed help-seeking intention as a means to estimate further need after the intervention (Blom et al., Reference Blom, Jernelöv, Kraepelien, Bergdahl, Jungmarker, Ankartjärn and Kaldo2015; Christensen et al., Reference Christensen, Batterham, Gosling, Ritterband, Griffiths, Thorndike and Mackinnon2016). Moreover, promotion of help-seeking and de-stigmatization of mental health problems should not stop at an individual level but should be seen as a societal effort (Clement et al., Reference Clement, Schauman, Graham, Maggioni, Evans-Lacko, Bezborodovs and Thornicroft2015).

Finally, Asarnow and Manber (Reference Asarnow and Manber2019) found inconclusive evidence for the greater efficacy of combined over sequential insomnia and depression treatment and also suggested that comorbidity may influence adherence and dropout. Internet interventions could serve as an ideal testing ground to address these questions (Domhardt, Cuijpers, Ebert, & Baumeister, Reference Domhardt, Cuijpers, Ebert and Baumeister2021). Module-based online training could be used to explore if the order of components, for example, behavioral activations and sleep restriction, interact with each other and the treatment outcomes over time or if individual modules targeting potential transdiagnostic factors like rumination (Behrendt et al., Reference Behrendt, Ebert, Spiegelhalder and Lehr2020; Cheng, Kalmbach, Castelan, Murugan, & Drake, Reference Cheng, Kalmbach, Castelan, Murugan and Drake2020) are especially crucial for combined treatment. Internet interventions combining aspects of insomnia and depression treatment as a predefined module, on demand additional modules chosen by the user, or recommendations by the program/guiding coach could be used to adapt the intervention to the individual's needs and preferences.

Limitations

The current results should be interpreted considering several limitations. First, depending on the obtained IPD, our analysis included studies from a very homogenous group and a single (adapted) intervention. For instance, all participants came from a high-income country, were employed, predominantly female and highly educated. The intervention itself focused on work-related rumination in addition to the classic CBT-I components, such as sleep hygiene and sleep restriction. While this focus on the work context supports the ecological validity and highlights the potential of an indirect approach for occupational health, it limits transferability to other contexts. Especially the transfer to unemployed individuals, who are more prone to develop a depression than employed individuals (Van Der Noordt, IJzelenberg, Droomers, & Proper, Reference Van Der Noordt, IJzelenberg, Droomers and Proper2014), is not possible and is in need of dedicated studies. Second, we based our analysis on the German version of the CES-D, which does not have one uniform cut-off for depression onset or different categorical levels of DSS, limiting comparability with other studies in the field (Vilagut et al., Reference Vilagut, Forero, Barbaglia and Alonso2016). We retained the pre-specified cut-off of ⩾16 but included other cut-offs suggested from more recent depression guidelines, but future research should also consider clinical assessments. This limits generalizability and comparability with other standardized measures for depression such as the PHQ-9. Third, our results on subthreshold depression and potential depression onset should be interpreted with special caution because we (a) used a self-reported cut-off to identify potential MDD cases and (b) had a very reduced sample size and power to examine the effects on onset in a population with insomnia/depressive symptom comorbidity. Fourth, the reported effect sizes may be higher than would be expected in routine care given the WLC and high risk of bias in outcome measures. The reported OR were controlled for baseline CES-D to report conditional effects but given the underlying logistic distribution, the marginal effect on population level might be smaller (Groenwold, Moons, Peelen, Knol, & Hoes, Reference Groenwold, Moons, Peelen, Knol and Hoes2011). The effect sizes could also vary in relation to the amount of guidance provided, which was not studied due to the small number of included studies, but which should be focused on in future studies on (aggregated) data. Finally, the univariable and multivariable moderation analyses were the first in the field of indirect prevention and treatment of depression, and due to the relatively small sample size, should be considered exploratory and in need of validation across different samples. The random-forest method was only feasible in an aggregated dataset and did not account for the multilevel structure; thus, the analysis did not consider imputation insecurity or heterogeneity among included studies. Similarly, the model-based recursive partitioning was also run in an aggregated dataset but could consider the multilevel structure. Further, for ease of interpretation, we did not center variables in the tree, which could introduce ecological bias. Finally, due to the relatively small sample size, the tree analysis was prone to overfitting, so we adjusted the R 2.

Conclusion

The findings of the current study provide evidence that iCBT-I can probably effectively reduce depressive symptom severity in working adults experiencing sleep problems and high work stress. Multivariable moderation analyses suggested that the effect size magnitude of iCBT-I varied according to baseline symptom severity, but that iCBT-I is a promising intervention approach for treatment of comorbid insomniac and depressive symptoms. Dedicated studies are needed to conclude whether or not this approach is also applicable to the preventive setting.

Supplementary material

The supplementary material for this article can be found at https://doi.org/10.1017/S0033291724000527

Data availability statement

The data are not publicly available. The corresponding author is a data processor, not a data owner and thus cannot provide data access upon request. Access to the data must be sought from authors of original studies and might depend on to be specified data security and data exchange regulation agreements. The analyses scripts can be assessed via OSF: https://osf.io/fg46t/

Acknowledgements

Authors would like to thank enago Academy for proofreading the manuscript and TUM Graduate School for covering the costs for this service as part of JT's PhD program.

Author contributions

Janika Thielecke: Conceptualization, Methodology, Formal Analysis, Data Curation, Visualization, Project administration, Writing – Original Draft, Writing – Review & Editing. Paula Kuper: Conzeptionalization, Methodology, Formal Analysis, Data Curation, Visualization, Writing – Review & Editing. Dirk Lehr: Conzeptionalization, Resources, Writing – Review & Editing. Lea Schuurmans: Conzeptionalization, Methodology, Formal Analysis, Data Curation, Writing – Review & Editing. Mathias Harrer: Conzeptionalization, Methodology, Data Curation, Formal Analysis, Writing – Review & Editing. David D. Ebert: Conzeptionalization, Resources, Supervision, Writing – Review & Editing. Dörte Behrendt: Resources, Writing – Review & Editing. Hanna Brückner: Resources, Writing – Review & Editing. Hanne Horvath: Resources, Writing – Review & Editing. Heleen Riper: Resources, Writing – Review & Editing. Pim Cuijpers: Resources, Writing – Review & Editing. Claudia Buntrock: Conzeptionalization, Methodology, Project administration, Supervision, Writing – Review & Editing.

Funding statement

This research received no specific grant from any funding agency, commercial or not-for-profit sectors.

Competing interests

MH is a part-time employee at the Institute for Health Trainings Online (GET.ON), which aims to implement scientific findings related to digital health interventions into routine care.

DDE reports to have received consultancy fees or served on the scientific advisory board of several companies such as Novartis, Sanofi, Lantern, Schön Kliniken, Minddistrict, and German health insurance companies (BARMER, Techniker Krankenkasse). DDE is a stakeholder of GET.ON. HH is Founder and Chief Commercial Officer at GET.ON. JT, PK, LS, DL, HB, DB, HR, PC, and CB report no competing interests.

Ethical standards

The authors assert that all procedures contributing to this work comply with the ethical standards of the relevant national and institutional committees on human experimentation and with the Helsinki Declaration of 1975, as revised in 2008. All included studies individually underwent approval by the ethics committee of the responsible institutions as described in the original articles.

References

Andrade, L. H., Alonso, J., Mneimneh, Z., Wells, J. E., Al-Hamzawi, A., Borges, G., … Kessler, R. C. (2014). Barriers to mental health treatment: Results from the WHO world mental health surveys. Psychological Medicine, 44(6), 13031317. doi: 10.1017/S0033291713001943CrossRefGoogle ScholarPubMed
Asarnow, L. D., & Manber, R. (2019). Cognitive behavioral therapy for insomnia in depression. Sleep Medicine Clinics, 14(2), 177184. doi: 10.1016/j.jsmc.2019.01.009CrossRefGoogle ScholarPubMed
Baglioni, C., Battagliese, G., Feige, B., Spiegelhalder, K., Nissen, C., Voderholzer, U., … Riemann, D. (2011). Insomnia as a predictor of depression: A meta-analytic evaluation of longitudinal epidemiological studies. Journal of Affective Disorders, 135(1–3), 1019. doi: 10.1016/j.jad.2011.01.011CrossRefGoogle ScholarPubMed
Batterham, P. J., Christensen, H., Mackinnon, A. J., Gosling, J. A., Thorndike, F. P., Ritterband, L. M., … Griffiths, K. M. (2017). Trajectories of change and long-term outcomes in a randomised controlled trial of internet-based insomnia treatment to prevent depression. BJPsych Open, 3(5), 228235. doi: 10.1192/bjpo.bp.117.005231CrossRefGoogle Scholar
Behrendt, D., Ebert, D. D., Spiegelhalder, K., & Lehr, D. (2020). Efficacy of a self-help web-based recovery training in improving sleep in workers: Randomized controlled trial in the general working population. Journal of Medical Internet Research, 22(1), e13346. doi: 10.2196/13346CrossRefGoogle ScholarPubMed
Bjorøy, I., Jørgensen, V. A., Pallesen, S., & Bjorvatn, B. (2020). The prevalence of insomnia subtypes in relation to demographic characteristics, anxiety, depression, alcohol consumption and use of hypnotics. Frontiers in Psychology, 11, 527. doi: 10.3389/fpsyg.2020.00527CrossRefGoogle Scholar
Bjorvatn, B., Olufsen, I. S., & Sørensen, M. E. (2019). The ICSD-3/DSM-5 diagnostic criteria for insomnia reinforce the association between insomnia, anxiety and depression. Sleep Medicine, 64, S41. doi: 10.1016/j.sleep.2019.11.114CrossRefGoogle Scholar
Blanken, T. F., Borsboom, D., Penninx, B. W., & Van Someren, E. J. (2020). Network outcome analysis identifies difficulty initiating sleep as a primary target for prevention of depression: A 6-year prospective study. Sleep, 43(5), 16. doi: 10.1093/sleep/zsz288CrossRefGoogle ScholarPubMed
Blom, K., Jernelöv, S., Kraepelien, M., Bergdahl, M. O., Jungmarker, K., Ankartjärn, L., … Kaldo, V. (2015). Internet treatment addressing either insomnia or depression, for patients with both diagnoses: A randomized trial. Sleep, 38(2), 267277. doi: 10.5665/sleep.4412CrossRefGoogle ScholarPubMed
Blom, K., Jernelöv, S., Rück, C., Lindefors, N., & Kaldo, V. (2017). Three-year follow-up comparing cognitive behavioral therapy for depression to cognitive behavioral therapy for insomnia, for patients with both diagnoses. Sleep, 40(8), zsx108. doi: 10.1093/sleep/zsx108CrossRefGoogle ScholarPubMed
Braun, L., Titzler, I., Ebert, D. D., Buntrock, C., Terhorst, Y., Freund, J., … Baumeister, H. (2019). Clinical and cost-effectiveness of guided internet-based interventions in the indicated prevention of depression in green professions (PROD-A): Study protocol of a 36-month follow-up pragmatic randomized controlled trial. BMC Psychiatry, 19(1), 278. doi: 10.1186/s12888-019-2244-yCrossRefGoogle ScholarPubMed
Braun, L., Titzler, I., Terhorst, Y., Freund, J., Thielecke, J., Ebert, D. D., & Baumeister, H. (2021a). Are guided internet-based interventions for the indicated prevention of depression in green professions effective in the long run? Longitudinal analysis of the 6– and 12-month follow-up of a pragmatic randomized controlled trial (PROD-A). Internet Interventions, 26, 100455. doi: 10.1016/j.invent.2021.100455CrossRefGoogle Scholar
Braun, L., Titzler, I., Terhorst, Y., Freund, J., Thielecke, J., Ebert, D. D., & Baumeister, H. (2021b). Effectiveness of guided internet-based interventions in the indicated prevention of depression in green professions (PROD-A): Results of a pragmatic randomized controlled trial. Journal of Affective Disorders, 278, 658671. doi: 10.1016/j.jad.2020.09.066CrossRefGoogle ScholarPubMed
Brohan, E., & Thornicroft, G. (2010). Stigma and discrimination of mental health problems: Workplace implications. Occupational Medicine, 60(6), 414415. doi: 10.1093/occmed/kqq048CrossRefGoogle ScholarPubMed
Brückner, H., Wallot, S., Horvath, H., Ebert, D. D., & Lehr, D. (2024). Effectiveness of an online recovery training for employees exposed to blurred boundaries between work and non-work: A Bayesian analysis of a randomized controlled trial. University of Lüneburg.Google Scholar
Bundesärztekammer, B. Ä. K., Kassenärztliche Bundesvereinigung, K. B. V., & Arbeitsgemeinschaft der Wissenschaftlichen Medizinischen Fachgesellschaften, A. W. M. F. (2022). Nationale VersorgungsLeitlinie Unipolare Depression – Langfassung [Text/pdf]. doi: 10.6101/AZQ/000493CrossRefGoogle Scholar
Cheng, P., Kalmbach, D. A., Castelan, A. C., Murugan, N., & Drake, C. L. (2020). Depression prevention in digital cognitive behavioral therapy for insomnia: Is rumination a mediator? Journal of Affective Disorders, 273(August 2019), 434441. doi: 10.1016/j.jad.2020.03.184CrossRefGoogle ScholarPubMed
Cheng, P., Kalmbach, D. A., Kalmbach, D. A., Tallent, G., Joseph, C. L. M., Espie, C. A., & Drake, C. L. (2019a). Depression prevention via digital cognitive behavioral therapy for insomnia: A randomized controlled trial. Sleep, 42(10), zsz150. doi: 10.1093/sleep/zsz150CrossRefGoogle ScholarPubMed
Cheng, P., Luik, A. I., Fellman-Couture, C., Peterson, E., Joseph, C. L. M., Tallent, G., … Drake, C. L. (2019b). Efficacy of digital CBT for insomnia to reduce depression across demographic groups: A randomized trial. Psychological Medicine, 49(3), 491500. doi: 10.1017/S0033291718001113CrossRefGoogle ScholarPubMed
Chisholm, D., Sweeny, K., Sheehan, P., Rasmussen, B., Smit, F., Cuijpers, P., & Saxena, S. (2016). Scaling-up treatment of depression and anxiety: A global return on investment analysis. The Lancet Psychiatry, 3(5), 415424. doi: 10.1016/S2215-0366(16)30024-4CrossRefGoogle Scholar
Christensen, H., Batterham, P. J., Gosling, J. A., Ritterband, L. M., Griffiths, K. M., Thorndike, F. P., … Mackinnon, A. J. (2016). Effectiveness of an online insomnia program (SHUTi) for prevention of depressive episodes (the GoodNight study): A randomised controlled trial. The Lancet Psychiatry, 3(4), 333341. doi: 10.1016/S2215-0366(15)00536-2CrossRefGoogle Scholar
Chung, Y., Rabe-Hesketh, S., Dorie, V., Gelman, A., & Liu, J. (2013). A nondegenerate penalized likelihood estimator for variance parameters in multilevel models. Psychometrika, 78(4), 685709. doi: 10.1007/s11336-013-9328-2CrossRefGoogle ScholarPubMed
Clement, S., Schauman, O., Graham, T., Maggioni, F., Evans-Lacko, S., Bezborodovs, N., … Thornicroft, G. (2015). What is the impact of mental health-related stigma on help-seeking? A systematic review of quantitative and qualitative studies. Psychological Medicine, 45(1), 1127. doi: 10.1017/S0033291714000129CrossRefGoogle ScholarPubMed
Cooper, K. M., Gin, L. E., & Brownell, S. E. (2020). Depression as a concealable stigmatized identity: What influences whether students conceal or reveal their depression in undergraduate research experiences? International Journal of STEM Education, 7(1), 27. doi: 10.1186/s40594-020-00216-5CrossRefGoogle ScholarPubMed
Cuijpers, P. (2021). Indirect prevention and treatment of depression: An emerging paradigm? Clinical Psychology in Europe, 3(4), e6847. doi: 10.32872/cpe.6847CrossRefGoogle ScholarPubMed
Cuijpers, P., Karyotaki, E., Ciharova, M., Miguel, C., Noma, H., & Furukawa, T. A. (2021a). The effects of psychotherapies for depression on response, remission, reliable change, and deterioration: A meta-analysis. Acta Psychiatrica Scandinavica, 144(3), 288299. doi: 10.1111/acps.13335CrossRefGoogle ScholarPubMed
Cuijpers, P., Pineda, B. S., Quero, S., Karyotaki, E., Struijs, S. Y., Figueroa, C. A., … Muñoz, R. F. (2021b). Psychological interventions to prevent the onset of depressive disorders: A meta-analysis of randomized controlled trials. Clinical Psychology Review, 83, 101955. doi: 10.1016/j.cpr.2020.101955CrossRefGoogle ScholarPubMed
Cuijpers, P., Smit, F., Aalten, P., Batelaan, N., Klein, A., Salemink, E., … Karyotaki, E. (2021c). The associations of common psychological problems with mental disorders among college students. Frontiers in Psychiatry, 12(September), 19. doi: 10.3389/fpsyt.2021.573637CrossRefGoogle Scholar
Cuijpers, P., van Straten, A., Warmerdam, L., & van Rooy, M. J. (2010). Recruiting participants for interventions to prevent the onset of depressive disorders: Possible ways to increase participation rates. BMC Health Services Research, 10, 181. doi: 10.1186/1472-6963-10-181CrossRefGoogle ScholarPubMed
Dieck, A., Morin, C. M., & Backhaus, J. (2018). Deutsche version des insomnia severity index: Validierung und Bestimmung eines Cut-off-Punkts für Insomnie. Somnologie, 22(1), 2735. doi: 10.1007/s11818-017-0147-zCrossRefGoogle Scholar
Domhardt, M., Cuijpers, P., Ebert, D. D., & Baumeister, H. (2021). More light? Opportunities and pitfalls in digitalized psychotherapy process research. Frontiers in Psychology, 12, 544129. doi: 10.3389/fpsyg.2021.544129CrossRefGoogle ScholarPubMed
Ebert, D. D., Mortier, P., Kaehlke, F., Bruffaerts, R., Baumeister, H., & Auerbach, R. P., … On behalf of the WHO World Mental Health – International College Student Initiative collaborators. (2019). Barriers of mental health treatment utilization among first-year college students: First cross-national results from the WHO world mental health international college student initiative. International Journal of Methods in Psychiatric Research, 28(2), e1782. doi: 10.1002/mpr.1782CrossRefGoogle ScholarPubMed
Ebert, D. D., Thiart, H., Laferton, J. A. C., Berking, M., Riper, H., Cuijpers, P., … Lehr, D. (2015). Restoring depleted resources: Efficacy and mechanisms of change of an internet-based unguided recovery training for better sleep and psychological detachment from work. Health Psychology, 34(December), 12401251. doi: 10.1037/hea0000277CrossRefGoogle Scholar
Ebert, D. D., Van Daele, T., Nordgreen, T., Karekla, M., Compare, A., Zarbo, C., … Baumeister, H. (2018). Internet- and mobile-based psychological interventions: Applications, efficacy, and potential for improving mental health. European Psychologist, 23(2), 167187. doi: 10.1027/1016-9040/a000318CrossRefGoogle Scholar
Emerson, R. W. (2020). Bonferroni correction and type I error. Journal of Visual Impairment & Blindness, 114(1), 7778. doi: 10.1177/0145482X20901378CrossRefGoogle Scholar
Feng, G., Han, M., Li, X., Geng, L., & Miao, Y. (2020). The clinical effectiveness of cognitive behavioral therapy for patients with insomnia and depression: A systematic review and meta-analysis. Evidence-Based Complementary and Alternative Medicine, 2020, 114. doi: 10.1155/2020/8071821CrossRefGoogle ScholarPubMed
Ferrari, A. J., Charlson, F. J., Norman, R. E., Patten, S. B., Freedman, G., Murray, C. J. L., … Whiteford, H. A. (2013). Burden of depressive disorders by country, sex, age, and year: Findings from the global burden of disease study 2010. PLoS Medicine, 10, e1001547. doi: 10.1371/journal.pmed.1001547CrossRefGoogle ScholarPubMed
Furukawa, T. A., Noma, H., Caldwell, D. M., Honyashiki, M., Shinohara, K., Imai, H., … Churchill, R. (2014). Waiting list may be a nocebo condition in psychotherapy trials: A contribution from network meta-analysis. Acta Psychiatrica Scandinavica, 130(3), 181192. doi: 10.1111/acps.12275CrossRefGoogle Scholar
Garge, N. R., Bobashev, G., & Eggleston, B. (2013). Random forest methodology for model-based recursive partitioning: The mobForest package for R. BMC Bioinformatics, 14(1), 125. doi: 10.1186/1471-2105-14-125CrossRefGoogle ScholarPubMed
Groenwold, R. H. H., Moons, K. G. M., Peelen, L. M., Knol, M. J., & Hoes, A. W. (2011). Reporting of treatment effects from randomized trials: A plea for multivariable risk ratios. Contemporary Clinical Trials, 32(3), 399402. doi: 10.1016/j.cct.2010.12.011CrossRefGoogle ScholarPubMed
Gutiérrez-Rojas, L., Porras-Segovia, A., Dunne, H., Andrade-González, N., & Cervilla, J. A. (2020). Prevalence and correlates of major depressive disorder: A systematic review. Brazilian Journal of Psychiatry, 42(6), 657672. doi: 10.1590/1516-4446-2020-0650CrossRefGoogle ScholarPubMed
Harrell, F. E., Lee, K. L., & Mark, D. B. (1996). Multivariable prognostic models: Issues in developing models, evaluating assumptions and adequacy, and measuring and reducing errors. Statistics in Medicine, 15(4), 361387. doi: 10.1002/(SICI)1097-0258(19960229)15:4<3613.0.CO;2-4>CrossRefGoogle ScholarPubMed
Harrer, M., Apolinário-Hagen, J., Fritsche, L., Salewski, C., Zarski, A. C., Lehr, D., … Ebert, D. D. (2021). Effect of an internet- and app-based stress intervention compared to online psychoeducation in university students with depressive symptoms: Results of a randomized controlled trial. Internet Interventions, 24(February), 4:100374. doi: 10.1016/j.invent.2021.100374CrossRefGoogle ScholarPubMed
Harrer, M., & Ebert, D. D. (2023). Data Warehouse Coding Guide. Retrieved June 5, 2023, from https://web.archive.org/web/20230605070444/https://protectr.netlify.app/coding-guide.htmlGoogle Scholar
Hautzinger, M., Bailer, M., Hofmeister, D., & Keller, F. (2012). Allgemeine depressionsskala (2nd ed.). Göttingen, Germany: Hogrefe.Google Scholar
Higgins, J. P. T., Savović, J., Page, M. J., & Sterne, J. A. (2019). Revised Cochrane risk-of-bias tool for randomized trials (RoB 2). Retrieved from riskofbias.info.Google Scholar
Jacobson, N. S., & Truax, P. (1991). Clinical significance: A statistical approach to defining meaningful change in psychotherapy research. Journal of Consulting and Clinical Psychology, 59(1), 1219. doi: 10.1037/0022-006X.59.1.12CrossRefGoogle ScholarPubMed
Kalmbach, D. A., Cheng, P., Ahmedani, B. K., Peterson, E. L., Reffi, A. N., Sagong, C., … Drake, C. L. (2022). Cognitive-behavioral therapy for insomnia prevents and alleviates suicidal ideation: Insomnia remission is a suicidolytic mechanism. Sleep, 45(12), zsac251. doi: 10.1093/sleep/zsac251CrossRefGoogle ScholarPubMed
Kraepelien, M., Forsell, E., & Blom, K. (2022). Large-scale implementation of insomnia treatment in routine psychiatric care: Patient characteristics and insomnia-depression comorbidity. Journal of Sleep Research, 31(1), e13448.CrossRefGoogle ScholarPubMed
Kreiner, G. E. (2006). Consequences of work-home segmentation or integration: A person-environment fit perspective. Journal of Organizational Behavior, 27(4), 485507. doi: 10.1002/job.386CrossRefGoogle Scholar
Leerssen, J., Lakbila-Kamal, O., Dekkers, L. M. S., Ikelaar, S. L. C., Albers, A. C. W., Blanken, T. F., … Van Someren, E. J. W. (2021). Treating insomnia with high risk of depression using therapist-guided digital cognitive, behavioral, and circadian rhythm support interventions to prevent worsening of depressive symptoms: A randomized controlled trial. Psychotherapy and Psychosomatics, 91, 168179. doi: 10.1159/000520282CrossRefGoogle ScholarPubMed
Lehr, D., Koch, S., & Hillert, A. (2010). Where is (im)balance? Necessity and construction of evaluated cut-off points for effort-reward imbalance and overcommitment. Journal of Occupational and Organizational Psychology, 83(1), 251261. doi: 10.1348/096317909X406772CrossRefGoogle Scholar
Li, L., Wu, C., Gan, Y., Qu, X., & Lu, Z. (2016). Insomnia and the risk of depression: A meta-analysis of prospective cohort studies. BMC Psychiatry, 16(1), 375. doi: 10.1186/s12888-016-1075-3CrossRefGoogle ScholarPubMed
Little, R. J. A., & Rubin, D. B. (2002). Statistical analysis with missing data. Hoboken, NJ, USA: John Wiley & Sons, Inc. doi: 10.1002/9781119013563CrossRefGoogle Scholar
Mohr, G., Rigotti, T., & Müller, A. (2005). Irritation – Ein instrument zur Erfassung psychischer Beanspruchung im Arbeitskontext. Skalen- und Itemparameter aus 15 Studien. Zeitschrift für Arbeits- und Organisationspsychologie A&O, 49(1), 4448. doi: 10.1026/0932-4089.49.1.44CrossRefGoogle Scholar
Morin, C. M., Bertisch, S. M., Pelayo, R., Watson, N. F., Winkelman, J. W., Zee, P. C., & Krystal, A. D. (2023). What should be the focus of treatment when insomnia disorder is comorbid with depression or anxiety disorder? Journal of Clinical Medicine, 12(5), 1975. doi: 10.3390/jcm12051975CrossRefGoogle ScholarPubMed
Morin, C. M., Drake, C. L., Harvey, A. G., Krystal, A. D., Manber, R., Riemann, D., & Spiegelhalder, K. (2015). Insomnia disorder. Nature Reviews Disease Primers, 1(1), 15026. doi: 10.1038/nrdp.2015.26CrossRefGoogle Scholar
National Institute for Health and Care Excellence, N. I. C. E. (2022). Depression in adults: Treatment and management. Retrieved from www.nice.org.uk/guidance/ng222Google Scholar
Radloff, L. S. (1977). The CES-D scale: A self-report depression scale for research in the general population. Applied Psychological Measurement, 1(3), 385401. doi: 10.1177/014662167700100306CrossRefGoogle Scholar
R Core Team. (2022). R: A language and environment for statistical computing [Manual]. Vienna, Austria. Retrieved from https://www.R-project.org/Google Scholar
Riley, R. D., Debray, T. P. A., Fisher, D., Hattle, M., Marlin, N., Hoogland, J., … Ensor, J. (2020). Individual participant data meta-analysis to examine interactions between treatment effect and participant-level covariates: Statistical recommendations for conduct and planning. Statistics in Medicine, 39(15), 21152137. doi: 10.1002/sim.8516CrossRefGoogle ScholarPubMed
Riley, R. D., Lambert, P. C., & Abo-Zaid, G. (2010). Meta-analysis of individual participant data: Rationale, conduct, and reporting. BMJ, 340(feb05 1), c221c221. doi: 10.1136/bmj.c221CrossRefGoogle ScholarPubMed
Roach, M., Juday, T., Tuly, R., Chou, J. W., Jena, A. B., & Doghramji, P. P. (2021). Challenges and opportunities in insomnia disorder. International Journal of Neuroscience, 131(11), 10581065. doi: 10.1080/00207454.2020.1773460CrossRefGoogle ScholarPubMed
Robitzsch, A., & Grund, S. (2022). miceadds: Some additional multiple imputation functions, especially for “mice” [Manual]. Retrieved from https://CRAN.R-project.org/package=miceaddsGoogle Scholar
Rubin, D. B. (1987). Multiple imputation for nonresponse in surveys. Hoboken, NJ, USA: John Wiley & Sons, Inc. doi: 10.1002/9780470316696CrossRefGoogle Scholar
Satinsky, E., Fuhr, D. C., Woodward, A., Sondorp, E., & Roberts, B. (2019). Mental health care utilisation and access among refugees and asylum seekers in Europe: A systematic review. Health Policy, 123(9), 851863. doi: 10.1016/j.healthpol.2019.02.007CrossRefGoogle Scholar
Schaufeli, W., & Bakker, A. (2004). Utrecht Work Engagement Scale (UWES) – Preliminary Manual. Retrieved from https://www.wilmarschaufeli.nl/tests/#engagementGoogle Scholar
Shannon, P. J., Wieling, E., Simmelink-McCleary, J., & Becher, E. (2015). Beyond stigma: Barriers to discussing mental health in refugee populations. Journal of Loss and Trauma, 20(3), 281296. doi: 10.1080/15325024.2014.934629CrossRefGoogle Scholar
Siegrist, J. (2008). Chronic psychosocial stress at work and risk of depression: Evidence from prospective studies. European Archives of Psychiatry and Clinical Neuroscience, 258(S5), 115119. doi: 10.1007/s00406-008-5024-0CrossRefGoogle ScholarPubMed
Siegrist, J., Wege, N., Pühlhofer, F., & Wahrendorf, M. (2009). A short generic measure of work stress in the era of globalization: Effort–reward imbalance. International Archives of Occupational and Environmental Health, 82(8), 10051013. doi: 10.1007/s00420-008-0384-3CrossRefGoogle Scholar
Simon, L., Steinmetz, L., Feige, B., Benz, F., Spiegelhalder, K., & Baumeister, H. (2023). Comparative efficacy of onsite, digital, and other settings for cognitive behavioral therapy for insomnia: A systematic review and network meta-analysis. Scientific Reports, 13(1), 1929. doi: 10.1038/s41598-023-28853-0CrossRefGoogle ScholarPubMed
Smith, G. C. S., Seaman, S. R., Wood, A. M., Royston, P., & White, I. R. (2014). Correcting for optimistic prediction in small data sets. American Journal of Epidemiology, 180(3), 318324. doi: 10.1093/aje/kwu140CrossRefGoogle ScholarPubMed
Spanhel, K., Burdach, D., Pfeiffer, T., Lehr, D., Spiegelhalder, K., Ebert, D. D., … Sander, L. B. (2021). Effectiveness of an internet-based intervention to improve sleep difficulties in a culturally diverse sample of international students: A randomised controlled pilot study. Journal of Sleep Research,31(2), e134931. doi: 10.1111/jsr.13493Google Scholar
Spanhel, K., Hovestadt, E., Lehr, D., Spiegelhalder, K., Baumeister, H., Bengel, J., … Sander, L. B. (2022). Engaging refugees with a culturally adapted digital intervention to improve sleep: A randomized controlled pilot trial. Frontiers in Psychiatry, 13, 832196. doi: 10.3389/fpsyt.2022.832196Google Scholar
Staner, L. (2010). Comorbidity of insomnia and depression. Sleep Medicine Reviews, 14(1), 3546. doi: 10.1016/j.smrv.2009.09.003CrossRefGoogle ScholarPubMed
Sterne, J. A. C., Savović, J., Page, M. J., Elbers, R. G., Blencowe, N. S., Boutron, I., … Higgins, J. P. T. (2019). RoB 2: A revised tool for assessing risk of bias in randomised trials. BMJ, 366, l4898. doi: 10.1136/bmj.l4898CrossRefGoogle ScholarPubMed
Stewart, L. A., Clarke, M., Rovers, M., Riley, R. D., Simmonds, M., Stewart, G., & Tierney, J. F. (2015). Preferred reporting items for a systematic review and meta-analysis of individual participant data: The PRISMA-IPD statement. JAMA, 313(16), 1657. doi: 10.1001/jama.2015.3656CrossRefGoogle ScholarPubMed
Stewart, R., Besset, A., Bebbington, P., Brugha, T., Lindesay, J., Jenkins, R., … Meltzer, H. (2006). Insomnia comorbidity and impact and hypnotic use by age group in a national survey population aged 16 to 74 years. Sleep, 29(11), 13911397. doi: 10.1093/sleep/29.11.1391CrossRefGoogle Scholar
Sztein, D. M., Koransky, C. E., Fegan, L., & Himelhoch, S. (2018). Efficacy of cognitive behavioural therapy delivered over the internet for depressive symptoms: A systematic review and meta-analysis. Journal of Telemedicine and Telecare, 24(8), 527539. doi: 10.1177/1357633X17717402CrossRefGoogle ScholarPubMed
Thiart, H., Lehr, D., Ebert, D. D., Berking, M., & Riper, H. (2015). Log in and breathe out: Internet-based recovery training for sleepless employees with work-related strain – results of a randomized controlled trial. Scandinavian Journal of Work, Environment and Health, 41(2), 164174. doi: 10.5271/sjweh.3478CrossRefGoogle ScholarPubMed
Thiart, H., Lehr, D., Ebert, D. D., Sieland, B., Berking, M., & Riper, H. (2013). Log in and breathe out: Efficacy and cost-effectiveness of an online sleep training for teachers affected by work-related strain – study protocol for a randomized controlled trial. Trials 14, 169. doi: 10.1186/1745-6215-14-169[Q11]CrossRefGoogle ScholarPubMed
Torok, M., Han, J., Baker, S., Werner-Seidler, A., Wong, I., Larsen, M. E., & Christensen, H. (2020). Suicide prevention using self-guided digital interventions: A systematic review and meta-analysis of randomised controlled trials. The Lancet Digital Health, 2(1), e25e36. doi: 10.1016/S2589-7500(19)30199-2CrossRefGoogle Scholar
van Buuren, S. (2018). Chapter 2 multiple imputation. In van Buuren, S., Flexible imputation of missing data (2nd ed.), p.29-61. London, UK: Chapman & Hall/CRC Press.CrossRefGoogle Scholar
van Buuren, S., & Groothuis-Oudshoorn, K. (2011). Mice: Multivariate imputation by chained equations in R. Journal of Statistical Software, 45(3), 167. doi: 10.18637/jss.v045.i03Google Scholar
Van Der Noordt, M., IJzelenberg, H., Droomers, M., & Proper, K. I. (2014). Health effects of employment: A systematic review of prospective studies. Occupational and Environmental Medicine, 71(10), 730736. doi: 10.1136/oemed-2013-101891CrossRefGoogle ScholarPubMed
van der Zweerde, T., van Straten, A., Effting, M., Kyle, S. D., & Lancee, J. (2019). Does online insomnia treatment reduce depressive symptoms? A randomized controlled trial in individuals with both insomnia and depressive symptoms. Psychological Medicine, 49(3), 501509. doi: 10.1017/S0033291718001149CrossRefGoogle ScholarPubMed
Vargas, I., & Perlis, M. L. (2020). Insomnia and depression: Clinical associations and possible mechanistic links. Current Opinion in Psychology, 34, 9599. doi: 10.1016/j.copsyc.2019.11.004CrossRefGoogle ScholarPubMed
Vilagut, G., Forero, C. G., Barbaglia, G., & Alonso, J. (2016). Screening for depression in the general population with the center for epidemiologic studies depression (CES-D): A systematic review with meta-analysis. PLoS ONE, 11(5), e0155431. doi: 10.1371/journal.pone.0155431CrossRefGoogle Scholar
Wade, A. (2010). The societal costs of insomnia. Neuropsychiatric Disease and Treatment, 20(7), 118. doi: 10.2147/NDT.S15123CrossRefGoogle Scholar
Weisel, K. K., Lehr, D., Heber, E., Zarski, A. C., Berking, M., Riper, H., & Ebert, D. D. (2018). Severely burdened individuals do not need to be excluded from internet-based and mobile-based stress management: Effect modifiers of treatment outcomes from three randomized controlled trials. Journal of Medical Internet Research, 20(6), e211. doi: 10.2196/jmir.9387CrossRefGoogle Scholar
Werntz, A., Amado, S., Jasman, M., Ervin, A., & Rhodes, J. E. (2023). Providing human support for the use of digital mental health interventions: Systematic meta-review. Journal of Medical Internet Research, 25, e42864. doi: 10.2196/42864CrossRefGoogle ScholarPubMed
World Health Organization. (2022). World mental health report: Transforming mental health for all. Geneva.Google Scholar
Ye, Y., Chen, N., Chen, J., Liu, J., Lin, L., Liu, Y., … Jiang, X. (2016). Internet-based cognitive–behavioural therapy for insomnia (ICBT-i): A meta-analysis of randomised controlled trials. BMJ Open, 6(11), e010707. doi: 10.1136/bmjopen-2015-010707CrossRefGoogle ScholarPubMed
Zeileis, A., Hothorn, T., & Hornik, K. (2008). Model-based recursive partitioning. Journal of Computational and Graphical Statistics, 17(2), 492514. doi: 10.1198/106186008X319331CrossRefGoogle Scholar
Figure 0

Figure 1. Flowchart of study selection and inclusion.

Figure 1

Table 1. Characteristics of the included studies investigating the efficacy of GET.ON recovery on insomnia severity

Figure 2

Table 2. Overview of depression outcomes at post-treatment (8 weeks post-randomization) and at follow-up (24 weeks post-randomization) based on multiple imputed data

Figure 3

Figure 2. Forest plot summarizing the estimated effects estimated in individual studies (based on multiple imputation) and the average pooled effect from a one-stage IPD analysis.

Figure 4

Figure 3. Tree model for depressive symptoms (CES-D) post-treatment (a) and at follow-up (b) derived from model-based recursive partitioning in aggregated data.

Supplementary material: File

Thielecke et al. supplementary material

Thielecke et al. supplementary material
Download Thielecke et al. supplementary material(File)
File 366.1 KB