Hostname: page-component-cd9895bd7-fscjk Total loading time: 0 Render date: 2024-12-23T00:56:24.623Z Has data issue: false hasContentIssue false

A new generation computerised metacognitive cognitive remediation programme for schizophrenia (CIRCuiTS): a randomised controlled trial

Published online by Cambridge University Press:  04 September 2017

C. Reeder*
Affiliation:
Institute of Psychiatry, Psychology and Neuroscience (IoPPN), King's College London, UK
V. Huddy
Affiliation:
University College, London, UK
M. Cella
Affiliation:
Institute of Psychiatry, Psychology and Neuroscience (IoPPN), King's College London, UK
R. Taylor
Affiliation:
Institute of Psychiatry, Psychology and Neuroscience (IoPPN), King's College London, UK
K. Greenwood
Affiliation:
Sussex Partnership NHS Foundation Trust, Sussex, UK School of Psychology, University of Sussex, Falmer, UK
S. Landau
Affiliation:
Institute of Psychiatry, Psychology and Neuroscience (IoPPN), King's College London, UK
T. Wykes
Affiliation:
Institute of Psychiatry, Psychology and Neuroscience (IoPPN), King's College London, UK
*
*Address for correspondence: Dr C. Reeder, Ph.D., Department of Psychology, PO77, IoPPN, De Crespigny Park, Denmark Hill, London, SE5 8AF, UK. (Email: [email protected])
Rights & Permissions [Opens in a new window]

Abstract

Background

Cognitive remediation (CR) is a psychological therapy, which improves cognitive and social functioning in people with schizophrenia. It is now being implemented within routine clinical services and mechanisms of change are being explored. We designed a new generation computerised CR programme, CIRCuiTS (Computerised Interactive Remediation of Cognition – a Training for Schizophrenia), to enhance strategic and metacognitive processing, with an integrated focus on the transfer of cognitive skills to daily living. This large trial tested its feasibility to be delivered in therapist-led and independent sessions, and its efficacy for improved cognitive and social functioning.

Methods

A two arm single blind randomised superiority trial comparing CIRCuiTS plus treatment-as-usual (TAU) with TAU alone in 93 people with a diagnosis of schizophrenia. Cognitive, social functioning and symptom outcomes were assessed at pre- and post-therapy and 3 months later.

Results

85% adhered to CIRCuiTS, completing a median of 28 sessions. There were significant improvements in visual memory at post-treatment (p = 0.009) and follow-up (p = 0.001), and a trend for improvements in executive function at post-treatment (p = 0.056) in favour of the CIRCuiTS group. Community function was also differentially and significantly improved in the CIRCuiTS group at post-treatment (p = 0.003) but not follow-up, and was specifically predicted by improved executive functions.

Conclusions

CIRCuiTS was beneficial for improving memory and social functioning. Improved executive functioning emerges as a consistent predictor of functional gains and should be considered an important CR target to achieve functional change. A larger-scale effectiveness trial of CIRCuiTS is now indicated.

Type
Original Articles
Creative Commons
Creative Common License - CCCreative Common License - BY
This is an Open Access article, distributed under the terms of the Creative Commons Attribution licence (http://creativecommons.org/licenses/by/4.0/), which permits unrestricted re-use, distribution, and reproduction in any medium, provided the original work is properly cited.
Copyright
Copyright © Cambridge University Press 2017

Introduction

Cognitive dysfunction is a hallmark of a diagnosis of schizophrenia, a good predictor of functional recovery (Green et al. Reference Green, Kern, Braff and Mintz2000) and consequently a valued treatment target (Wykes & Spaulding, Reference Wykes and Spaulding2011). Cognitive remediation (CR) is ‘a behavioural training-based intervention to improve cognitive processes (e.g. attention, memory, executive functioning), with the general aim of durable benefits on community functioning’ (CREW, 2012). Meta-analytic results demonstrate beneficial effects on cognition and functioning (Krabbendam & Aleman, Reference Krabbendam and Aleman2003; McGurk et al. Reference McGurk, Twamley, Sitzer, McHugo and Mueser2007; Wykes et al. Reference Wykes, Huddy, Cellard, McGurk and Czobor2011), although generalisation to functional benefits are frequently restricted to strategy-based, rather than drill-and-practice, CR approaches, delivered in the context of vocational rehabilitation (Wykes et al. Reference Wykes, Huddy, Cellard, McGurk and Czobor2011; Drake et al. Reference Drake, Day, Picucci, Warburton, Larkin, Husain, Reeder, Wykes and Marshall2014). There is consensus, with some supporting evidence that cognitive improvements are likely to be maximised if the CR includes (i) massed practice (i.e. highly repetitive practice taking place on several days a week for prolonged periods), (ii) scaffolded learning facilitating high success rates, and (iii) a focus on motivation (Wykes & Reeder, Reference Wykes and Reeder2005; Wykes & Spaulding, Reference Wykes and Spaulding2011; Vinogradov et al. Reference Vinogradov, Fisher and de Villers-Sidani2012). CR programmes have generally not been purpose-built and frequently do not use evidence-based principles to drive cognitive change, or to generalise cognitive changes to functioning. The lack of an optimal, easy-to-deliver CR programme is notable, given that CR is increasingly being adopted in governmental guidelines (SIGN, 2013) and routine clinical practice (New York State Office of Mental Health, 2010).

Our group has developed a new generation, computerised metacognitive CR programme, CIRCuiTS [Computerised Interactive Remediation of Cognition – a Training for Schizophrenia (Reeder & Wykes, Reference Reeder and Wykes2010)], fit for widespread clinical dissemination, which uses evidence-based cognitive training principles, and targets functioning directly. Its focus on developing metacognition [i.e. thinking about thinking (Flavell, Reference Flavell1979)] is underpinned by a model that suggests that the transfer of cognitive skills to daily activities depends on metacognitive knowledge and metacognitive regulation, or the ability to effectively understand and manage one's own cognitive processes (Wykes & Reeder, Reference Wykes and Reeder2005). This entails a strategy-based approach, which is supported by studies showing that changes in executive function (i.e. metacognitive regulation) better predict functional change in schizophenia than changes in other cognitive processes such as memory (Reeder et al. Reference Reeder, Smedley, Butt, Bogner and Wykes2006, Reference Reeder, Harris, Pickles, Patel, Cella and Wykes2014; Eack et al. Reference Eack, Greenwald, Hogarty, Cooley, DiBarry, Montrose and Keshavan2009; Wykes et al. Reference Wykes, Reeder, Huddy, Taylor, Wood, Ghirasim, Kontis and Landau2012).

CIRCuiTS was designed for people with a schizophrenia diagnosis and developed with service user and therapist involvement. It is delivered by a therapist, supplemented by independent sessions. It is highly acceptable to service users and clinicians (Reeder et al. Reference Reeder, Pile, Watson, Crawford, Huddy, Cella, Rose, Callard and Wykes2015). An independent randomised controlled trial comparing CIRCuiTS plus Cognitive Behavioural Therapy for psychosis (CBTp) with social contact plus CBTp (Drake et al. Reference Drake, Day, Picucci, Warburton, Larkin, Husain, Reeder, Wykes and Marshall2014) showed that CIRCuiTS participants achieved the same symptom improvements with significantly fewer CBTp sessions and signficantly greater insight and executive improvements.

The current randomised controlled trial (RCT) compares CIRCuiTS plus treatment-as-usual (TAU) with TAU alone in people with schizophrenia. Our objectives were to assess (i) the feasibility of delivering CIRCuiTS with therapist-led sessions supplemented by independent working; and (ii) the efficacy of CIRCuiTS for improved cognition and social functioning.

Method

Ethical permission reference number 08/H0807/26.

Design

A two arm randomised superiority trial comparing CIRCuiTS plus TAU with TAU alone. Outcomes were measured at week 0 pre-randomisation (baseline), week 12 (post-treatment) and week 26 (follow-up).

Participants

Inclusion criteria were (i) DSM-IV diagnosis of schizophrenia or schizo-affective disorder, (ii) at least 1 year's contact with mental health services, (iii) 17–65 years, and (iv) performance more than one s.d. below the normative mean in working memory [digit span (Wechsler, Reference Wechsler1993)] and/or cognitive flexibility [Wisconsin Card Sorting Test (WCST) (Heaton et al. Reference Heaton, Chelune, Talley, Kay and Curtiss1993) or Hayling Sentence Completion Test (Burgess & Shallice, Reference Burgess and Shallice1997)]. The protocol criterion of poor social function was interpreted as not being in paid employment, receiving financial benefits for disability, or not living independently, due to difficulties in finding an informant for the pre-specified questionnaire. This criterion was included since social functioning is a target of the intervention and a secondary outcome. Therefore, participants needed to show room for improvement in this respect. Exclusion criteria were (i) plans to change medication during the study, (ii) substance dependence or (iii) evidence of an organic cause to cognitive difficulties.

Participants were recruited across the UK South London and Maudsley Mental Health National Health Service (NHS) Foundation Trust. Following an explanation of the study, written informed consent was obtained from all participants.

Interventions

Treatment-as-usual

Routine psychiatric care provided within the UK National Health Service, which may have taken place within community, inpatient or rehabilitation settings. In all settings, this is likely to include individualised multi-disciplinary contacts such as medication review and monitoring by a psychiatrist, regular meetings with a mental health nurse for support, and less frequently, psychological or occupational therapy, residential support with self-care, and attendance at day centres or rehabilitation programmes.

CR programme [CIRCuiTS (Reeder & Wykes, Reference Reeder and Wykes2010; Reeder et al. Reference Reeder, Pile, Watson, Crawford, Huddy, Cella, Rose, Callard and Wykes2015)]

CIRCuiTS is a web-based computerised CR therapy, delivered by a therapist but supplemented with independent sessions to facilitate massed practice. It targets metacognition, particularly strategy use, in addition to providing massed practice of basic cognitive functions. The therapist facilitates motivation, metacognitive and strategy development and generalisation of learning by encouraging the participant to learn about and regulate their cognitive performance and to transfer this learning to meet real-world goals. Therapists provide additional scaffolding for CR tasks to ensure consistent successful performance. Independent sessions involve carrying out cognitive tasks allocated by the therapist to ensure scaffolded learning.

Real-world cognitive goals are set collaboratively, and then CIRCuiTS tasks are used to identify cognitive strengths and difficulties and factors affecting cognitive performance. The primary cognitive targets are attention, memory and executive functioning and repetitive tasks gradually increase in difficulty in line with individual highly successful performance. Participants develop a set of personalised strategies to improve their cognitive performance, and achieve their goals.

The CR tasks are either ‘abstract’ (neutral content, such as numbers, and designed to target specific cognitive functions) or ‘exercises’ (cognitively complex and ecologically valid) associated with work, social situations, cooking, shopping and travelling. (Please see the online Supplementary material 1 for some examples). Therapists encourage participants to apply the skills learnt to daily life and to practice in vivo, in order to achieve their real-world goals. Thus, functional outcomes are directly targeted by the therapy.

Rate of delivery

CIRCuiTS was offered at least three times a week (maximum 12 weeks), up to 40 sessions lasting up to an hour. Where possible, according to participants’ ability and choice, therapists encouraged them to carry out additional independent sessions (please see online Supplementary material 1 for further information).

Therapists and therapy fidelity

Therapists were supervised, trained graduate psychologists. A high degree of fidelity is ensured using computerised delivery but audio-recordings of three sessions (from start, middle and end of therapy) for all participants who consented to recordings (n = 28 sessions) were also rated using a modified CRT Fidelity Scale (Stenmark, Reference Stenmark2006) (see online Supplementary materials 2).

Outcome measures

Participants were reimbursed £5 per hour for assessments.

Baseline assessments

Socio-demographic and clinical variables collated from participants, case notes and mental health workers.

Estimated premorbid full scale IQ: Wechsler Test of Adult Reading (Wechsler, Reference Wechsler2001).

Estimated current IQ [pro-rated (Silverstein, Reference Silverstein1982)]: Vocabulary and Block Design from the Wechsler Adult Intelligence Scale – Third Edition – UK [WAIS-III-UK (Wechsler, Reference Wechsler1993)].

Symptoms: Positive and Negative Syndrome Scale (Kay et al. Reference Kay, Fiszbein and Opler1987) (PANSS) (total score). A 30-item clinical interview to assess symptom severity for schizophrenia, administered by trained graduate psychologists achieving high inter-rater reliability to an expert trainer. Positive, negative, disorganised, excited and depressed subscales were used (Wallwork et al. Reference Wallwork, Fortgang, Hashimoto, Weinberger and Dickinson2012).

Primary outcomes

The primary point of interest was 12 weeks (post-therapy).

Verbal working memory: Digit Span [WAIS-III-UK (Wechsler, Reference Wechsler1993)], a working memory task: total raw score (high scores – good performance).

Visual memory: Rey Osterreith Complex Figure (ROCF) (Rey, Reference Rey1941; Osterreith, Reference Osterreith1944), a visual memory test: immediate recall raw score (high scores – good performance).

Verbal executive function: Hayling Sentence Completion test (Burgess & Shallice, Reference Burgess and Shallice1997), measuring response inhibition: total scaled score (high scores – good performance).

Visual executive function: WCST (Heaton et al. Reference Heaton, Chelune, Talley, Kay and Curtiss1993), testing abstraction and cognitive flexibility: percentage errors raw score (high scores – poor performance).

Secondary outcomes

Community functioning: Time Use Survey [UK 2000 Time Use Survey (Short, Reference Short2006)]. A semi-structured interview recording participants’ time use, selected to capture widely disparate clinically meaningful increases in functional activity. Key outcome: total hours per week over the past month spent in employment, education, voluntary work, voluntary and structured leisure activities, housework and chores, childcare, sports and hobbies.

Symptoms: PANSS: positive, negative and disorganised symptom subscales (high scores – high symptom levels).

Sample size

Following the most recent meta-analysis (Wykes et al. Reference Wykes, Huddy, Cellard, McGurk and Czobor2011), the planned sample size was revised to 44 per group allowing detection of an effect size of 0.6 or larger at post-treatment with 80% power using an independent samples t test at the 5% significance level. Assuming a drop out rate of 10%, 49 participants per group were needed.

Randomisation and blinding

Following the initial assessment, consecutive referrals of participants meeting inclusion criteria were allocated (1:1) to CIRCuiTS plus TAU or TAU using an online system, independently set up by the Clinical Trials Unit, KCL. A minimisation algorithm was used to ensure balance in terms of the gender and age group (above and below 40 years) stratifiers.

Graduate psychologists blind to group assignment conducted all assessments. All the analyses not requiring group identification were carried out blind to allocation.

Statistical analyses

Therapy feasibility analyses (conducted by CR)

These summarised therapy adherence (number and length of completed sessions, including independent sessions) for all CIRCuiTS participants. We judged 20 sessions a priori to constitute a minimum therapy course. Therapy completers and non-completers and those who did and did not complete independent sessions were compared on age, current IQ, five symptom dimensions and the primary cognitive outcomes at baseline using t tests or Mann–Whitney U tests.

Primary and secondary outcome group comparisons

Formal analyses were carried out on an intention-to-treat basis by SL to evaluate the efficacy of CIRCuiTS in terms of primary and secondary outcomes at 12 and 26 weeks.

Linear mixed models fitted by maximum likelihood (ML) simultaneously modelled the 12 and 26 week data. The models were parameterised to provide separate group effect estimates at 12 and 26 weeks (see Table 3) and effect estimates standardised by dividing by respective baseline s.d.s. Models include (fixed) effects of time, trial arm and a group × time interaction. Models always include randomisation stratifiers and baseline values of the variable under investigation as a covariate to increase power. They further conditioned on variables that were found to predict attrition to make more realistic assumptions regarding the missing data mechanism. (The resulting ML estimates are valid under the missing at random assumption). To detect such variables empirically a logistic regression was conducted with the dependent variable ‘missingness of the primary outcome variables at 26 weeks’. This used a forward selection approach (inclusion threshold 10%) to test whether any of: PANSS five factor scores, ethnic group, employment status, estimated premorbid and current IQ, or baseline chlorpromazine equivalent, predicted missingness, in addition to age and gender. PANSS excited scores and premorbid IQ were found to be predictive and hence included as covariates in all analysis models. Finally linear mixed models contained a randomly varying intercept at the level of the participant to account for correlation between the two repeated measures.

Exploratory mechanism analyses

Therapy characteristics were correlated with change in each of the four primary cognitive outcomes and community functioning over 12 weeks for CRT completers: (i) total number of sessions completed, (ii) mean number of tasks completed per session, (iii) mean number of strategies, rated with high usefulness, used per session, and (iv) whether or not independent sessions were completed.

To explore whether change in any of the cognitive variables singly partially mediated the effect of CIRCuiTS on the functioning outcome we followed a Baron–Kenny approach (Baron & Kenny, Reference Baron and Kenny1986; MacKinnon & Valente, Reference MacKinnon and Valente2014). We adjusted mediator and outcome models for covariates identified in the efficacy analyses.

Results

In total 93 people were randomised between 24th May 2010 and 29th May 2012. The final follow-up assessment was on 26th November 2012 (see Fig. 1).

Fig. 1. Consort diagram.

Participant characteristics

Randomisation was successful in balancing the trial arms with regard to baseline variables (see Table 1).

Table 1. Participant characteristics

Only four participants were completely lost to follow-up (i.e. 4.3% at both 12 and 26 week assessment time points, Fig. 1). 17 participants had a missing value for at least one of the four primary outcome variables at 26 weeks (18.3%).

CIRCuiTS feasibility

Of the seven (15%) non-completers, six completed only one or two sessions, and one completed 16 sessions. For all CIRCuiTS participants, the median number of sessions completed was 25.5 (range 1–41). Amongst completers, the median was 27.5 (20–41), the mean session length was 45.5 min (s.d. 10.2), a mean of 4.8 (s.d. 1.6) tasks per session were completed and a mean of 7.1 (s.d. 4.2) useful strategies used per session.

Nine people (20%) completed at least one independent session (median 6, 1–10). Participants who completed independent sessions completed a similar number of sessions overall (median 27.5, 20–41) to those who did not complete independent sessions (median 27.0, 20–40). The only significant difference (t = 2.8, df = 39.6, p = 0.007), with little clinical importance, between those completing independent sessions and those who did not, was on the PANSS excited score: independent sessions mean = 5.68, s.d. = 2.2; no independent sessions mean = 4.44, s.d. = 0.73).

Five therapists conducted the CRT with three seeing fewer than 10 patients. The majority of rated sessions (18 sessions – 64.2%) were scored 7/7 on the modified CRT Fidelity Scale and the lowest score (only three sessions – 10.7%) was 5/7.

Does CIRCuiTS lead to improved cognitive and functioning outcomes?

Table S1 (please see online Supplementary material 3) summarises observed primary and secondary outcomes.

Table 2 shows the results of the formal statistical analyses. Since we had four primary outcomes, the significance level was adjusted (α = 0.05/4 = 0.0125). We found significant improvements for immediate visual memory at post-treatment (p = 0.009) and at follow-up (p = 0.001), and a trend for improvement in non-verbal executive functioning at post-treatment (p = 0.056), in favour of CIRCuiTS. The secondary outcome analyses demonstrated that CIRCuiTS participants spent significantly more time in structured activities at post-treatment (p = 0.003). There was also some evidence (p = 0.049) that PANSS positive symptoms were lower in the CIRCuiTS arm at post-treatment.

Table 2. Estimated treatment group effects at 12 and 26 weeks post randomisation

a Outcome was analysed on the ln-scale due to positive skewness. Unstandardised effect estimates represent multiplicative (factor) effects and need to be compared with the factor value ‘1’ (=no group effect).

Are aspects of therapy associated with cognitive and functional outcomes?

More completed sessions were associated with greater non-verbal executive improvement (r = −0.31) at 12 weeks and a larger benefit for structured activity (r = 0.22). Improvement in visual memory was associated with more tasks completed and a higher number of useful strategies (r = 0.39 and r = 0.24 respectively). Completion of independent sessions was not associated with any outcome.

Does cognition mediate the CR effect on functioning?

The exploratory mediation analyses are summarised in Table 3. Change in only one of the four primary cognitive outcomes, the WCST, showed a significant association with increased time in structured activities at 12 weeks (estimated standardised regression coefficient −0.28, 95% CI from −0.51 to −0.06). Approximately 20% of the increase in (ln-)structured time in the CIRCuiTS arm was mediated by a reduction in WCST errors.

Table 3. Mediation of CR effects on time spend in structured activities at 12 weeks by primary cognitive outcomes (n = 87)

a Time spend in structured activities was ln-transformed and then standardised to express functioning in units of baseline standard deviations (s.d.s).

b Confidence interval for direct effect is bias corrected bootstrap interval (using 1000 bootstrap replicates) as recommended in (MacKinnon & Valente, Reference MacKinnon and Valente2014).

c Sobel test for zero mediation.

d Not applicable when the direct and indirect CR effect point in different directions.

Discussion

CIRCuITS feasibility

This study demonstrates that CIRCuiTS, a new generation computerised metacognitive CR programme, is feasible for people with a schizophrenia diagnosis with cognitive impairment. 85% of participants offered CIRCuiTS attended at least 20 sessions within 12 weeks. This adherence rate compares favourably with other CR studies (Wykes et al. Reference Wykes, Huddy, Cellard, McGurk and Czobor2011), including computerised CR (Murthy et al. Reference Murthy, Mahncke, Wexler, Maruff, Inamdar, Zucchetto, Lund, Shabbir, Shergill, Keshavan, Kapur, Laruelle and Alexander2012). Six of the seven participants with poor adherence stopped attending after only one or two sessions, suggesting that for most participants engagement was achieved very quickly.

The target dose was 40 sessions but the median number for completers was 28. The average attendance of approximately two sessions per week is consistent with attendance rates in our previous trials, which have generally used extended time periods to achieve a higher dose (Wykes et al. Reference Wykes, Reeder, Landau, Everitt, Knapp, Patel and Romeo2007). One meta-analysis of CR (McGurk et al. Reference McGurk, Twamley, Sitzer, McHugo and Mueser2007) reported a mean intensity of 2 hours per week, and this remains a common regime in CR trials (Bowie et al. Reference Bowie, McGurk, Mausbach, Patterson and Harvey2012; Drake et al. Reference Drake, Day, Picucci, Warburton, Larkin, Husain, Reeder, Wykes and Marshall2014). The persistence of a two session per week norm, despite the emphasis on massed practice in CR programmes, may reflect the clinical reality that motivating people with schizophrenia [known to often have motivational impairments (Cella et al. Reference Cella, Bishara, Medin, Swan, Reeder and Wykes2014)], to attend more than twice a week is challenging.

Does CIRCuiTS lead to improved cognitive and functional outcomes?

Both post-therapy and at 3 month follow-up the CIRCuiTS group showed significantly greater improvement in immediate visual memory. This is encouraging in light of findings of deterioration in visual-spatial/constructional skills over 3 years in a sample of people with chronic schizophrenia (Dickerson et al. Reference Dickerson, Schroeder, Stallings, Origoni, Katsafanas, Schwienfurth, Savage, Khushalani and Yolken2014): CIRCuiTS may protect against cognitive decline. There was also a trend (p = 0.056) for greater improvement in WCST scores following CIRCuiTS, which may be important since this was the main cognitive driver of functioning improvement.

Changes in other cognitive outcomes were not significantly different between groups. We have noted that the mean number of sessions was lower than intended and consequently may have been insufficient for consistent cognitive improvements. In fact, greater WCST and social functioning improvements at post-treatment were associated with doing more therapy sessions. The main theoretical change mechanism for CIRCuiTS, in addition to massed practice, is via the development of metacognitive knowledge and metacognitive regulation, including the use of strategies for a more systematic and organised approach to tasks. Greater improvement in immediate visual memory was predicted by a higher mean number of tasks carried out within sessions and a higher mean number of strategies rated as helpful by patients. This is consistent with massed practice and strategy use being the chief mechanisms of cognitive change. However, note that our study only estimates associations with aspects of therapy, which are not necessarily causal.

A more strategic approach is likely to entail a considerable shift in the way in which tasks are undertaken, and this may lead to an initial deterioration in performance (Harvey et al. Reference Harvey, Galletly, Field and Proeve2009). The two cognitive tasks, which did not show improvement require immediate, rapid responses, and so would not have been likely to benefit from an increase in strategic thinking, which may take more time. However, better strategy use does appear to underpin more efficient executive and memory performance in schizophrenia in both the WCST (Choi & Kurtz, Reference Choi and Kurtz2009) and the ROCF (Landgraf et al. Reference Landgraf, Amado, Brucks, Krueger, Krebs and Van der Meer2011), consistent with the cognitive improvements in this study.

To assess functional changes, we used a Time Use Survey measure in an attempt to capture the wide range of changes (from gaining paid employment to beginning to meet with a relative once or twice a week) that may be meaningful within a sample of people with a schizophrenia diagnosis. CIRCuiTS led to improved community functioning post-therapy by increasing the hours spent in structured activity, although this was not sustained at follow-up. This presumably reflects the constraints of offering therapy within a research context. For many people, sustained improvement and recovery requires maintained support. This is consistent with findings that CR is most beneficial when offered in the context of an adjunctive rehabilitation programme (Wykes et al. Reference Wykes, Huddy, Cellard, McGurk and Czobor2011).

Does cognition mediate improvements in functioning?

Only improved executive functioning was associated with benefits for functioning: this finding is well-supported in the literature (Reeder et al. Reference Reeder, Smedley, Butt, Bogner and Wykes2006, Reference Reeder, Harris, Pickles, Patel, Cella and Wykes2014; Eack et al. Reference Eack, Greenwald, Hogarty, Cooley, DiBarry, Montrose and Keshavan2009; Wykes et al. Reference Wykes, Reeder, Huddy, Taylor, Wood, Ghirasim, Kontis and Landau2012) and is consistent with the metacognitive model, which underpins CIRCuiTS (Wykes & Reeder, Reference Wykes and Reeder2005). Executive functions are likely to be important CR targets to achieve functional change. However, note that we cannot establish causality at this stage. Our mediation models were exploratory in nature and make a number of assumptions; including that there are no further hidden confounders of the cognition-functioning relationship and that measurement error in cognitive variables is negligible.

Study limitations

Despite being one of the largest CR trials to date, our final sample size might have been too low to identify moderate effects at the 5% significance level taking into account our multiple outcome comparisons. Consequently, we may have failed to detect some effects of CIRCuiTS.

We did not include an active control condition: a lack of agreement regarding what constitutes specific v. non-specific effects of CR, combined with evidence that active computerised CR controls may not be effective (Gomar et al. Reference Gomar, Valls, Radua, Mareca, Tristany, Del Olmo, Rebolleda-Gil, Janez-Alvarez, de Alvaro, Ovejero, Llorente, Teixido, Donaire, Garcia-Laredo, Lazcanoiturburu, Granell, Mozo, Perez-Hernandez, Moreno-Alcazar, Pomarol-Clotet and McKenna2015), made it difficult to justify public funding support for an additional control treatment arm.

Conclusions

CIRCuiTS, a new generation computerised CR programme, is feasible to deliver both with therapist-led and independent sessions. It led to improved performance in immediate visual memory which relies on executive organisational skills for effective encoding, and this improvement was maintained at 3-month follow-up. It also resulted in increased structured activity post-therapy. A large-scale effectiveness trial is warranted.

Supplementary material

The supplementary material for this article can be found at https://doi.org/10.1017/S0033291717001234.

Acknowledgements

Professor Til Wykes and Dr Clare Reeder jointly own the IP for CIRCuiTS along with King's College London. CIRCuiTS therapists were Fiona Ram, Diane Agoro, India Webb, Natalia Ghirasim, Dimitrios Kontis and Polly Crawford. The assessments were conducted by Sasha Whaley, Evelina Medin, Sarah Swan, Gareth Drake, Nina Grant, Mary Jo Doyle and Clementine Edwards. This work was supported by a Research for Patient Benefit grant from the National Institute of Health Research, UK (grant reference number: PB-PG-0807-14002). Sabine Landau and Til Wykes receive salary support from the National Institute for Health Research (NIHR) (Mental Health Biomedical Research Centre) at the South London and Maudsley NHS Foundation Trust and King's College London. Til Wykes also receives support from her NIHR Senior Investigator award. The views expressed are those of the authors and not necessarily those of the NHS, the NIHR or the Department of Health.

Trial Registration: ISRCTN55488371 (http://www.isrctn.com/ISRCTN55488371).

Declaration of Interest

Professor Til Wykes and Dr Clare Reeder jointly own the IP for CIRCuiTS along with King's College London.

Ethical standards

The authors assert that all procedures contributing to this work comply with the ethical standards of the relevant national and institutional committees on human experimentation and with the Helsinki Declaration of 1975, as revised in 2008.

Footnotes

Joint last authors.

References

Baron, RM, Kenny, DA (1986). The moderator mediator variable distinction in social psychological-research – Conceptual, strategic, and statistical considerations. Journal of Personality and Social Psychology 51, 11731182.CrossRefGoogle ScholarPubMed
Bowie, CR, McGurk, SR, Mausbach, B, Patterson, TL, Harvey, PD (2012). Combined cognitive remediation and functional skills training for schizophrenia: effects on cognition, functional competence, and real-world behavior. American Journal of Psychiatry 169, 710718.CrossRefGoogle ScholarPubMed
Burgess, P, Shallice, T (1997). The Hayling and Brixton Tests. Thames Valley Test Company/Pearson Assessment: Bury St. Edmunds, UK.Google Scholar
Cella, M, Bishara, AJ, Medin, E, Swan, S, Reeder, C, Wykes, T (2014). Identifying cognitive remediation change through computational modelling – effects on reinforcement learning in schizophrenia. Schizophrenia Bulletin 40, 14221432.CrossRefGoogle ScholarPubMed
Choi, J, Kurtz, MM (2009). A comparison of remediation techniques on the Wisconsin Card Sorting Test in schizophrenia. Schizophrenia Research 107, 7682.CrossRefGoogle ScholarPubMed
CREW (2012). Definition of Cognitive Remediation. Cognitive Remediation Expert Working Group: Florence, Italy.Google Scholar
Dickerson, F, Schroeder, J, Stallings, C, Origoni, A, Katsafanas, E, Schwienfurth, LAB, Savage, CLG, Khushalani, S, Yolken, R (2014). A longitudinal study of cognitive functioning in schizophrenia: clinical and biological predictors. Schizophrenia Research 156, 248253.CrossRefGoogle ScholarPubMed
Drake, RJ, Day, CJ, Picucci, R, Warburton, J, Larkin, W, Husain, N, Reeder, C, Wykes, T, Marshall, M (2014). A naturalistic, randomized, controlled trial combining cognitive remediation with cognitive-behavioural therapy after first-episode non-affective psychosis. Psychological Medicine 44, 18891899.Google Scholar
Eack, SM, Greenwald, DP, Hogarty, SS, Cooley, SJ, DiBarry, AL, Montrose, DM, Keshavan, MS (2009). Cognitive enhancement therapy for early-course schizophrenia: effects of a two-year randomized controlled trial. Psychiatric Services 60, 14681476.CrossRefGoogle ScholarPubMed
Flavell, JH (1979). Metacognition and cognitive monitoring: a new area of cognitive -developmental inquiry. American Psychologist 34, 906911.Google Scholar
Gomar, JJ, Valls, E, Radua, J, Mareca, C, Tristany, J, Del Olmo, F, Rebolleda-Gil, C, Janez-Alvarez, M, de Alvaro, FJ, Ovejero, MR, Llorente, A, Teixido, C, Donaire, AM, Garcia-Laredo, E, Lazcanoiturburu, A, Granell, L, Mozo, CP, Perez-Hernandez, M, Moreno-Alcazar, A, Pomarol-Clotet, E, McKenna, PJ, Cognitive Rehabilitation Study G (2015). A multisite, randomized controlled clinical trial of computerized cognitive remediation therapy for schizophrenia. Schizophrenia Bulletin 41, 13871396.Google Scholar
Green, MF, Kern, RS, Braff, DL, Mintz, J (2000). Neurocognitive deficits and functional outcome in schizophrenia: are we measuring the ‘right stuff’? Schizophrenia Bulletin 26, 119136.Google Scholar
Harvey, KE, Galletly, CA, Field, C, Proeve, M (2009). The effects of verbalisation on cognitive performance in schizophrenia: a pilot study using tasks from the Delis Kaplan Executive Function System. Neuropsychological Rehabilitation 19, 733741.Google Scholar
Heaton, R, Chelune, G, Talley, J, Kay, G, Curtiss, G (1993). Wisconsin Card Sorting Test Manual, Revised and Expanded. P. Resources: Odessa.Google Scholar
Kay, SR, Fiszbein, A, Opler, LA (1987). The positive and negative syndrome scale (panss) for schizophrenia. Schizophrenia Bulletin 13, 261276.Google Scholar
Krabbendam, L, Aleman, A (2003). Cognitive rehabilitation in schizophrenia: a quantitative analysis of controlled studies. Psychopharmacology 169, 376382.Google Scholar
Landgraf, S, Amado, I, Brucks, M, Krueger, F, Krebs, M-O, Van der Meer, E (2011). Inflexible information acquisition strategies mediate visuo-spatial reasoning in stabilized schizophrenia patients. World Journal of Biological Psychiatry 12, 608619.Google Scholar
MacKinnon, DP, Valente, MJ (2014). Mediation from multilevel to structural equation modeling. Annals of Nutrition and Metabolism 65, 198204.Google Scholar
McGurk, SR, Twamley, EW, Sitzer, DI, McHugo, GJ, Mueser, KT (2007). A meta-analysis of cognitive remediation in schizophrenia. American Journal of Psychiatry 164, 17911802.CrossRefGoogle ScholarPubMed
Murthy, NV, Mahncke, H, Wexler, BE, Maruff, P, Inamdar, A, Zucchetto, M, Lund, J, Shabbir, S, Shergill, S, Keshavan, M, Kapur, S, Laruelle, M, Alexander, R (2012). Computerized cognitive remediation training for schizophrenia: an open label, multi-site, multinational methodology study. Schizophrenia Research 139, 8791.Google Scholar
Osterreith, PA (1944). Filetest de copie d'une figure complex: contribution a l'etude de la perception et de la memoire. Archives de Psychologie 30, 286356.Google Scholar
Reeder, C, Harris, V, Pickles, A, Patel, A, Cella, M, Wykes, T (2014). Does change in cognitive function predict change in costs of care for people with a schizophrenia diagnosis following cognitive remediation therapy? Schizophrenia Bulletin 40, 14721481.CrossRefGoogle ScholarPubMed
Reeder, C, Pile, V, Watson, A, Crawford, P, Huddy, V, Cella, M, Rose, D, Callard, F, Wykes, T (2015). The feasibility and acceptability to service users of CIRCuiTS – computerised interactive remediation of cognition – a training for schizophrenia. Behavioural and Cognitive Psychotherapy Bulletin 44, 288305.CrossRefGoogle Scholar
Reeder, C, Smedley, N, Butt, K, Bogner, D, Wykes, T (2006). Cognitive predictors of social functioning improvements following cognitive remediation for schizophrenia. Schizophrenia Bulletin 32, S123S131.CrossRefGoogle ScholarPubMed
Reeder, C, Wykes, T (2010). Cognitive Interaction Remediation of Cognition – a Training for Schizophrenia (CIRCuiTS). King's College London: UK.Google Scholar
Rey, A (1941). L'examen psychologique dans les cas d'encephalopathie traumatique (Les problems.). Archives de Psychologie 28, 215285.Google Scholar
Short, S (2006). Review of the UK 2000 Time Use Survey. O. f. N. Statistics: London, UK.Google Scholar
SIGN (2013). A national clinical guideline: Health Care Improvement.Google Scholar
Silverstein, A (1982). Two- and four-subtest short forms of the Wechsler adult intelligence scale-revised. Journal of Consulting and Clinical Psychology 50, 415418.Google Scholar
New York State, Office of Mental Health (2010). Personalized Recovery Oriented Services Regulations (Part 512). New York State, USA.Google Scholar
Stenmark, R (2006). Cognitive Remediation Therapy Fidelity Scale. University of Lund: Jonkoping, Sweden.Google Scholar
Vinogradov, S, Fisher, M, de Villers-Sidani, E (2012). Cognitive training for impaired neural systems in neuropsychiatric illness. Neuropsychopharmacology 37, 4376.Google Scholar
Wallwork, RS, Fortgang, R, Hashimoto, R, Weinberger, DR, Dickinson, D (2012). Searching for a consensus five-factor model of the Positive and Negative Syndrome Scale for schizophrenia. Schizophrenia Research 137, 246250.CrossRefGoogle ScholarPubMed
Wechsler, D (1993). Wechsler Adult Intelligence Scale – 3rd edn., manual. Psychological Corporation: San Antonio.Google Scholar
Wechsler, D (2001). Wechsler Test of Adult Reading (WTAR). The Psychological Corporation: San Antonio.Google Scholar
Wykes, T, Huddy, V, Cellard, C, McGurk, SR, Czobor, P (2011). A meta-analysis of cognitive remediation for schizophrenia: methodology and effect sizes. American Journal of Psychiatry 168, 472485.CrossRefGoogle ScholarPubMed
Wykes, T, Reeder, C (2005). Cognitive Remediation Therapy for Schizophrenia: Theory and Practice. Brunner Routledge: London, UK.Google Scholar
Wykes, T, Reeder, C, Huddy, V, Taylor, R, Wood, H, Ghirasim, N, Kontis, D, Landau, S (2012). Developing models of how cognitive improvements change functioning: mediation, moderation and moderated mediation. Schizophrenia Research 138, 8893.Google Scholar
Wykes, T, Reeder, C, Landau, S, Everitt, B, Knapp, M, Patel, A, Romeo, R (2007). Cognitive remediation therapy in schizophrenia – Randomised controlled trial. British Journal of Psychiatry 190, 421427.CrossRefGoogle ScholarPubMed
Wykes, T, Spaulding, WD (2011). Thinking about the future cognitive remediation therapy-what works and could we do better? Schizophrenia Bulletin 37, S80S90.CrossRefGoogle ScholarPubMed
Figure 0

Fig. 1. Consort diagram.

Figure 1

Table 1. Participant characteristics

Figure 2

Table 2. Estimated treatment group effects at 12 and 26 weeks post randomisation

Figure 3

Table 3. Mediation of CR effects on time spend in structured activities at 12 weeks by primary cognitive outcomes (n = 87)

Supplementary material: File

Reeder et al supplementary material

Reeder et al supplementary material 1

Download Reeder et al supplementary material(File)
File 675.3 KB