Hostname: page-component-cd9895bd7-jkksz Total loading time: 0 Render date: 2024-12-22T18:40:04.203Z Has data issue: false hasContentIssue false

Increasing access to cognitive–behavioural therapy for patients with psychosis by evaluating the feasibility of a randomised controlled trial of brief, targeted cognitive–behavioural therapy for distressing voices delivered by assistant psychologists: the GiVE2 trial

Published online by Cambridge University Press:  19 August 2021

Mark Hayward*
Affiliation:
School of Psychology, University of Sussex, UK; and Research & Development Department, Sussex Partnership NHS Foundation Trust, UK
Katherine Berry
Affiliation:
Faculty of Biology, Medicine & Health, Manchester Academic Health Sciences Centre, University of Manchester, UK
Stephen Bremner
Affiliation:
Brighton & Sussex Medical School, University of Sussex, UK
Anna-Marie Jones
Affiliation:
Research & Development Department, Sussex Partnership NHS Foundation Trust, UK
Sam Robertson
Affiliation:
Research & Development Department, Sussex Partnership NHS Foundation Trust, UK
Kate Cavanagh
Affiliation:
School of Psychology, University of Sussex, UK
Heather Gage
Affiliation:
School of Biosciences & Medicine, University of Surrey, UK
Clio Berry
Affiliation:
Brighton & Sussex Medical School, University of Sussex, UK
Suzanne Neumann
Affiliation:
Research & Development Department, Sussex Partnership NHS Foundation Trust, UK
Cassie M Hazell
Affiliation:
Social Sciences Department, University of Westminster, UK
David Fowler
Affiliation:
School of Psychology, University of Sussex, UK; and Research & Development Department, Sussex Partnership NHS Foundation Trust, UK
Kathryn Greenwood
Affiliation:
School of Psychology, University of Sussex, UK; and Research & Development Department, Sussex Partnership NHS Foundation Trust, UK
Clara Strauss
Affiliation:
School of Psychology, University of Sussex, UK; and Research & Development Department, Sussex Partnership NHS Foundation Trust, UK
*
Correspondence: Mark Hayward. Email: [email protected]
Rights & Permissions [Opens in a new window]

Abstract

Background

Cognitive–behavioural therapy (CBT) is recommended for all patients with psychosis, but is offered to only a minority. This is attributable, in part, to the resource-intensive nature of CBT for psychosis. Responses have included the development of CBT for psychosis in brief and targeted formats, and its delivery by briefly trained therapists. This study explored a combination of these responses by investigating a brief, CBT-informed intervention targeted at distressing voices (the GiVE intervention) administered by a briefly trained workforce of assistant psychologists.

Aims

To explore the feasibility of conducting a randomised controlled trial to evaluate the clinical and cost-effectiveness of the GiVE intervention when delivered by assistant psychologists to patients with psychosis.

Method

This was a three-arm, feasibility, randomised controlled trial comparing the GiVE intervention, a supportive counselling intervention and treatment as usual, recruiting across two sites, with 1:1:1 allocation and blind post-treatment and follow-up assessments.

Results

Feasibility outcomes were favourable with regard to the recruitment and retention of participants and the adherence of assistant psychologists to therapy and supervision protocols. For the candidate primary outcomes, estimated effects were in favour of GiVE compared with supportive counselling and treatment as usual at post-treatment. At follow-up, estimated effects were in favour of supportive counselling compared with GiVE and treatment as usual, and GiVE compared with treatment as usual.

Conclusions

A definitive trial of the GiVE intervention, delivered by assistant psychologists, is feasible. Adaptations to the GiVE intervention and the design of any future trials may be necessary.

Type
Papers
Creative Commons
Creative Common License - CCCreative Common License - BY
This is an Open Access article, distributed under the terms of the Creative Commons Attribution licence (http://creativecommons.org/licenses/by/4.0/), which permits unrestricted re-use, distribution, and reproduction in any medium, provided the original work is properly cited.
Copyright
Copyright © The Author(s), 2021. Published by Cambridge University Press on behalf of the Royal College of Psychiatrists

Approximately 300 000 people in England and Wales have a diagnosis of psychosis.1 The overall annual cost of psychosis in England has been estimated at £11.8 billion.Reference Andrew, Knapp, McCrone, Parsonage and Trachtenberg2 Cognitive–behavioural therapy (CBT) for psychosis is recommended by the National Institute for Health and Care Excellence (NICE) for the treatment of psychosis,3 but is offered to only 26% of patients with psychosis.4 One reason for this lack of access is limited resources,Reference Ince, Haddock and Tai5 as CBT for psychosis is resource-intensive in its duration (minimum of 16 sessions recommended by NICE) and delivery (by highly trained therapists, typically CBT therapists or clinical psychologists), and NICE has recommended research to explore how resources could be reduced.3 Our response has been twofold: first, we conducted a meta-analysis suggesting that CBT for psychosis could effectively treat the symptoms of psychosis when offered in fewer than 16 sessions;Reference Hazell, Hayward, Cavanagh and Strauss6 and second, consistent with recent developments favouring the targeting of single psychosis symptoms,Reference Lincoln and Peters7 we developed a brief, CBT-informed intervention for distressing voice hearing experiences (‘Guided self-help CBT intervention for voices’, referred to as GiVE). GiVE is a structured and workbook-based interventionReference Hazell, Hayward, Strauss and Kingdon8 derived from our self-help book,Reference Hayward, Strauss and Kingdon9 and has the potential to be delivered by a cost-effective and widely available workforce of psychology graduates (assistant psychologists). We initially evaluated GiVE when delivered by clinical psychologists, with promising results.Reference Hazell, Hayward, Cavanagh, Jones and Strauss10 Our next step was to explore the efficacy of GiVE when delivered by assistant psychologists. Before seeking funding for a definitive randomised controlled trial (RCT), we needed to demonstrate the feasibility of engaging patients, clinicians, assistant psychologists and service managers in the delivery of such a trial. The aims of this feasibility study were to assess the acceptability of GiVE to clinicians and patients, and the ability of assistant psychologists to adhere to therapy and clinical supervision protocols. An estimate of the standard deviation of outcomes was also sought to facilitate a sample size calculation for use within a definitive trial.

Method

Study design

The published study protocolReference Hayward, Berry, Cameron, Arnold, Berry and Bremner11 is briefly described here. This was a feasibility RCT with a three-arm, parallel-group design and 1:1:1 allocation, comparing GiVE and treatment as usual (the study intervention) to supportive counselling and treatment as usual (the control intervention) to treatment as usual alone, recruiting across two sites, with blinded post-treatment and follow-up assessments. Clinical outcomes were assessed at baseline (pre-randomisation, time point 0), 16 weeks (post-intervention, time point 1) and 28 weeks (follow-up, time point 2; this assessment was only offered to participants who reached the 28-week post-randomisation milestone before the end of the data collection period). A mixed-methods process evaluation captured participants’, clinicians’ and assistant psychologists’ experiences of the study and the interventions, and their views on the facilitators and barriers to the implementation of GiVE within routine psychosis care pathways. Findings from the process evaluation will be reported in a separate paper. There were minimal changes to the design after trial commencement, and details are reported in the study protocol.Reference Hayward, Berry, Cameron, Arnold, Berry and Bremner11 The trial was registered with the ISRCTN registry (number 16166070) on 5 February 2019 (http://www.isrctn.com/ISRCTN16166070).

Participants

Participants were recruited over 12 months from community mental health teams and early intervention in psychosis services at two sites within the UK National Health Service (NHS): Sussex Partnership NHS Foundation Trust and Pennine Care NHS Foundation Trust. Inclusion criteria were: aged 16 years or older in contact with NHS mental health services and under the care of a consultant psychiatrist; experiencing current voice hearing (a score of 1 or more [‘At least once a day’] on item 1 [‘How frequently did you hear a voice or voices?’] of the Hamilton Program for Schizophrenia Voices Questionnaire; HPSVQ);Reference Hayward, Berry, Cameron, Arnold, Berry and Bremner11 distressed by hearing voices (operationalised by participants scoring at least 8 out of 16 on the negative voice impact scale of the HPSVQ);Reference Van Lieshout and Goldberg12 meeting DSM-5 research criteria for schizophrenia spectrum or other psychotic disorders (assessed by the Structured Clinical Interview for DSM-5 disordersReference First, Williams, Karg and Spitser13); and willing and able to provide written informed consent. Exclusion criteria were: established organic cause for distressing voices (e.g. brain disease or injury); primary diagnosis of substance misuse; currently detained in hospital under a section of the Mental Health Act; have completed a full course (minimum of 16 h) of CBT for psychosis during the past year; currently participating, or confirmed to participate, in another interventional study in which the participant is receiving an intervention that utilises psychological therapy; English speaking to the degree that the participant is unable to fully understand and answer assessment questions and give informed consent; severe intellectual disability (assessed with the Test of Premorbid Functioning – UK)Reference Wechsler14; and deemed to be at immediate and serious risk to self or others.

Procedure

Following a referral to the research team by a patient's clinician, a study research assistant contacted the potential participant to discuss the study and arrange a consent and eligibility meeting. A patient information sheet was given to the potential participant at least 24 h before the meeting. If participants consented to take part in the study, they completed a baseline (time point 0) assessment at a separate meeting.

The authors assert that all procedures contributing to this work comply with the ethical standards of the relevant national and institutional committees on human experimentation and with the Helsinki Declaration of 1975, as revised in 2008. All procedures involving patients were approved by an NHS Research Ethics Committee (London – Surrey, reference number 18/LO/ 2091). Written informed consent was obtained from all participants.

Intervention description

GiVE

The GiVE intervention was delivered by an assistant psychologist and followed a workbookReference Hazell, Hayward, Strauss and Kingdon8 that was based upon the Overcoming Distressing Voices self-help book.Reference Hayward, Strauss and Kingdon9 Participants were given a copy of both the workbook and the self-help book at the commencement of therapy, and asked to read both and complete the workbook with the support of the assistant psychologist in sessions. They also had the opportunity to access the ‘Choices’ mobile phone application, a publicly available app with interactive elements linked to the content of the self-help book. GiVE consists of three core modules: beliefs about the self, beliefs about voices and relationships with voices and others. There is also an introductory session on coping with voices and a final session to consolidate learning and identify next steps. Assistant psychologists delivered GiVE within eight 1-h sessions, over a maximum of 16 weeks.

Supportive counselling

The supportive counselling intervention followed the therapy protocol that was used by assistant psychologists in the full RCT of AVATAR therapy.Reference Craig, Rus-Calafell, Ward, Leff, Huckvale and Howarth15 It was delivered over the same number and duration of sessions as GiVE, with the aim of equalising the duration of total therapist contact time across both arms. Supportive counselling offered a supportive and non-judgemental space for the discussion of topics and issues determined by the participant. The supportive counselling therapy protocol contained specific guidance for the assistant psychologist on how to respond to participant disclosure of distressing voices in a manner that did not provide specific intervention strategies. The intervention was delivered within eight 1-h sessions, over a maximum of 16 weeks. The same assistant psychologists delivered GiVE and supportive counselling, to minimise therapist effects.

Treatment as usual

Treatment as usual was provided by the usual care team and typically included medication management and support and monitoring, with psychological therapies offered occasionally.

Training and supervision

Assistant psychologists received a 5-day training in GiVE and supportive counselling (1 introductory day, 2 days on GiVE and 2 days on supportive counselling), delivered by clinical psychologists with experience of CBT for psychosis and an experienced counselling psychologist, respectively. Weekly clinical supervision was provided by these clinical psychologists for the GiVE intervention, with a mixture of 1:1 and group supervision offered face to face or remotely. The counselling psychologist offered remote group supervision for the supportive counselling intervention on a weekly basis.

Treatment adherence

Therapeutic drift and contamination were minimised by the use of highly detailed therapy protocols and close supervision of the assistant psychologists by experienced psychologists. Adherence to therapy protocols was assessed through assistant psychologists completing a checklist at the conclusion of each session. The competence of assistant psychologist delivery of the interventions was assessed by the rating of a random selection of session recordings by independent experts. GiVE sessions were rated by a CBT expert, using the Cognitive Therapy Rating Scale for Psychosis.Reference Haddock, Devane, Bradshaw, McGovern, Tarrier and Kinderman16 Supportive counselling sessions were rated by a supportive counselling expert, using the Counselling Adherence Scale.Reference Hill, Aldridge, Coles, Docchar, Griffiths and Rowland17

Outcomes

Feasibility outcomes prespecified in the published study protocol were as follows: number of care coordinators willing to refer their patients, number (percentage) of referred patients found to be eligible, number (percentage) of consenting participants retained within the study who offer full data-sets, proportion of non-missing items for each variable, number (percentage) of consenting participants within the GiVE and supportive counselling arms who reach the point of therapy ‘exposure’ (attend at least six out of eight therapy sessions), and assistant psychologist adherence to therapy protocols and clinical supervision protocols.

For primary outcomes for a definitive trial, two candidate measures were used to assess voice-related distress at time points 0, 1 and 2: the five-item distress scale of the Psychotic Symptom Rating Scales (PSYRATS auditory hallucinations subscale)Reference Haddock, McCarron, Tarrier and Faragher18 (‘amount of negative voice content’, ‘degree of negative voice content’, ‘amount of distress’, ‘intensity of distress’ and ‘controllability of voices’) and the four-item negative voice impact scale of the HPSVQReference Hayward, Berry, Cameron, Arnold, Berry and Bremner11 (‘How bad are the things voices say to you?’, ‘How much do the voices interfere with your daily activities?’, ‘How distressing are the voices that you hear?’ and ‘How bad do the voices make you feel about yourself?’).

A range of secondary outcomes were assessed at time points 0, 1 and 2, and evaluated mental health problems commonly experienced by people with psychosis, including anxiety and depression (Hospital Anxiety and Depression ScaleReference Zigmund and Snaith19) and paranoia (Paranoid Thoughts ScaleReference Green, Freeman, Kuipers, Bebbington, Fowler and Dunn20); variables that have been associated with the impact of voice hearing, such as negative beliefs about the self (Self Scale of the Brief Core Schema Scale)Reference Fowler, Freeman, Smith, Kuipers, Bebbington and Bashworth21, negative beliefs about voices (Beliefs About Voices Questionnaire – RevisedReference Chadwick, Lees and Birchwood22) and negative relating to voices (Voice and YouReference Hayward, Denney, Vaughan and Fowler23) and other people (Persons Relating to Others QuestionnaireReference Birtchnell, Hammond, Horn, De Jong and Argyroula24); and a range of personal and social recovery-oriented outcomes (psychological recovery [CHOICE-SF],Reference Webb, Bartl, James, Skan, Peters and Jones25 the positive impact of voices [Voice Impact Scale] (Strauss C, personal communication, 2018), engagement in meaningful activity [Work and Social Adjustment Scale]Reference Mundt, Marks, Shear and Greist26 and social functioning [Social and Occupational Functioning Scale]Reference Rybarczyk, Kreutzer, DeLuca and Caplan27).

We assessed participants’ expectations for therapy following the commencement of the intervention between time point 0 and time point 1 (Therapy Credibility and Expectancy Questionnaire)Reference Devilly and Borkovec28 and the quality of the therapeutic relationships at time point 1 (Scale to Assess Therapeutic Relationships).Reference McGuire-Snieckus, McCabe, Catty, Hansson and Proebe29

Health economic outcomes were measured by the EQ-5D-5L,Reference Brooks30 the Client Service Receipt InventoryReference Thornicroft, Becker, Knapp, Knudsen, Schene and Tansella31 and the Short Form 12 Version 2.Reference Ware, Kosinki and Keller32

Sample size

Following recommendations for designing feasibility trials that aim to detect a small-to-medium (Cohen's d = 0.2–0.5) standardised effect size (where the definitive trial will be designed with 90% power and two-sided 5% significance), this study aimed to recruit 90 participants (30 per treatment arm).Reference Cohen33Reference Teare, Dimairo, Shepherd, Hayman, Whitehead and Walters36

Randomisation and blinding

Following the completion of the baseline assessment, participants were randomly allocated by the trial manager using the Sealed Envelope online service (https://www.sealedenvelope.com/), incorporating stratification by site (Sussex or Pennine) and type of service (community mental health team or early intervention in psychosis) by using random block lengths and 1:1:1 allocation. The online randomisation procedure was set up and tested by the trial statistician.

The research assistants were blind to the allocation sequence and remained so for all future assessments. Measures were put in place to maintain blinding, and ‘blind’ awareness and education was promoted throughout the study. The trial statistician was also blind to participant allocation throughout the analysis. Reported breaks in blinding were recorded. Outcome assessments were re-blinded by re-allocating blind research assistants to collect and score participant responses.

Statistical analysis

Participant characteristics, feasibility outcomes and baseline clinical outcomes were summarised with descriptive statistics such as count, mean, s.d., median, 25% and 75% quartiles, interquartile range, minimum and maximum. Analyses were of available cases, following the intention-to-treat principle. All clinical outcomes were summarised at time points 0, 1 and 2 for each treatment arm. Primary and secondary outcomes were modelled with linear mixed models (to allow for covariate adjustment), with random effects for individuals and fixed effects for treatment group (treatment as usual, GiVE and supportive counselling), time (time points 1 and 2) and the group×time interaction with the baseline score, site and service type entered as covariates. Contrasts were used for the following comparisons: GiVE versus treatment as usual, GiVE versus supportive counselling, and supportive counselling versus treatment as usual at time points 1 and 2. 95% and 75% confidence intervals for all estimates of unstandardised between-group effect sizes were calculated. For each contrast we were interested in whether the minimum clinically important difference (MCID) was contained in the confidence interval. The MCIDs are two points for the HPSVQ negative voice impact scale and three points for the PSYRATS distress scale. Standardised effect sizes (Cohen's d) were also calculated and interpreted as follows: 0.2 = small, 0.5 = medium and 0.8 = large effect.Reference Cohen33 As this was a feasibility study, P-values from the models are not reported. The level of missing data was summarised at each time point, but not treated. All analyses were conducted in Stata (version 16 for Mac).37

Adverse event reporting and harms

Any unfavourable and unintended sign, symptom or illness that developed or worsened during the period of the study was classified as an adverse event, whether or not it was considered to be related to the study treatment and was either expected or unexpected. Serious adverse events (SAEs) were those considered to be life-threatening. The number (events and individuals) and nature of all events (adverse events and SAEs) reported to blind and unblind members of the research team were recorded. All SAEs were reviewed for causality and expectedness by an independent rater and the sponsor's representative.

Impact of the COVID-19 pandemic

The onset of the pandemic in March 2020 required all assessments and therapy sessions to be delivered remotely by phone or video call. At time point 1, 21 out of 68 (31%) assessments were completed remotely. For time point 2, this figure was 15 out of 46 (33%) assessments. Regarding intervention delivery, 11 participants who were receiving sessions face to face at the onset of the pandemic were offered remote sessions (seven for GiVE and four for supportive counselling), and a further two participants (one for GiVE and one for supportive counselling) received all sessions remotely.

Results

Participant flow

A total of 151 patients were referred to the study over a 12-month period between 13 February 2019 and 24 February 2020. A total of 101 (66.9%) patients were screened, of whom 79 (78.2%) consented, completed a time point 0 assessment and were randomised as follows: 27 to treatment as usual, 26 to supportive counselling and 26 to GiVE. Time point 1 and time point 2 assessments were completed between July 2019 and July 2020. See Fig. 1 for CONSORT diagram illustrating the flow of participants through the study. The study was concluded as planned, on 30 August 2020. The final 6 months of the study were conducted during the COVID-19 pandemic.

Fig. 1 CONSORT flow diagram.

Participant characteristics

There were 45 (57%) male and 34 (43%) female participants, with a mean age of 40.1 years (s.d. 13.1, range 17–66) and, on average, had been hearing voices since the age of 22.0 years (s.d. 12.1, 0.1–61). Mean summary scores for the baseline candidate primary outcomes were 11.6 (s.d. 2.5) for the HPSVQ negative voice impact scale and 14.5 (s.d. 3.3) for the PSYRATS distress scale. All baseline participant characteristics and clinical outcomes are shown in Table 1.

Table 1 Baseline characteristics by treatment group

Data are count n (%), mean (s.d.) or n; mean (s.d.). Numbers in brackets after name of the measure is the range of possible values; clinical outcomes are normally distributed. HPSVQ, Hamilton Program for Schizophrenia Voices Questionnaire; PSYRATS, Psychotic Symptoms Rating Scale; HADS, Hospital Anxiety and Depression Scale; CHOICE-SF, Choice in Outcome in CBT for Psychoses, Short Form; * some percentage totals may add up to more than 100% due to rounding error.

Feasibility outcomes

Aim 1: to assess the acceptability to clinicians of the GiVE intervention delivered by assistant psychologists (will they refer patients to the study?)

Patients were referred to the study by 102 different clinicians (50 from the Pennine site and 52 from the Sussex site). Of the 101 patients who consented and were assessed for eligibility, 83 (82%, 95% CI 73.3–89.1%) were found to be eligible. The views of some of the referring clinicians were explored within the process evaluation and will be reported in a separate paper.

Aim 2: to assess the acceptability to patients of the GiVE intervention delivered by assistant psychologists (can patients be recruited and retained, and what are their experiences of the intervention?)

We randomised 79 (88%) of our target of 90 participants. Of those randomised, 68 (86%) participants completed time point 1 assessments and 46 (74%) participants who reached the 28-week post-randomisation milestone completed time point 2 assessments.

In terms of therapy exposure, 23 (88%) participants attended at least six sessions in the GiVE arm (the predetermined level of exposure), and this was the case for 19 (73%) participants in the supportive counselling arm. The experiences of some of the participants who received the GiVE and supportive counselling interventions were explored within the process evaluation and will be reported in a separate paper.

Aim 3: to assess the ability of assistant psychologists to adhere to the therapy and clinical supervision protocols

All attended sessions of GiVE were self-rated for adherence by assistant psychologists, using therapy checklists, and adherence was indicated for 83% of items. There was some variability by therapist (range 72–97%) and by session (range 70–88%). For supportive counselling, all but one attended session was rated by assistant psychologists and adherence was indicated for 95% of items. There was some variability in adherence by therapist (range 89–100%) and by session (range 92–97%).

With regard to assistant psychologist competence, the independent raters were external to the NHS organisations that were hosting the trial. Changes to the policies of the NHS organisations relating to the transfer of patient identifying information created complexities for the secure transfer of the audio recordings outside of these organisations. We were not able to overcome these complexities before the end of the trial. Additionally, during the COVID-19 pandemic it was not possible to record sessions delivered remotely because of home working. At the Sussex site, 58 GiVE sessions were recorded (out of a total of 185 sessions delivered; 31%) and 50 supportive counselling sessions were recorded (out of a total of 162 sessions delivered; 31%). Six audio recordings of randomly selected GiVE sessions (3%) from the Sussex site were independently rated with the Cognitive Therapy Rating Scale – Psychosis. The mean was 31.7 (s.d. 3.8) out of a maximum of 60. The mean score for general skills was 17.5 (s.d. 3.1) out of a maximum of 30. The mean score for technical skills was 14.2 (s.d. 2.1) out of a maximum of 30. The ratings revealed that although assistant psychologists demonstrated skills in general understanding and interpersonal skills, they were less able to link sessions though homework and feedback. Ratings were completed for five supportive counselling sessions (3%) using the Counselling Adherence Scale, and the mean was 17⋅8 (s.d. 2.4) out of a maximum of 28, which equates to moderate-to-good evidence of competence. To assess for drift between the interventions, the supportive counselling session recordings were assessed by the independent CBT rater against the session checklists for the GiVE intervention. For three of the recordings, the rater found ‘no evidence’ of items from the GiVE checklists. On the remaining two recordings, there was ‘negligible evidence’ of items from the GiVE checklists. These assessments suggest that any drift from the GiVE intervention to the supportive counselling intervention was minimal.

Adherence to clinical supervision protocols was assessed through the recording of attendance at weekly supervision sessions for each of the four assistant psychologists. Attendance rates were as follows: 89.0%, 91.6%, 96.4% and 98.0%.

Completeness of data

Items were mostly at least 90% complete, except for the Scale to Assess Therapeutic Relationships - Patient version (missing data was 79% owing to measures not being posted back by participants), the Therapy Credibility and Expectancy Questionnaire (missing data was 25%), the Short Form 12 Version 2 (missing data was 53% at time point 0, 92% at time point 1 and 100% at time point 2 [owing to administration errors]), and some of the sociodemographic characteristics.

Candidate primary outcomes

The descriptive summary for the candidate primary and selected secondary outcomes at time points 1 and 2 are shown in Table 2.

Table 2 Summary of candidate primary (HPSVQ & PSYRATS) and secondary clinical outcomes by group at time points 1 and 2

HPSVQ, Hamilton Program for Schizophrenia Voices Questionnaire; PSYRATS, Psychotic Symptoms Rating Scale; HADS, Hospital Anxiety and Depression Scale; CHOICE-SF, Choice in Outcome in CBT for Psychoses, Short Form.

Results from the intention-to-treat analyses of the candidate primary outcomes are shown in Table 3. Details regarding the secondary outcomes and the health economic outcomes are provided in the Supplementary material available at https://doi.org/10.1192/bjo.2021.983.

Table 3 Effect sizes for candidate primary outcomes by time point

Table provides results of pairwise comparisons of intervention [A] versus [B] at time point 1/time point 2. Effect estimates represent a difference in change for [A] compared with [B]: negative scores indicate that [A] has improved more and positive scores indicate that [B] has improved more. For Cohen's d calculations, HPSVQ s.d. = 2.46 and PSYRATS s.d. = 3.30. LCL, lower confidence limit; UCL, upper confidence limit; HPSVQ, Hamilton Program for Schizophrenia Voices Questionnaire; GiVE, guided self-help intervention for voices; TAU, treatment as usual; PSYRATS, Psychotic Symptoms Rating Scale.

a. Conventions for interpreting Cohen's d are as follows: 0.2 = small effect, 0.5 = medium effect and 0.8 = large effect.Reference Cohen33

All 95% confidence intervals included their respective outcome's MCID. For the candidate primary outcomes at time point 1, estimated effects were in favour of GiVE compared with both supportive counselling and treatment as usual. For these comparisons, Cohen's d standardised effect sizes ranged from medium to large. At time point 2 for HPSVQ negative voice impact: estimated effects were in favour of supportive counselling compared with both GiVE (small effect) and treatment as usual (small to medium effect); effects for GiVE were favourable compared with treatment as usual (small effect). For PSYRATS distress at time point 2: estimated effects were in favour of GiVE compared with both supportive counselling (negligible effect) and treatment as usual (medium effect); supportive counselling was favourable to treatment as usual (small to medium effect).

Breaks in blinding

One break in blinding was reported. In this instance, the assessment was completed by a blinded researcher who was not part of the research team.

Assessment of safety

SAEs were reported by 11 participants on a total of 16 occasions. The most frequently recorded SAE code was ‘suicidal ideation and intent to act’ (3). The SAEs were distributed evenly across the three arms. Independent assessment suggested that no SAEs were related to the trial or its procedures. Adverse events were reported by 20 participants on a total of 30 occasions. The most frequently recorded adverse event codes were ‘deterioration in mental health’ (n = 10), ‘general medical assessment/procedure’ (n = 8), ‘suicidal ideation’ (n = 6) and ‘self-harm’ (n = 4). The adverse events were evenly distributed across the three arms.

Discussion

This study has demonstrated that a definitive RCT of the GiVE intervention delivered by assistant psychologists to patients with psychosis is feasible. Clinicians were willing to refer their patients, the majority of participants completed interventions and were retained at follow-up, and assistant psychologists were adherent to therapy and supervision protocols. The interventions appeared to be safe and the MCIDs for the candidate primary outcomes were captured in the 95% confidence intervals for the between-group differences in the means at time point 1.

The favourable levels of referrals and recruitment suggest a willingness on behalf of clinicians and patients with psychosis to engage with a trial when the intervention is delivered by briefly trained assistant psychologists. Once randomised, participants demonstrated further willingness to engage in the study by attending therapy sessions and time point 1 assessments. The level of therapy exposure was highest for the participants receiving the GiVE intervention (88%), with an exposure rate higher than comparable trials where CBT for psychosis was delivered by highly trained therapists (e.g. 72%Reference Chadwick, Strauss, Jones, Kingdon, Ellet and Dannahy38). Attendance at time point 2 assessments was lower than at time point 1. Although noteworthy, attempts were made to engage only a subset of participants (as planned) in the time point 2 assessments, and the limited attendance may, in part, be attributable to the COVID-19 pandemic, which led to all assessments being conducted remotely during the final 6 months of data collection.

Willingness to engage with the trial was also required by the other important stakeholder group – the assistant psychologists. To our knowledge, no studies have previously explored the adherence of this workforce to therapy and supervision protocols when working with patients with psychosis. Consequently, rigorous assessment was required. Findings were encouraging, with each of the assistant psychologists attending most of the weekly clinical supervision sessions offered. Self-rated adherence to the therapy protocols was also high, but with variation across particular sessions indicating areas for additional training within a future trial. The rating of competence was restricted by the limited availability of session recordings as a result of information governance issues and the COVID-19 pandemic. The former issues will need to be addressed before a future trial. The available ratings suggested that assistant psychologists could achieve competence in the delivery of both GiVE and supportive counselling. However, the ratings for the GiVE intervention suggested some areas for improvement, including the linking of learning during and between sessions, which could be addressed in a future trial with specific training and supervision on this issue. The assessment of contamination between the interventions suggested that the assistant psychologists had been able to prevent the GiVE techniques from drifting into the supportive counselling sessions.

Findings were also encouraging with respect to the candidate primary outcomes. Medium-to-large estimated effects were found in favour of GiVE compared with both supportive counselling and treatment as usual at time point 1. The effect sizes were in line with prior expectations of detecting small-to-medium effects with some inflation owing to the small sample size. Although effects detected in small feasibility studies, such as this one, are likely to be imprecise and biased, the size and magnitude of our detected effects support further testing in a powered RCT. The findings at time point 2 were less clear as the estimated effects favoured supportive counselling compared with GiVE and treatment as usual with (negligible-small and medium effects, respectively). However, GiVE was still favourable compared with treatment as usual negligible-medium effects at time point 2. The findings at time point 2 were attributable, in part, to a reduction of benefits for GiVE during the follow-up period (from time point 1 to time point 2), and may indicate the need for the intervention to be extended and/or for the addition of booster sessions. This reduction in benefit for GiVE during the follow-up period also raises the question of the potential place of this intervention within a therapeutic pathway for patients with psychosis, e.g. as part of a modular pathway where other single-symptom interventions could build upon the learning generated by GiVE, or vice versa. A modular pathway for the psychological treatment of paranoia has recently been evaluated and generated encouraging findings, albeit with the interventions delivered by highly trained therapists.Reference Freeman, Emsley, Diamond, Collett, Bold and Chadwick39 The findings of increased benefits for supportive counselling during the follow-up period are similar to those reported by the recently completed RCT of AVATAR therapy.Reference Wechsler14 Those authors suggested that supportive counselling is a control condition with non-specific factors that, compared with treatment as usual, can be effective in its own right. This is a possibility that is worthy of further investigation.

This study has limitations in a number of respects. First, the follow-up data were available for only a subsample of the participants (as planned), thereby limiting the learning about the durability of benefits from the interventions. Second, the self-reported adherence ratings of the assistant psychologists were not assessed and would benefit from independent assessment within a future trial. Furthermore, the competence ratings of the assistant psychologists were limited to a small selection of session recordings. Further learning about the competence of assistant psychologists within a future trial will be crucial, and any barriers to the rating of competence must be addressed a priori. Finally, the findings may have been influenced by the COVID-19 pandemic. Some of the therapy sessions and assessments were conducted remotely during the final 6 months of the study, but any impact of remote delivery and/or the more general impact of the pandemic upon participants could not be established because of the small sample size.

The main implication of this trial is that a definitive RCT is feasible and is now required to provide evidence regarding the efficacy of a brief, CBT-informed intervention for distressing voices when delivered to patients with psychosis by assistant psychologists. If found to be efficacious in future trials, CBT for psychosis offered in these less resource-intensive forms has the potential to generate benefits for individual patients (reduced distress and enhanced recovery), service-level patient benefits (increased access to evidence-based psychological therapies) and economic benefits to the NHS (in terms of the reduced use of high-impact mental health services).

Supplementary material

Supplementary material is available online at https://doi.org/10.1192/bjo.2021.983

Data availability

The data that support the findings of this study are available from the corresponding author, M.H., upon reasonable request.

Acknowledgements

We are grateful to the participants who helped us to learn from their experiences. We also thank the researchers who worked tirelessly to maximise our learning: Ben Cameron, Sophie Green, Emogen Campbell, Sacha Stone, Debra Sheffield, Maisha Murshed, Peter Garwood, Jake Ellwood and Kate Arnold.

Author contributions

The study was designed by M.H., K.B., S.B., K.C., D.F., H.G., S.R., C.S., K.G., C.H. and A.-M.J. Data collection involved C.B. and S.N. Analysis and interpretation was led by S.B. and A.-M.J. The manuscript was drafted by M.H., with significant contributions from S.B., A.-M.J. and C.S. All of the authors were involved with revising and finalising the manuscript.

Funding

This paper presents independent research funded by the National Institute for Health Research (NIHR) under its Research for Patient Benefit programme (grant reference number PB-PG-0317-20029). The views expressed are those of the authors and not necessarily those of the NIHR or the Department of Health and Social Care.

Declaration of interest

M.H., C.H. and C.S. are authors of the self-help book and the companion workbook that was used to assist the delivery of the GiVE intervention within this study. Each author receives a small royalty for each copy of the book and companion workbook that is sold.

References

Royal College of Psychiatrists. Report of the Second Round of the National Audit of Schizophrenia (NAS). Healthcare Quality Improvement Partnership and Royal College of Psychiatrists, 2014 (https://www.rcpsych.ac.uk/docs/default-source/improving-care/ccqi/national-clinical-audits/ncap-library/national-audit-of-schizophrenia-document-library/nas_round-2-report.pdf?sfvrsn=6356a4b0_4)Google Scholar
Andrew, A, Knapp, M, McCrone, P, Parsonage, M, Trachtenberg, M. Effective Interventions in Schizophrenia the Economic Case: A Report Prepared for the Schizophrenia Commission. Rethink Mental Illness, 2012 (https://www.researchgate.net/publication/308378475_Effective_interventions_in_schizophrenia_the_economic_case).Google Scholar
National Institute for Health and Care Excellence. Psychosis and Schizophrenia in Adults: Treatment and Management (CG178). National Institute for Health and Care Excellence, 2014 (https://www.nice.org.uk/guidance/cg178/evidence/full-guideline-490503565).Google Scholar
The Royal College of Psychiatrists. National Clinical Audit of Psychosis – National Report for the Core Audit. Healthcare Quality Improvement Partnership, 2018 (https://www.rcpsych.ac.uk/docs/default-source/improving-care/ccqi/national-clinical-audits/ncap-library/ncap-national-report-for-core-audit-2018.pdf?sfvrsn=23c6a262_4).Google Scholar
Ince, P, Haddock, G, Tai, S. A systematic review of the implementation of recommended psychological interventions for schizophrenia: rates, barriers, and improvement strategies. Psychol Psychother 2016; 89: 324–50.CrossRefGoogle ScholarPubMed
Hazell, C, Hayward, M, Cavanagh, K, Strauss, C. A systematic review and meta-analysis of low intensity CBT for psychosis. Clin Psychol Rev 2016; 45: 183–92.CrossRefGoogle ScholarPubMed
Lincoln, TM, Peters, E. A systematic review and discussion of symptom specific cognitive behavioural approaches to delusions and hallucinations. Schizophr Res 2018; 203: 6679.CrossRefGoogle ScholarPubMed
Hazell, C, Hayward, M, Strauss, C, Kingdon, D. An Introduction to Self-Help for Distressing Voices. Robinson, 2018.Google Scholar
Hayward, M, Strauss, C, Kingdon, D. Overcoming Distressing Voices (2nd edn). Constable & Robinson, 2018.Google Scholar
Hazell, C, Hayward, M, Cavanagh, K, Jones, A-M, Strauss, C. Guided self-help cognitive-behaviour intervention for voices (GiVE): results from a pilot randomised controlled trial. Schizophr Res 2017; 195: 441–7.CrossRefGoogle ScholarPubMed
Hayward, M, Berry, C, Cameron, B, Arnold, K, Berry, K, Bremner, S, et al. Increasing access to CBT for psychosis patients: a feasibility, randomised controlled trial evaluating brief, targeted CBT for distressing voices delivered by assistant psychologists (GiVE2). Trials 2020; 21: 302.CrossRefGoogle Scholar
Van Lieshout, RJ, Goldberg, JO. Quantifying self-reports of auditory verbal hallucinations in person with psychosis. Can J Behav Sci 2007; 39: 73–7.CrossRefGoogle Scholar
First, MB, Williams, JBW, Karg, RS, Spitser, RL. Structured Clinical Interview for DSM-5 Disorders (SCID-5). American Psychiatric Association, 2016.Google Scholar
Wechsler, D. The Test of Premorbid Functioning (TOPF). The Psychological Corporation, 2011.Google Scholar
Craig, TKJ, Rus-Calafell, M, Ward, T, Leff, JP, Huckvale, M, Howarth, E, et al. AVATAR therapy for auditory verbal hallucinations in psychosis patients: a single-blind randomized controlled trial. Lancet Psychiatry 2018; 5: 3140.CrossRefGoogle Scholar
Haddock, G, Devane, S, Bradshaw, T, McGovern, J, Tarrier, N, Kinderman, P, et al. An investigation into the psychometric properties of the Cognitive Therapy Scale for Psychosis (CTS-Psy). Behav Cogn Psychother 2001; 29: 221–34.CrossRefGoogle Scholar
Hill, A, Aldridge, S, Coles, H, Docchar, C, Griffiths, A, Rowland, N. Manual for the selection, training and supervision of counsellors in the IAPT programme. British Association for Counselling and Psychotherapy, no date (https://www.bacp.co.uk/media/5751/iapt-pce-cfd-national-curriculum.pdf).Google Scholar
Haddock, G, McCarron, J, Tarrier, N, Faragher, EB. Scales to measure dimensions of hallucinations and delusions: the Psychotic Symptom Rating Scales (PSYRATS). Psychol Med 1999; 29: 879–89.CrossRefGoogle Scholar
Zigmund, AS, Snaith, RP. The Hospital Anxiety and Depression Scale. Acta Psychiat Scand 1983; 67: 361–70.CrossRefGoogle Scholar
Green, C, Freeman, D, Kuipers, E, Bebbington, P, Fowler, D, Dunn, G, et al. Measuring ideas of persecution and reference: the Green et al Paranoid Thought Scales (G-PTS). Psychol Med 2008; 38: 101–11.CrossRefGoogle Scholar
Fowler, D, Freeman, D, Smith, B, Kuipers, E, Bebbington, P, Bashworth, H, et al. The Brief Core Schema Scale (BCSS): psychometric properties and associations with paranoia and grandiosity in non-clinical and psychosis samples. Psychol Med 2006; 36: 749–59.CrossRefGoogle ScholarPubMed
Chadwick, P, Lees, S, Birchwood, M. The revised Beliefs About Voices Questionnaire (BAVQ-R). Brit J Psychiatr 2000; 177: 229–32.CrossRefGoogle Scholar
Hayward, M, Denney, J, Vaughan, S, Fowler, D. The Voice and You: development and psychometric evaluation of a measure of relationships with voices. Clin Psychol Psychother 2008; 15: 4552.CrossRefGoogle ScholarPubMed
Birtchnell, J, Hammond, S, Horn, E, De Jong, C, Argyroula, K. A cross national comparison of a shorter version of the Person's Relating to Others Questionnaire. Clin Psychol Psychother 2013; 20: 3648.CrossRefGoogle ScholarPubMed
Webb, R, Bartl, G, James, B, Skan, R, Peters, E, Jones, A-M, et al. Exploring the development, validity and utility of the short form version of the Choice of Outcome in CBT for Psychoses (CHOICE-SF): a patient reported outcome measure of psychological recovery. Schizophr Bull 2021; 47(3): 653–61.CrossRefGoogle ScholarPubMed
Mundt, JC, Marks, IM, Shear, MK, Greist, JM. The Work and Social Adjustment Scale: a simple measure of impairment in functioning. Br J Psychiatr 2002; 180: 461–4.CrossRefGoogle ScholarPubMed
Rybarczyk, B. Social and Occupational Functioning Assessment Scale (SOFAS). In Encyclopedia of Clinical Neuropsychology 1st ed. (eds Kreutzer, JS, DeLuca, J, Caplan, B): 2313. Springer, 2011.Google Scholar
Devilly, GJ, Borkovec, TD. Psychometric properties of the credibility/expectancy questionnaire. J Behav Ther Exp Psychiatry 2000; 31: 7386.CrossRefGoogle ScholarPubMed
McGuire-Snieckus, R, McCabe, R, Catty, J, Hansson, L, Proebe, S. A new scale to assess the therapeutic relationship in community mental health care: STAR. Psychol Med 2007; 37: 8595.CrossRefGoogle ScholarPubMed
Brooks, R. EuroQol: the current state of play. Health Policy 1996; 37: 5372.CrossRefGoogle ScholarPubMed
Thornicroft, G, Becker, T, Knapp, M, Knudsen, HC, Schene, A, Tansella, M, et al. International Outcome Measures in Mental Health. RCPsych Publications, 2006.Google Scholar
Ware, JE, Kosinki, M, Keller, SD. SF-12: How to Score the SF-12 Physical and Mental Health Summary Scales. The Health Institute, New England Medical Centre, 1995 (https://www.researchgate.net/publication/242636950_SF-12_How_to_Score_the_SF-12_Physical_and_Mental_Health_Summary_Scales).Google Scholar
Cohen, J. A power primer. Psychol Bull 1992; 112: 155–9.CrossRefGoogle Scholar
Whitehead, AL, Julious, SA, Cooper, CL, Campbell, MJ. Estimating a sample size for a pilot randomised trial to minimise the overall trial sample size for the external pilot and the main trial for continuous outcome variable. Stat Methods Med Res 2016; 25: 1057–73.CrossRefGoogle ScholarPubMed
Sim, J, Lewis, M. The size of a pilot study for a clinical trial should be calculated in relation to considerations of precision and efficiency. J Clin Epidemiol 2012; 65: 301–8.CrossRefGoogle ScholarPubMed
Teare, MD, Dimairo, M, Shepherd, N, Hayman, A, Whitehead, A, Walters, SJ. Sample size requirements to estimate key design parameters from external pilot randomised controlled trials: a simulation study. Trials 2014; 15: 264.CrossRefGoogle ScholarPubMed
StataCorp. Stata Statistical Software: Release 16. StataCorp, 2019 (https://www.stata.com/).Google Scholar
Chadwick, P, Strauss, C, Jones, A-M, Kingdon, D, Ellet, L, Dannahy, L, et al. Group mindfulness-based intervention for distressing voices: a pragmatic randomized controlled trial. Schizophr Res 2016; 175: 168–73.CrossRefGoogle Scholar
Freeman, D, Emsley, R, Diamond, R, Collett, N, Bold, E, Chadwick, E, et al. Comparison of a theoretically driven cognitive therapy (the Feeling Safe Programme) with befriending for the treatment of persistent persecutory delusions: a parallel, single-blind, randomised controlled trial. Lancet Psychiat 2021; 8: 696707.CrossRefGoogle ScholarPubMed
Figure 0

Fig. 1 CONSORT flow diagram.

Figure 1

Table 1 Baseline characteristics by treatment group

Figure 2

Table 2 Summary of candidate primary (HPSVQ & PSYRATS) and secondary clinical outcomes by group at time points 1 and 2

Figure 3

Table 3 Effect sizes for candidate primary outcomes by time point

Supplementary material: File

Hayward et al. supplementary material

Hayward et al. supplementary material 1

Download Hayward et al. supplementary material(File)
File 190.1 KB
Supplementary material: File

Hayward et al. supplementary material

Hayward et al. supplementary material 2

Download Hayward et al. supplementary material(File)
File 73.5 KB
Submit a response

eLetters

No eLetters have been published for this article.