Empirical testing is essential for rigorous complex intervention evaluation and for further refinement of the underpinning theoretical framework. Reference Campbell, Fitzpatrick, Haines, Kinmonth, Sandercock and Spiegelhalter1,Reference Michie and Prestwich2 The cognitive interpersonal maintenance model of eating disorders Reference Schmidt and Treasure3 provides a theoretical basis for carer interventions. Carers' expressed emotion Reference Hooley4 (e.g. emotional over-involvement, criticism and hostility) and enabling and accommodating behaviours Reference Sepulveda, Kyriacou and Treasure5,Reference Treasure, Sepulveda, Macdonald, Whitaker, Lopez and Zabala6 are proposed to maintain the illness. The model, which can be applied trans-diagnostically, describes a causal chain whereby high levels of carer unmet needs Reference Winn, Perkins, Murray, Murphy and Schmidt7-Reference Haigh and Treasure9 and a reduced ability to cope contribute to carers' high expressed emotion and ineffective strategies in managing symptoms. These responses cause distress in carers Reference Kyriacou, Treasure and Schmidt10,Reference Zabala, Macdonald and Treasure11 and allow eating disorder symptoms to flourish. Expert Carers Helping Others (ECHO), a self-help intervention for carers, targets these proposed interpersonal maintaining factors. Expert Carers Helping Others can be supplemented with telephone coaching sessions using the principles of motivational interviewing, a client-centred therapeutic tool employed to elicit behaviour change. Reference Rollnick and Miller12 Preliminary studies found that the intervention improved carer well-being. Reference Sepulveda, Lopez, Macdonald and Treasure13,Reference Sepulveda, Lopez, Todd, Whitaker and Treasure14
Hypotheses to be tested in this study were:
-
(a) ECHO will reduce the level of carer distress;
-
(b) ECHO will produce positive changes in secondary outcomes of caregiving self-efficacy and burden, well-being, expressed emotion, accommodation and enabling behaviour;
-
(c) at post-intervention, carers will report an increase in level of functioning in the individuals with an eating disorder for whom they care;
-
(d) changes in maintaining factors (expressed emotion, self-efficacy, accommodating and enabling) will mediate intervention effects on carer distress and perceived eating disorder symptoms;
-
(e) ECHO will have a greater effect on those for whom the intervention is most relevant (i.e. those with high levels of expressed emotion and accommodating and enabling behaviour, low levels of self-efficacy); it is also predicted that living situation, amount of face-to-face contact, and duration of illness will moderate the intervention effect;
-
(f) telephone coaching using motivational interviewing will enhance effects of ECHO.
Method
Participants
Participants were a community sample of carers recruited from the UK between September 2006 and February 2009. The definition of ‘carer’ used is that of the Princess Royal Trust for Carers (UK Charity) (www.carers.org) and includes partners, siblings and other relatives or friends who provide unpaid help and support. Inclusion criteria required individuals to be fluent in English. Written informed consent was obtained for all participants.
Ethical approval was from King's College London. Recruitment was conducted via posters and fliers in clinics and on our website, www.eatingresearch.com.
Design and procedure
All carers were first assessed once consent had been obtained (baseline time point), at which point they waited for 6 weeks (n = 119) (matching the 6-week duration of the intervention) before they were assessed for a second time (pre-intervention time point). The waiting period allowed us to examine the stability of the caregiving experience over a time period equivalent to the intervention period. Owing to limited resources, this waiting period was reduced to 2 weeks for a final subset of participants (n = 34). After the second assessment, carers were randomised to receive self-help only (ECHO) or guided self-help (ECHOc). Post-intervention assessment data were collected at 6 weeks (post-intervention time point) and at 3 months post-intervention (follow-up time point). All assessments were collected by postal questionnaires; consequently, assessor masking was not necessary.
Intervention
All carers received written material (a book) Reference Treasure, Smith and Crane15 and five DVDs (three theoretical; two practical skills) via the post after the second assessment.
Both ECHO and ECHOc include many behaviour change strategies defined according to the published taxonomy, Reference Michie, Abraham, Whittington, McAteer and Gupta16 including: providing information on the behaviour-health link; identification of barriers to change; general encouragement; graded tasks; behavioural goals and contracts; modelling; prompts and cues; self-talk; and stress management skills.
Carers allocated to ECHOc received an additional three telephone coaching sessions approximately 40 min in duration (plus an introductory telephone call lasting 15-20 min). The majority of sessions were delivered by two coaches (a non-professional who had been a carer herself and a senior clinical nurse who specialised in eating disorders). The third coach was a clinical psychologist. The coaches were trained in motivational interviewing Reference Rollnick, Kinnersley and Stott17 and used this to target the behaviour change goals in ECHO. Weekly supervision was available.
Measures
The primary outcome (carer distress) and key factors within the maintenance model, i.e. expressed emotion and level of functioning of the individual with the eating disorder (reported by carer) were measured at four time points: baseline, pre-intervention, post-intervention, and 3-month follow-up. Assessments for other secondary outcomes were collected at baseline, pre- and post-intervention (not follow-up).
-
1 Hospital Anxiety and Depression Scale (HADS) Reference Zigmond and Snaith18 is a 14-item self-report measure assessing presence and severity of anxiety and depression over the previous week. Scores are calculated on a 4-point Likert scale. The scale shows high internal reliability in this sample (α = 0.9 across time points).
-
2 The General Health Questionnaire (GHQ) Reference Goldberg19 is a 12-item measure assessing general well-being over the previous few weeks using a 4-point Likert scale (α = 0.9).
-
3 The Experience of Caregiving Inventory (ECI) Reference Szmukler, Burgess, Herrmann, Benson, Colusa and Bloch20 is a 66-item measure that assesses levels of caregiving burden in carers. Items explore both positive and negative aspects of caring using a 5-point Likert scale (α = 0.7-0.9).
-
4 The Eating Disorder Symptom Impact Scale (EDSIS) Reference Sepulveda, Whitney, Hankins and Treasure21 is a 24-item scale that measures caregiving burden related to symptoms specific to the eating disorder using a 5-point Likert scale (α = 0.9).
-
5 The Family Questionnaire (FQ) Reference Wiedemann, Rayki, Feinstein and Hahlweg22 is a 20-item self-report measure exploring levels of expressed emotion in carers. Scores are given on a 4-point Likert scale (α = 0.8-0.9).
-
6 The Revised Scale for Caregiving Self-Efficacy (CSE) Reference Steffen, McKibbin, Zeiss, Gallagher-Thompson and Bandura23 is a 15-item self-report measure that measures caregiving self-efficacy. Scores are marked on a Likert scale ranging from 1 through to 100 in increments of 10 (α = 0.8-0.9).
-
7 The Accommodation and Enabling Scale for Eating Disorders (AESED) Reference Sepulveda, Kyriacou and Treasure5 is a 33-item self-report measure using a 5-point Likert scale assessing caregiver behaviours that may serve to accommodate the eating disorder (α = 0.9).
-
8 Global Eating Disorder Functioning (GEDF). Adapted for carers from the Global Assessment of Functioning scale. Reference Endicott, Spitzer, Fleiss and Cohen24 Carers are asked to assess the general behavioural functioning of their loved one on a hypothetical continuum of ten equal-point intervals (range 1-100, where 100 is the least impaired).
-
9 Eating Behaviours (EatBeh). Carers were asked to mark which behaviours they could identify in their loved one at that time: severely underweight, restricting food intake, exercising excessively, vomiting after meals, missing menstrual periods for 3 months or more, eating unusually large amounts of food in one sitting (binge eating), eating in secret, stealing food/money in order to binge, severely overweight or other behaviours. A variable was calculated to reflect the number of eating behaviours that an individual presented by summing the number of items endorsed.
-
10 Acceptability of intervention. Carers were asked to rate the proportion of DVDs watched on a visual analogue scale (0 = none, 10 = all) and how helpful they found the intervention for key areas (communication with their loved one, reactions to the eating disorder, own stress levels) (score 0-10).
Sample size
In a pilot study (self-help only), we found a change in carer distress between pre- and post-ECHO intervention corresponding to an effect size of 0.26. To detect this difference with 80% power using a paired-samples t-test at a 0.05 significance level we estimated that a sample of n = 119 would be needed. Therefore, we aimed to recruit 143 carers to account for a drop-out rate of 20%.
Randomisation
Randomisation was conducted by a member of the research team, masked to the algorithm, using a random number generator List Randomiser that can be found on www.random.org. Carers were randomised in groups of four to five individuals using block randomisation. Group allocations were kept on a password protected secure electronic database and each carer was marked according to allocation. Carers were informed of group allocation by post.
Statistical analysis
The main analysis assessed the effect of ECHO on the primary outcome: carers' anxiety and depression (HADS). The secondary outcomes were observed patient measures of the global level of functioning and eating behaviours, both reported by the carer (GEDF and EatBeh), expressed emotion (FQ), well-being (GHQ), caregiving burden (ECI and EDSIS), accommodation and enabling of symptoms (AESED) and caregiving self-efficacy (CSE) of the carer. Only one carer per family was included in the analysis.
A linear mixed model was used to look for any significant changes in outcome scores from pre-intervention to post-intervention with or without coaching. The outcome data at pre- and post-intervention formed the dependent variable. The independent variables are ‘baseline data’, a ‘time’ variable and a ‘coaching’ variable. The time variable takes the value of 0 at pre-intervention and 1 for scores at post-intervention. The coaching variable takes the value of 1 at post-intervention for the coaching group and 0 otherwise. Therefore, the time variable represents the effect of ECHO, that is, the difference in outcome between pre- and post-intervention time points for those receiving ECHO. The coaching variable measures any incremental effect due to coaching. Random intercepts for individuals were included in the model to take account of the variance in the data that is due to individual differences. The model assumes that change between pre- and post-intervention can be attributed to the intervention and not to any other temporally varying variable.
Variables with an additional follow-up time point
The model was extended for outcomes available at 3-month follow-up (HADS, FQ and GEDF) and the dependent variable was then formed of the outcomes at pre-, post-intervention, and 3-month follow-up. An additional explanatory variable to explain the changes between post-intervention and follow-up in the ECHO group, and another covariate to explain the potential additional benefit in the ECHOc group at follow-up were added.
The number of missing values in our data varied for different outcomes. Therefore, for each outcome, we separately display the number of individuals with measurements and the total number of observations in the following results section. Observations for some individuals are not available for all time points. We assume that any missing data are missing at random. We fitted the mixed models using the maximum likelihood method, which provides estimates that are valid under the missing-at-random assumption.
Exploratory moderation and mediation analysis of the change over the intervention period
To assess whether the change in outcome between pre- and post-intervention times depended on variables at pre-intervention, we
extended the linear mixed model described above (excluding the follow-up time point) to contain a main effect of the hypothesised moderating variable at pre-intervention, an interaction of time and moderator variable and an interaction for coaching and moderator variable. The existence of moderating effects can be assessed by looking at the estimated interactions.
We referred to the criteria outlined by Baron & Kenny Reference Baron and Kenny25 for our mediation analyses. We assumed the absence of unobserved confounders in our analysis. A variable is a partial mediator of the effect of intervention (time) on outcome, if time significantly accounts for variations in the mediator variable and, additionally, if variations in the mediator variable significantly account for variations in outcome. Furthermore, the relation between time and outcome is less strong when both the mediator and time are included in the model, as the mediator explains part of the relationship between the other two variables.
Analyses were carried out in Stata 10 for Windows.
Results
The flow of participants is shown in the CONSORT diagram (Fig. 1). A similar number of participants in both intervention arms failed to complete the post-intervention and follow-up assessments.
Clinical and demographic data
Clinical and demographic features in ECHO and ECHOc at the second assessment are shown in Table 1. Table 2 displays
Demographic | ECHO (n = 80) | ECHOc (n = 73) |
---|---|---|
Carer's age, years: mean (s.d.) | 50.5 (6.9) | 48.7 (9.1) |
Carer's gender, n: F:M | 74:6 | 62:11 |
Carer's employment status, n | ||
Full/part time | 59 | 47 |
Unemployed/retired/housewife/-husband | 14 | 17 |
Sick leave | 2 | 7 |
Carers’ marital status, n | ||
Married/living together/civil partner | 61 | 66 |
Divorced/separated/widowed | 16 | 6 |
Single | 3 | 1 |
Relationship to patient, n | ||
Parent, mother:father | 72:3 | 58:6 |
Spouse/partner | 3 | 5 |
Child | 0 | 2 |
Other (e.g. friend, aunt, sibling) | 2 | 2 |
Patient's gender, n: F:M | 76:4 | 70:3 |
Patient's age, years: mean (s.d.) | 20.8 (6.9) | 20.9 (6.8) |
Patient's diagnosis, n | ||
Anorexia nervosa | 63 | 59 |
Bulimia nervosa | 7 | 5 |
Eating disorder NOS | 4 (+2)b | 1 (+1)b |
Current treatment, n | ||
In-patient/day patient | 20 | 13 |
Out-patient | 42 | 48 |
None | 23 | 16 |
Duration of illness, years: median (IQR) | 3 (7) | 4 (7) |
Ever admitted to hospital, n | ||
Yes | 43 | 34 |
No | 35 | 38 |
Times admitted to hospital, median (IQR) | 1 (1) | 0 (1) |
Length of time spent in hospital, months: median (IQR) | 1 (15) | 0 (8.3) |
Length of time in past 6 months, weeks: median (IQR) | 0 (3.5) | 0 (0.3) |
Currently receiving family therapy, yes | 24 | 19 |
Carer currently attending a carer support group, yes | 22 | 19 |
Currently living with relative, n | ||
Yes | 63 | 54 |
No | 15 | 16 |
Face-to-face contact, hours per week | ||
<21 | 30 | 29 |
>21 | 48 | 41 |
Other contact (e.g. telephone), hours per week | ||
<21 | 63 | 55 |
>21 | 1 | 6 |
ECHO, Expert Carers Helping Others self-help only intervention; ECHOc, Expert Carers Helping Others guided self-help intervention; NOS, not otherwise specified; IQR, interquartile range.
a Not all questions were answered by all carers.
b Carers did not feel confident to provide a diagnosis.
pre- and post-intervention values of primary and secondary outcomes. Change scores over the waiting period were calculated for HADS (mean –0.7, s.d. = 5.9), FQ (mean –0.5, s.d. = 6.2), AESED (mean –2.2, s.d. = 13.6), EDSIS (mean –4.9, s.d. = 11.1), CSE (mean 0.3, s.d. = 13.5), GHQ (mean –0.9, s.d. = 5.7), ECI negative (mean –7.5, s.d. = 22.6), ECI positive (mean –0.9, s.d. = 6.7), GEDF (mean 2.3, s.d. = 11.9) and EatBeh (mean –0.4, s.d. = 1.1).
Main effects
The main effects of ECHO at the post-intervention time point are displayed in Table 3. There were no significant effects for coaching over and above intervention alone (except for GEDF and EatBeh, discussed below), therefore coaching effects are not shown. Analyses were conducted with and without the 34 people who received the 2-week waiting period (compared with the 6-week period) and the results were similar; therefore, data for the total sample are shown.
Change in carer anxiety and depression over time
The HADS score was reduced at post-intervention in both groups. The intervention effect was maintained at follow-up (estimated reduction: –4.8, P<0.001; 95% CI –6.3 to –3.4).
For total HADS scores, 33% of carers scored outside of range (two standard deviations from the norm mean) Reference Crawford, Henry, Crombie and Taylor27 at pre-intervention, 22% scored outside of this range at post-intervention, and 17% at 3-month follow-up. These results, therefore, are of clinical significance for this population.
Change in secondary outcomes
Carers benefit from the intervention for almost all of the secondary outcomes. The FQ scores decreased significantly at post-intervention and decreased further at follow-up (estimated reduction at 3-month follow-up: –4.3, P<0.001; 95% CI –6.2 to –2.4). The AESED scores were significantly reduced and CSE improved at post-intervention. Scores for GHQ, ECI and EDSIS also fell. There were no significant changes in positive aspects of ECI. Telephone coaching had no significant additional benefit on carer outcomes (FQ: P = 0.9; GHQ: P = 0.3; AESED: P = 0.2; CSE: P = 0.5; ECI negative: P = 0.9; EDSIS: P = 0.3; ECI positive: P = 0.1).
Carers reported an increase in GEDF scores and this effect is further increased at 3-month follow-up (estimated increase 6.8, P<0.001; 95% CI 3.8 to 9.8). Unexpectedly, this effect at follow-up was significantly greater in the standard ECHO group compared with the ECHOc group (estimated difference –5.7, P = 0.007; 95% CI –9.8 to –1.6). Also, carers in the ECHOc group reported a smaller reduction in EatBeh at post-intervention (estimated difference 0.6, P = 0.01; 95% CI 0.1 to 1.0).
Acceptability
Descriptive data are presented in Table 4. Carers in the ECHOc group watched a greater proportion of the DVDs than carers in the ECHO group (P = 0.02). Carers in the ECHOc group also found the information more useful for the development of their communication skills (P = 0.04). Groups did not differ on other ratings.
Exploratory mediation analyses
Mediating role of improvements in proposed maintaining factors on carer distress
The intervention successfully reduced carers' HADS and also the factors thought to contribute to carer distress (i.e. FQ, AESED, CSE). Hence, we tested whether the intervention benefits carers' distress through its effects on proposed maintaining factors.
A model of anxiety and depression explained by the covariates, baseline HADS, time and coaching was compared with three models that additionally included the putative mediating variables. In each case, the estimated intervention effect lost significance on addition of the mediating variable. Change scores for FQ
ECHO, mean (s.d.) | ECHOc, mean (s.d.) | ||||
---|---|---|---|---|---|
Pre-intervention | Post-intervention | Pre-intervention | Post-intervention | ||
Hospital Anxiety and Depression Scale | 18.9 (9.0) | 15.6 (8.7) | 19.0 (8.1) | 15.1 (7.2) | |
Family Questionnaire | 51.5 (9.5) | 48.8 (10.2) | 50.8 (9.3) | 47.4 (9.9) | |
Accommodation and Enabling Scale for Eating Disorders | 47.4 (23.7) | 40.7 (25.4) | 45.2 (22.8) | 40.4 (21.7) | |
Eating Disorder Symptom Impact Scale | 37.7 (18.1) | 32.6 (17.3) | 40.1 (18.6) | 33.3 (19.1) | |
Caregiving Self-Efficacy | 63.8 (22.4) | 70.5 (20.1) | 64.2 (19.3) | 73.3 (17.0) | |
General Health Questionnaire | 17.5 (7.1) | 15.0 (7.4) | 18.7 (7.6) | 14.5 (5.9) | |
Experience of Caregiving Inventory – negative | 95.2 (38.3) | 81.0 (39.2) | 96.3 (39.4) | 81.3 (32.6) | |
Experience of Caregiving Inventory – positive | 28.7 (6.9) | 29.7 (8.7) | 27.0 (8.9) | 30.2 (9.6) | |
Global Eating Disorder Functioning | 56.7 (14.7) | 59.5 (15.1) | 57.8 (13.6) | 58.9 (15.8) | |
Eating Behaviours | 3.3 (1.5) | 2.5 (1.4) | 3.2 (1.3) | 3.0 (1.6) |
ECHO, Expert Carers Helping Others self-help only intervention; ECHOc, Expert Carers Helping Others guided self-help intervention.
Estimate (95% CI) | P | |
---|---|---|
Primary outcomes: carer | ||
Total HADS (n = 149, obs. = 377) | –3.1 (–4.5 to –1.7) | <0.001** |
Secondary outcomes: carer | ||
FQ (n = 152, obs. = 380) | –3.0 (–4.8 to –1.1) | 0.002* |
CSE (n = 104, obs. = 180) | 9.0 (4.6 to 13.5) | <0.001** |
EDSIS (n = 152, obs. = 266) | –4.5 (–7.4 to –1.7) | 0.002* |
GHQ (n = 150, obs. = 263) | –2.7 (–4.2 to –1.1) | 0.001** |
Negative ECI (n = 153, obs. = 268) | –13.4 (–19.4 to –7.5) | <0.001** |
Positive ECI (n = 268, obs. = 153) | 1.2 (–0.4 to 2.8) | 0.1 |
AESED (n = 122, obs. = 122) | –9.1 (–13.4 to –4.8) | <0.001** |
Secondary outcomes: individual with eating disorder (carer report) | ||
GEDF (n = 146, obs. = 367) | 3.5 (0.5 to 6.5) | 0.02* |
EatBeh (n = 152, obs. = 268) | –0.8 (–1.2 to –0.5) | <0.001** |
ECHO, Expert Carers Helping Others self-help intervention; HADS, Hospital Anxiety and Depression Scale; GEDF, Global Eating Disorder Functioning (indirect); EatBeh, Eating Behaviours (indirect); FQ, Family Questionnaire; CSE, Caregiver Self-Efficacy; EDSIS, Eating Disorder Symptom Impact Scale; GHQ, General Health Questionnaire; ECI, Experience of Caregiving Inventory; AESED, Accommodation and Enabling Scale for Eating Disorders; obs., observations.
* P < 0.05
** P < 0.001.
(r = 0.5, P<0.0001), AESED (r = 0.5, P<0.0001) and CSE (r =–0.5, P<0.0001) all correlated with changes in carers' HADS, suggesting that they are all partly mediating the effect on HADS.
Contact time as a mediator of intervention effect on carer behaviour and distress
We explored whether the amount of face-to-face contact and other contact (e.g. telephone) mediated the effect of ECHO on outcomes HADS, FQ and AESED. Carers were split according to whether they had a high (>21 h a week) or low (<21 h per week) level of contact with the patient. Since there was no significant relationship between amount of contact and the effect of the intervention, assumptions for a mediation model were not met; contact time does not appear to mediate the effect of ECHO on carers' HADS, FQ or AESED.
Mediating role of maintaining factors on patient improvement (carer report)
A similar modelling approach was used with GEDF and EatBeh scores as the outcome. The intervention reduced FQ, AESED
ECHO (n = 52), mean (s.d.) | ECHOc (n = 47), mean (s.d.) | |
---|---|---|
Proportion of materials watched/read | 8.13 (2.51) | 9.21 (1.63) |
Usefulness of the information | 8.00 (2.25) | 8.74 (1.64) |
Difficulty of using DVDs | 3.56 (3.05) | 2.81 (2.54) |
Usefulness of DVD information for caregiving | 7.54 (2.16) | 7.93 (2.16) |
Helpful for stress levels/self-care | 7.04 (2.03) | 6.94 (2.56) |
Helpful for communication | 7.63 (1.99) | 8.45 (1.77) |
Expectations met | 6.34 (2.36) | 6.73 (2.11) |
ECHO, Expert Carers Helping Others self-help only intervention; ECHOc, Expert Carers Helping Others guided self-help intervention.
and EatBeh and increased GEDF scores. We looked at mixed effects models including the mediating variable as a covariate, and the estimated intervention effect lost significance on addition of the mediating variable.
Negative correlations between change scores for FQ (r = –0.3, P<0.001) and AESED (r = −0.4, P<0.001) were found with GEDF scores. This finding suggests that changes in these elements partly mediate the effect of the intervention on GEDF scores. In contrast, correlations between FQ change scores and EatBeh scores (r = 0.2, P = 0.10) and AESED change scores and EatBeh scores (r = 0.2, P = 0.09) were not significantly different from zero, suggesting that there is no mediating effect on this variable.
Exploratory moderation analyses of ECHO intervention
We examined whether carers' FQ, AESED and CSE scores and aspects of the caregiving experience (illness duration and living together) measured at pre-intervention moderated the intervention effect on carers' HADS scores. We extended the linear mixed model to contain a main effect of the hypothesised moderating variable at pre-intervention, an interaction of intervention (i.e. time) and moderator variable, and an interaction of coaching and the moderator variable. Significant moderating effects for the standard intervention were obtained for FQ (estimate –0.2, P = 0.04) and AESED (estimate –0.1, P<0.001). The interaction effect for CSE was narrowly not significant at the 0.05 threshold. There were no significant moderating effects of coaching.
In order to gain a better understanding of these results, we looked at the effects of the intervention on high, medium and low levels of the moderator variable. There was a greater decrease in HADS following the intervention in those with high baseline levels of FQ (high FQ = 70: estimated reduction –6.00, 95% CI –9.14 to –2.86) in comparison with other groupings (low FQ = 40: estimated reduction –1.32, 95% CI −3.58 to 0.95; medium FQ = 55, estimated reduction −3.66, 95% CI –5.21 to –2.11).
Similarly, ECHO was most effective for people with high levels of AESED (high AESED = 90: estimated reduction –7.76, 95% CI –11.01 to –4.52; medium AESED = 60: estimated reduction, –4.32, 95% CI –6.11 to –2.53; low AESED = 30: estimated reduction –0.88, 95% CI –2.90 to 1).
The HADS score was reduced for every level of CSE at post-intervention and this reduction was greatest for people with low CSE (low CSE = 20: estimated reduction –7.06, 95% CI –10.77 to –3.34; medium CSE = 50: estimated reduction –4.76, 95% CI –6.73 to –2.79; high CSE = 80: estimated reduction –2.47, 95% CI –4.65 to –0.28).
We also assessed intervention adherence as a moderator. Using the variable illustrating the proportion of DVDs watched, a significant moderating effect was found on the intervention effect for FQ (estimate –0.7, P<0.03) and AESED (estimate –1.8, P = 0.02).
The reduction of FQ post-intervention was greatest for people who watched a greater proportion of DVDs (low amount of DVDs watched = 2: estimated reduction 1.03, 95% CI –2.29 to 4.35; most DVDs = 4: estimated reduction –1.86, 95% CI –3.54 to –0.19; all DVDs = 5: estimated reduction –3.31, 95% CI –5.36 to –1.30).
The reduction of AESED post-intervention was smallest for people who watched fewer of the DVDs (low amount of DVDs watched = 2: estimated reduction 0.79, 95% CI –6.87 to 8.45; most DVDs = 4: estimated reduction –6.23, 95% CI –10.07 to –2.39; all DVDs = 5: estimated reduction –9.75, 95% CI –14.44 to –5.05).
We assessed face-to-face contact and other contact as moderators, but found no moderating effect of level of face-to-face or other contact between carer and the person they care for on the treatment effect for HADS, AESED or FQ. No significant interaction effects, and thus no significant moderator effects, were found in models that included length of illness or living together as moderators.
Discussion
This study represents an early phase of the Medical Research Council's framework for complex interventions. Reference Campbell, Fitzpatrick, Haines, Kinmonth, Sandercock and Spiegelhalter1 The aims of this exploratory study were to test the interpersonal maintenance model and examine whether telephone guidance improves the effectiveness of a self-help intervention (ECHO) in order to refine its delivery. Reference Crawford, Henry, Crombie and Taylor27 Carer distress and almost all secondary outcomes derived from the model improved at post-intervention. Carers also reported improvements in their loved one's level of functioning and eating disorder symptoms. The addition of telephone coaching had no objective additional benefits to the self-help-only intervention, although this group rated some of the acceptability measures more positively.
As predicted by the model, exploratory analyses showed that changes in caregiving self-efficacy, expressed emotion and accommodation and enabling behaviours mediated improvements in carer distress and perceived level of functioning of the individual with the eating disorder. The impact of ECHO was greatest in those carers with the highest levels of expressed emotion and accommodation and enabling behaviours and lowest self-efficacy. Carers who watched a greater proportion of the DVDs exhibited a greater reduction in expressed emotion and accommodating and enabling behaviours.
The results provide preliminary empirical support for the cognitive interpersonal maintenance model of eating disorders. These results suggest that better implementation of the interventions (encouraging carers to watch the DVDs, perhaps by improving their quality) may be of benefit.
The improvement in carers' status is consistent with previous research using different forms of the intervention but with similar content Reference Sepulveda, Lopez, Macdonald and Treasure13,Reference Sepulveda, Lopez, Todd, Whitaker and Treasure14,Reference Glasziou, Chalmers, Altman, Bastian, Boutron and Brice28 and other interventions based on carers' needs. Reference Sepulveda, Todd, Whitaker, Grover, Stahl and Treasure29,Reference Zucker, Ferriter, Best and Brantley30 A secondary beneficial effect on patients with eating disorders has also been reported elsewhere. Reference Zucker, Ferriter, Best and Brantley30,Reference Uehara, Kawashima, Goto, Tasaki and Someya31
The failure to find an enhanced effect of telephone coaching was unexpected. It is possible that results may be due to lack of power, insufficient sessions or the participation of only one carer in the coaching process. Interestingly, carers who received ECHOc reported less improvement in functioning in the individual they cared for than those in the ECHO group. This may reflect carers' enhanced ability to recognise the symptoms of an eating disorder, or improved communication between carer and their loved one.
Limitations
No separate comparison group was included in this study and therefore it is possible that some changes in carer outcome are the result of other latent variables such as clinical improvement in the patients or receipt of external support (e.g. family therapy). We visually inspected the data and performed t-tests for significant changes during the waiting period. For the outcomes carer distress, self-efficacy, expressed emotion, accommodation and enabling, and positive caregiving burden, we did not find evidence that our assumptions do not hold. However, there are significant changes over the waiting period for caregiving burden, general well-being, and carer-reported variables of the individual with the eating disorder. This suggests that for these outcomes part of the estimated effects during the intervention period might be due to unobserved influences. Carers may have experienced a positive expectation of change and relief at the prospect of receiving support, thus rating their sense of burden and their loved one's state as less severe.
We do not have direct, validated measures from patients. The scaling of the measures used may be problematic, as it is difficult for carers to judge their loved one's level of functioning relative to others. Nevertheless, we were interested in individual change scores and the scaling rules for the instrument were well defined and gave carers a good indication of what symptoms, behaviours and level of impairment would be present at each point on the continuum. Also, carers have important insights into the level of symptomatology and functionality that are not necessarily observed in clinical settings. This study suggests that further research with objective patient measures is of interest.
The study was powered for the primary hypothesis, which was to detect change in carers' distress at post-intervention. Sample size may, therefore, not have been sufficient to detect additional effects of coaching. Our study was not powered to test all potential mediator and moderator effects (e.g. the extent to which patients/carers were accessing support, the relationship of carer to the individual, the specific symptom profile of the individual with an eating disorder). Although ECHO is designed to be used by all carers, it would be useful for future research to assess the utility of ECHO across different carer groups (e.g. fathers, partners). We believe that these would make interesting topics in further research including more complex forms of statistical modelling.
Finally, coaching was conducted by three different coaches. We were, however, unable to include this information in the already complex model. Coach effects should be evaluated in future studies and motivational interviewing adherence should be measured.
Implications
These results provide empirical support for the cognitive interpersonal model. Reference Schmidt and Treasure3,Reference Treasure, Sepulveda, Macdonald, Whitaker, Lopez and Zabala6 This skills training package is a low-cost intervention and an easily disseminated resource but the acceptability could be improved by making the materials more attractive and salient. The modified intervention could be used in a fully powered Phase III trial, with direct measurements of eating disorder psychopathology and compared with a no treatment control group. Reference Campbell, Fitzpatrick, Haines, Kinmonth, Sandercock and Spiegelhalter1
Funding
This work presents independent research commissioned by the National Institute for Health Research (NIHR) under Programme Grant for Applied Research (Reference number RP-PG-0606-1043). This work was also supported by the NIHR Biomedical Research Centre for Mental Health, South London and Maudsley NHS Foundation Trust, Institute of Social Psychiatry and Institute of Psychiatry, King's College London. The views expressed in this publication are those of the authors and not necessarily those of the NHS, the NIHR or the Department of Health.
Acknowledgements
Thank you to Gill Todd, Jeff Barrera, María Zabala, Idan Naor and Kimberley Davis for their help over the course of the project, and Jane Morris for her creative input. We would like to also thank the family members that have taken part in the study.
eLetters
No eLetters have been published for this article.