Hostname: page-component-586b7cd67f-2brh9 Total loading time: 0 Render date: 2024-11-22T08:27:29.275Z Has data issue: false hasContentIssue false
  • English
  • Français

Strengths and Difficulties Questionnaire Added Value Scores: evaluating effectiveness in child mental health interventions

Published online by Cambridge University Press:  02 January 2018

Tamsin Ford ,
Judy Hutchings ,
Tracey Bywater ,
Anna Goodman  and
Robert Goodman
Tamsin Ford*
Affiliation:
Institute of Health Services Research, Peninsula College of Medicine and Dentristry, Exeter
Judy Hutchings
Affiliation:
School of Psychology, Bangor University, Gwynedd, Wales
Tracey Bywater
Affiliation:
School of Psychology, Bangor University, Gwynedd, Wales
Anna Goodman
Affiliation:
Department of Epidemiology and Public Health, London School or Hygiene and Tropical Medicine
Robert Goodman
Affiliation:
Department of Child and Adolescent Psychiatry, Kings College London, Institute of Psychiatry, UK
*
Tamsin Ford, Institute of Health Services Research, Peninsula College of Medicine and Dentistry, St Luke's Campus, Heavitree Road, Exeter EX2 8UT. Email: [email protected]
Rights & Permissions [Opens in a new window]

Abstract

Core share and HTML view are not available for this content. However, as you have access to this content, a full PDF is available via the ‘Save PDF’ action button.
Background

Routine outcome monitoring may improve clinical services but remains controversial, partly because the absence of a control group makes interpretation difficult.

Aims

To test a computer algorithm designed to allow practitioners to compare their outcomes with epidemiological data from a population sample against data from a randomised controlled trial, to see if it accurately predicted the trial's outcome.

Method

We developed an ‘added value’ score using epidemiological data on the Strengths and Difficulties Questionnaire (SDQ). We tested whether it correctly predicted the effect size for the control and intervention groups in a randomised controlled trial.

Results

As compared with the a priori expectation of zero, the Added Value Score applied to the control group predicted an effect size of 70.03 (95% CI 70.30 to 0.24, t = 0.2, P = 0.8). As compared with the trial estimate of 0.37, the Added Value Score applied to the intervention group predicted an effect size of 0.36 (95% CI 0.12 to 0.60, t = 0.1, P = 0.9).

Conclusions

Our findings provide preliminary support for the validity of this approach as one tool in the evaluation of interventions with groups of children who have, or are at high risk of developing, significant psychopathology.

Type
Papers
Information
The British Journal of Psychiatry , Volume 194 , Issue 6 , June 2009 , pp. 552 - 558
Copyright
Copyright © Royal College of Psychiatrists, 2009 

Footnotes

The British Child and Adolescent Mental Health Survey 2004 was funded by the Department of Health; the Health Foundation funded the trial of parent training and T.F. wrote this paper while supported on an MRC clinician scientist fellowship. None of these funders had any involvement in the design or analysis of this paper or the construction of the Added Value Score.

Declaration of interest

R.G. and A.G. are directors and part owners of Youthinmind, which provides the www.sdqinfo.com website as a public service in order to make the SDQ freely available in many languages for non-profit use and to publish SDQ norms and the Added Value Score formula.

References

1 Weisz, JR, Jensen, AL. Child and adolescent psychotherapy in research and practice contexts: review of the evidence and suggestions for improving the field. Eur Child Adolesc Psychiatry 2001; 10 (suppl): 12–8.Google Scholar
2 Department of Health. Health Service Circular 2003/003, Local Authority Circular (2003)2. Child and Adolescent Mental Health Service Grant Guidance 2003/04. Department of Health, 2003 (http://www.dh.gov.uk/en/Publicationsandstatistics/Lettersandcirculars/Healthservicecirculars/DH_4004735).Google Scholar
3 Bridgewater, A, Grayson, A, Brooks, N, Grotte, G, Fabri, B, Au, J, et al. Has the publication of cardiac surgery outcome data been associated with changes in practice in Northwest England? An analysis of 25,730 patients undergoing CABG surgery under 30 surgeons over 8 years. Heart 2007; 93: 744–8.CrossRefGoogle Scholar
4 Department of Health. Getting the Right Start: National Framework for Children. Emerging Findings. TSO (The Stationery Office), 2003.Google Scholar
5 Last, JM. A Dictionary of Epidemiology (3rd edn): 144. Oxford University Press, 1995.Google Scholar
6 Jensen, PS, Roper, M, Fisher, P, Piacentini, J, Canino, G, Richters, J, et al. Test–retest reliability of the Diagnostic Interview Schedule for Children (DISC 2.1). Arch Gen Psychiatry 1995; 52: 61–71.CrossRefGoogle ScholarPubMed
7 Ford, T, Collishaw, S, Meltzer, H, Goodman, R. A prospective study of childhood psychopathology; predictors of change over three years. Soc Psychiatry Psychiatric Epidem 2007; 42: 953–61.Google Scholar
8 Cole, T, Flegal, KM, Nicholls, D, Jackson, AA. Body mass index cut offs to define thinness in children and adolescents. BMJ 2007; 335: 194–7.Google Scholar
9 Cotterill, AM, Majrowski, WH, Hearn, S, Preece, MA, Savage, MA. The potential effect of the UK 1990 height centile charts on community growth surveillance. Arch Dis Child 1996; 74: 452–4.Google Scholar
10 Green, H, McGinnity, A, Meltzer, H, Ford, T, Goodman, R. Mental Health of Children and Young People in Great Britain, 2004. TSO (The Stationery Office), 2005.Google Scholar
11 Hutchings, J, Bywater, T, Daley, D, Gardner, F, Whitaker, C, Jones, K, et al. Parenting interventions in Sure Start for children at risk of developing conduct disorder; pragmatic randomised controlled trial. BMJ 2007; 334: 678–82.Google Scholar
12 Goodman, R. Psychometric properties of the strengths and difficulties questionnaire. J Am Acad Child Adolesc Psychiatry 2001; 40: 1337–45.CrossRefGoogle ScholarPubMed
13 Goodman, R, Ford, T, Richards, H, Meltzer, H, Gatward, R. The Development and Well-being Assessment: description and initial validation of an integrated assessment of child and adolescent psychopathology. J Child Psychol Psychiatry 2000; 41: 645–57.Google Scholar
14 World Health Organization. The ICD–10 Classification of Mental and Behavioural Disorders. Diagnostic Criteria for Research. WHO, 1993.Google Scholar
15 Webster-Stratton, C. Preventing conduct problems in Head Start children: strengthening parenting competencies. J Consult Clin Psychol 1998; 66: 715–30.Google Scholar
16 National Institute for Health and Clinical Excellence. Parent Training/Education Programmes in the Management of Children with Conduct Disorders. NICE Technology Appraisal Guidance 102. NICE, 2006 (http://www.nice.org.uk/TA102).Google Scholar
17 Eyberg, S, Ross, AW. Assessment of child behaviour problems; the validation of a new inventory. J Clin Child Psychol 1978; 7: 113–6.CrossRefGoogle Scholar
18 Treasury, HM. PSA Delivery Agreement 12: Improve the Health and Well-Being of Children and Adolescents. TSO (The Stationery Office), 2007.Google Scholar
19 Garralda, ME, Yates, P, Higginson, I. Child and adolescent mental health service use: HONOSCA as an outcome measure. Br J Psychiatry 2000; 177: 52–8.Google Scholar
20 Lilford, RJ, Brown, CA, Nicholl, J. Use of process measures to monitor the quality of care. BMJ 2007; 335: 648–50.Google Scholar
21 Lee, W, Jones, L, Goodman, R, Heyman, I. Broad outcome measures may underestimate effectiveness: an instrument comparison survey. Child Adolesc Ment Health 2005; 10: 143–4.Google Scholar
22 Ford, T, Hamilton, H, Meltzer, H, Goodman, R. Child mental health is everybody's business; the prevalence of contacts with public sectors services by the types of disorder among British school children in a three-year period. Child Adolesc Ment Health 2007; 12: 13–20.Google Scholar
23 Jacobson, NS, Roberts, LJ, Berns, SB, McGlinchey, JB. Methods for defining and determiniming the clinical significance of treatment effects: description, application and alternatives. J Consult Clin Psychol 1999; 67: 300–7.Google Scholar
24 Wise, EA. Methods for analyzing psychotherapy outcomes: a review of clinical significance, reliable change and recommendations for future directions. J Pers Assess 2004; 82: 50–9.Google Scholar
25 Lambert, M. Presidential address: what we have learned from a decade of research aimed at improving psychotherapy outcome in routine care. Psychother Res 2007; 17: 1–14.Google Scholar
26 Fung, CH, Lim, YW, Mattke, S, Damberg, C, Shekelle, PG. Systematic review: the evidence that publishing patient care performance data improves quality of care. Ann Intern Med 2008; 148: 111–23.CrossRefGoogle ScholarPubMed
27 Burgess, P, Pirkis, J, Coombs, T. Do adults in contact with Australia's public sector mental health services get better? Aust New Zealand Health Policy 2006; 3: 9–16.CrossRefGoogle ScholarPubMed
28 Westaby, S, Archer, N, Manning, N, Adwani, S, Grebnik, C, Ormerod, O, et al. Comparison of hospital episode statistics and central cardiac audit database in public reporting of congenital heart surgery and mortality. BMJ 2007; 335: 759–62.Google Scholar
Submit a response

eLetters

No eLetters have been published for this article.