Hostname: page-component-78c5997874-t5tsf Total loading time: 0 Render date: 2024-11-17T19:14:07.829Z Has data issue: false hasContentIssue false
  • English
  • Français

Evaluating the training of clinical supervisors: a pilot study using the fidelity framework

Published online by Cambridge University Press:  06 December 2010

Tonia Culloty ,
Derek L. Milne  and
Alia I. Sheikh
Tonia Culloty
Affiliation:
Northumberland, Tyne & Wear Mental Health NHS Trust, St George's Park Hospital, Morpeth, Northumberland, UK
Derek L. Milne*
Affiliation:
School of Psychology, Newcastle University, Newcastle upon Tyne, UK
Alia I. Sheikh
Affiliation:
School of Psychology, Newcastle University, Newcastle upon Tyne, UK
*
*Author for correspondence: Dr D. L. Milne, School of Psychology, Newcastle University, Newcastle upon Tyne, UK. (email: [email protected])
Get access Rights & Permissions [Opens in a new window]

Abstract

Theevaluation of supervisor training has featured weak measurement and lacked a coherent framework, limiting effectiveness. A literature review was first conducted to clarify the current status of supervisor workshop evaluations, related to the promising fidelity framework. This consists of five criteria: the workshop's design, the training (competence of the trainer), the delivery of the workshop, the learning of the participants (receipt), and the clinical practice outcomes (enactment). Second, we applied this framework to the training of supervisors (n = 17) in a cognitive-behavioural therapy (CBT) approach, by analysing one trainer leading two successive supervisors’ workshops. The review of the literature indicated that there were significant psychometric and conceptual deficiencies in the current evaluation of supervisor training. The data from the case-study analysis suggest that the manual-based workshop could be delivered with high fidelity by this trainer (e.g. the CBT approach to supervision received 89% approval). The fidelity framework provided a systematic, feasible and coherent rationale for the evaluation of supervisor training. Our preliminary findings indicated that the workshop was successful. To fulfil its promise as an improved way of evaluating supervisor training, the framework should be piloted with other trainers, instruments and workshops, using controlled designs.

Keywords

Evaluationfidelity frameworksupervisiontraining
Type
Education and supervision
Information
the Cognitive Behaviour Therapist , Volume 3 , Issue 4 , December 2010 , pp. 132 - 144
Copyright
Copyright © British Association for Behavioural and Cognitive Psychotherapies 2010

Access options

Get access to the full version of this content by using one of the access options below. (Log in options will check for institutional or personal access. Content may require purchase if you do not have access.)

References

Recommended follow-up reading

On how to train supervisors

Kaslow, NJ, Borden, KA, Collins, FL, Forrest, L, Illfelder-Kaye, J, Nelson, PD, Rallo, JS, Vasquez, MJJ, Willmuth, ME (2004). Competencies conference: future directions in education and credentialing in professional psychology. Journal of Clinical Psychology 60, 699–712.CrossRefGoogle ScholarPubMed
Falender, C, Cornish, JAE, Goodyear, R, Hatcher, R, Kaslow, NJ, Leventhal, G, Shafranske, E, Sigmon, ST, Stoltenberg, C, Grus, C 2004. Defining competencies in psychology supervision: a consensus statement. Journal of Clinical Psychology 60, 771–785.CrossRefGoogle ScholarPubMed
Barrow, M, Domingo, RA 1997. The effectiveness of training clinical supervisors in conducting the supervisory conference. The Clinical Supervisor 16, 55–78.CrossRefGoogle Scholar
Kilminster, SM, Jolly, BC 2000. Effective supervision in clinical practice settings: a literature review. Medical Education 34, 827–840.CrossRefGoogle ScholarPubMed

References

American Presidential Task Force 2006. Evidence-based practice in clinical psychology. American Psychologist 61, 271–285.CrossRefGoogle Scholar
Andrews, P, Meyer, RG 2003. Marlowe–Crowne Social Desirability Scale and short form C: forensic norms. Journal of Clinical Psychology 59, 483–492.CrossRefGoogle ScholarPubMed
Bambling, M, King, R, Raue, P, Schweitzer, R, Lambert, W 2006. Clinical supervision: its influence on client-rated working alliance and client symptom reduction in the brief treatment of major depression. Psychotherapy Research 16, 317–331.CrossRefGoogle Scholar
Barrow, M, Domingo, RA 1997. The effectiveness of training clinical supervisors in conducting the supervisory conference. The Clinical Supervisor 16, 55–77.CrossRefGoogle Scholar
Bedward, J, Daniels, HRJ 2005. Collaborative solutions – clinical supervision and teacher support teams: reducing professional isolation through effective peer support. Learning in Health and Social Care 4, 53–66.CrossRefGoogle Scholar
Beidas, RS, Kendall, PC 2010. Training therapists in evidence-based practice: a critical review from a systems-contextual perspective. Clinical Psychology: Science and Practice 17, 1–30.Google ScholarPubMed
Bellg, AJ, Borrelli, B, Resnick, B, Hecht, J, Minicucci, DS, Ory, M, Ogedegbe, G, Orwig, D, Ernst, D, Czajkowski, S 2004. Enhancing treatment fidelity in health behaviour change studies: best practises and recommendations from the NIH Behaviour Change Consortium. Health Psychology 23, 443–451.CrossRefGoogle Scholar
Borders, LD, Rainey, LM, Crutchfield, LB, Martin, DW 1996. Impact of a counseling supervision course on doctoral students’ cognitions. Counselor Education and Supervision 35, 204–217.CrossRefGoogle Scholar
Borrelli, B, Sepinwall, D, Ernst, D, Bellg, AJ, Czajkowski, S, Greger, R et al. 2005. A new tool to assess treatment fidelity and evaluation of treatment fidelity across ten years of health behaviour research. Journal of Consulting and Clinical Psychology 73, 852–860.CrossRefGoogle Scholar
Busari, JO, Scherpbier, AJJA, Van Der Vleuten, CPM, Essed, GGM 2006. A two-day teacher-training programme for medical residents: investigating the impact on teaching ability. Advances in Health Sciences Education 11, 133–144.CrossRefGoogle ScholarPubMed
Crowne, DP, Marlowe, D 1960. A new scale of social desirability independent of psychopathology. Journal of Consulting Psychology 24, 349–354.CrossRefGoogle ScholarPubMed
Davis, JR, Rawana, EP, Capponi, DR 1989. Acceptability of behavioural staff management techniques. Behavioural Research and Treatment 4, 23–44.Google Scholar
DoH 1998. A First Class Service: Quality in the New NHS. London: Department of Health.Google Scholar
Diwan, S, Berger, C, Ivy, C 1996. Supervision and quality assurance in long-term-care case management. Journal of Case Management 5, 65–71.Google ScholarPubMed
Ducharme, JM, Williams, L, Cummings, A, Murray, P, Spencer, T 2001. General case quasi-pyramidal staff training to promote generalization of teaching skills in supervisory and direct-care staff. Behavior Modification 25, 233–254.CrossRefGoogle ScholarPubMed
Elliott, R 2002. Hermeneutic single-case efficacy design. Psychotherapy Research 12, 1–21.CrossRefGoogle ScholarPubMed
Ellis, MV, Ladany, N 1997. Inferences concerning supervisees and clients in clinical supervision: an integrative review. In: Handbook of Psychotherapy Supervision (ed. Watkins, C. E.), pp. 447–507. New York: Wiley.Google Scholar
Fleming, RK, Oliver, JR, Bolton, DM 1996. Training supervisors to train staff: a case study in a human service organization. Journal of Organizational Behavior Management 16, 3–25.CrossRefGoogle Scholar
Frisch, MB 1989. An integrative model of supervisory training for medical center personnel. Psychological Reports 64, 1035–1042.CrossRefGoogle ScholarPubMed
Heaven, C, Clegg, J, Maguire, P 2006. Transfer of communication skills training from workshop to workplace: the impact of clinical supervision. Patient Education and Counselling 60, 313–325.CrossRefGoogle ScholarPubMed
Henggeler, SW, Schoenwald, SK, Liao, JG, Letourneau, EJ, Edwards, DL 2008. Transporting efficacious treatments to field settings: the link between supervisory practices and therapist fidelity in MST programs. Journal of Clinical Child & Adolescent Psychology 31, 155–167.CrossRefGoogle Scholar
Kavanagh, DJ, Spence, SH, Wilson, J, Crow, N 2002. Achieving effective supervision. Drug and Alcohol Review 21, 247–252.CrossRefGoogle ScholarPubMed
Kirkpatrick, DL 1967. Evaluation of training. In: Training and Development Handbook (ed. Craig, R. L. and Bittel, L. R.), pp. 87–112. New York: McGraw-Hill.Google Scholar
Lomax, JW, Andrews, LB, Burruss, JW, Moorey, S 2005. Psychotherapy supervision. In: Oxford Textbook of Psychotherapy, pp. 495–503. Oxford University Press.CrossRefGoogle Scholar
McDonnell, A, Sturmey, P, Oliver, C, Cunningham, J, Hayes, S, Galvin, M, Walshe, C, Cunningham, C 2008. The effects of staff training on staff confidence and challenging behaviour in services for people with autism spectrum disorders. Research in Autism Spectrum Disorders 2, 311–319.CrossRefGoogle Scholar
Milne, D, James, I 2000. A systematic review of effective cognitive-behavioural supervision. British Journal of Clinical Psychology 39, 111–27.CrossRefGoogle ScholarPubMed
Milne, DL 2007 a. An empirical definition of clinical supervision, British Journal of Clinical Psychology 46, 437–447.CrossRefGoogle ScholarPubMed
Milne, DL 2007 b. Evaluation of staff development: the essential ‘SCOPPE’. Journal of Mental Health 16, 389–400.CrossRefGoogle Scholar
Milne, DL 2008. CBT supervision: from reflexivity to specialisation. Behavioural and Cognitive Psychotherapy 36, 779–786.CrossRefGoogle Scholar
Milne, DL 2009. Evidence-Based Clinical Supervision: Principles and Practice. Oxford: Wiley/Blackwell.Google Scholar
Milne, DL, James, IA, Keegan, D, Dudley, M 2002. Teachers PETS: a new observational measure of experiential training interactions. Clinical Psychology and Psychotherapy 9, 187–199.CrossRefGoogle Scholar
Milne, DL, Westerman, C 2001. Evidence-based clinical supervision: rationale and illustration. Clinical Psychology and Psychotherapy 8, 444–445.CrossRefGoogle Scholar
O'Brien, A, Price, C, Burns, T, Perkins, R 2003. Improving the vocational status of patients with long-term mental illness: a randomised controlled trial of staff training. Community Mental Health Journal 39, 333–347.CrossRefGoogle ScholarPubMed
Proctor, B 1988. A cooperative exercise in accountability. In: Enabling and Ensuring (ed. Marken, M. and Payne, M.), pp. 21–34. Leicester: Leicester National Youth Bureau and Council for Education and Training in Youth and Community Work.Google Scholar
Rossi, PH, Freeman, HE, Lipsey, MW 2003. Evaluation: A Systematic Approach, 7th edn. London: Sage Publications.Google Scholar
Smith, T, Parker, T, Taubman, M, Lovaas, OI 1992. Transfer of staff training from workshops to group homes: a failure to generalize across settings. Research in Developmental Disabilities 13, 57–71.CrossRefGoogle ScholarPubMed
Spence, C, Cantrell, J, Christie, I, Samet, W 2002. A collaborative approach to the implementation of clinical supervision. Journal of Nursing Management 10, 65–74.CrossRefGoogle Scholar
Townend, M, Iannetta, L, Freeston, MH 2002. Clinical supervision in practice: a survey of UK cognitive behavioural psychotherapists accredited by the BABCP. Behavioural and Cognitive Psychotherapy 30, 485–500.CrossRefGoogle Scholar
Waller, G 2009. Evidence-based treatment and therapist drift. Behaviour Research and Therapy 47, 119–127.CrossRefGoogle ScholarPubMed
Zorga, S 2002. Supervision: the process of lifelong learning in social and educational professions. Journal of Inter-Professional Care 16, 265–276.Google ScholarPubMed
Submit a response

Comments

No Comments have been published for this article.