Hostname: page-component-586b7cd67f-t7fkt Total loading time: 0 Render date: 2024-11-25T23:14:55.607Z Has data issue: false hasContentIssue false

Two years after introduction, trainees remain unconvinced about WPBAs and ARCPs

Published online by Cambridge University Press:  02 January 2018

Rights & Permissions [Opens in a new window]

Abstract

Type
Columns
Creative Commons
Creative Common License - CCCreative Common License - BY
This is an Open Access article, distributed under the terms of the Creative Commons Attribution (CC-BY) license (http://creativecommons.org/licenses/by/4.0/), which permits unrestricted re-use, distribution, and reproduction in any medium, provided the original work is properly cited.
Copyright
Copyright © The Royal College of Psychiatrists, 2010

Several surveys conducted in the first year after the introduction of workplace-based assessments (WPBAs) in 2007 show poor satisfaction with this process. Reference Menon, Winston and Sullivan1-Reference Babu, Htike and Cleak3 Our survey of trainees conducted in 2009 shows ongoing concerns with WPBAs 2 years on.

Of the 146 trainees who participated in our electronic survey, 40% did not feel that WPBAs had led to improvements in patient care, with 31% unsure. Furthermore, 68% considered that WPBAs did not help/were only slightly helpful to them in passing their MRCPsych examination. Of those who were in psychiatric training before WPBAs were introduced (67%), 70% reported no improvement in their training!

However, 88% of trainees rated their satisfaction reasonably high on the quality of feedback they received (at 3 or above on a 5-point Likert scale). Norcini & Burch Reference Pathan and Salter4 stress that formative assessment and feedback are a powerful means for changing behaviour in trainees, and that feedback can have a major influence on learning. On the face of it, our results seem strange, as trainees do not seem to acknowledge or recognise the helpfulness of this new method of assessment on their training experience.

The online filing of WPBA has improved greatly in 2008. The faulty Healthcare Assessment and Training computer system (originally in use to record WPBAs) can no longer be blamed for trainee dissatisfaction, as in earlier surveys. Reference Menon, Winston and Sullivan1 Our concurrent survey of 50 consultant trainers showed that they too had ongoing concerns about WPBAs. In particular, 80% of trainers felt that WPBAs had an impact on their work commitments. If trainers were more positive about these assessments, perhaps this would influence their trainees' perceptions.

Parallel with the WPBA, the annual review of competence progression (ARCP) panels have been introduced. The ARCP should be an important formative and summative part of training. In our survey, 44% of trainees and 20% of trainers felt ARCPs were not meaningful, with 30% of trainees and 42% of trainers not sure.

We acknowledge that the interpretation of our survey is limited by the reasonably low take-up among trainees and trainers. Yet our results concur with those of Menon et al's 2008 study Reference Menon, Winston and Sullivan1 and therefore we feel that our survey cannot be simply ignored because of the low response rate.

We agree with Menon et al Reference Menon, Winston and Sullivan1 that these new tools for evaluation and feedback should not be abandoned. However, further training of both trainers and trainees is needed to achieve better usage and a clearer understanding of the constructive role they should play in training, particularly with respect to the role of feedback.

Employers need to recognise that consultant psychiatrists require more time in their job plans for training future psychiatrists.

References

1 Menon, S, Winston, M, Sullivan, G. Workplace-based assessment: survey of psychiatric trainees in Wales. Psychiatr Bull 2009; 33: 468–74.CrossRefGoogle Scholar
2 Babu, KS, Htike, MM, Cleak, VE. Workplace-based assessments in Wessex: the first 6 months. Psychiatr Bull 2009; 33: 474–8.CrossRefGoogle Scholar
3 Pathan, T, Salter, M. Attitude to workplace-based assessment (letter). Psychiatr Bull 2008; 32: 359.CrossRefGoogle Scholar
4 Norcini, J, Burch, V. Workplace-based assessment as an educational tool: AMEE Guide No31. Med Teach 2007; 29: 855–71.CrossRefGoogle Scholar
Submit a response

eLetters

No eLetters have been published for this article.