Hostname: page-component-586b7cd67f-r5fsc Total loading time: 0 Render date: 2024-11-26T19:52:12.108Z Has data issue: false hasContentIssue false

An assessment centre for psychiatrists

Published online by Cambridge University Press:  02 January 2018

Philip Sugarman*
Affiliation:
St Andrew's Healthcare, Northampton
Graeme Yorston
Affiliation:
St Andrew's Healthcare, Northampton
Diane Wyman
Affiliation:
St Andrew's Healthcare, Northampton
*
Philip Sugarman ([email protected])
Rights & Permissions [Opens in a new window]

Summary

An assessment centre is a widely accepted management technique for the effective and fair selection of candidates for employment and promotion. In an era of evidence-based medicine, their adoption for clinicians must surely be overdue. We report our positive experience of introducing assessment centres at St Andrew's Healthcare, a UK mental health charity. The involvement of service users and members of the multidisciplinary team proved invaluable to the success of this innovation.

Type
Current Practice
Creative Commons
Creative Common License - CCCreative Common License - BY
This is an Open Access article, distributed under the terms of the Creative Commons Attribution (CC-BY) license (http://creativecommons.org/licenses/by/4.0/), which permits unrestricted re-use, distribution, and reproduction in any medium, provided the original work is properly cited.
Copyright
Copyright © The Royal College of Psychiatrists, 2010

Recruitment challenges in psychiatry

The challenge of recruiting and selecting able and committed clinicians to posts in psychiatry is a topic that has appeared frequently in the pages of The Psychiatrist. Reference Littlewood, Case, Gater and Lindsey1-Reference Brown, Vassilas and Patel3 This is not only because finding the right person directly affects the quality of services offered to patients, but perhaps also because of a sense of frustration over some of the processes involved and some of the changes that have been imposed. Reference Brown, Addie and Eagles4 Take, for example, the widespread unease, dissatisfaction and loss of confidence in the Medical Training Application System (MTAS) and other government recruitment innovations for training posts. Reference O'Connor and Vize5 For consultant recruitment, too, a rigid, unwieldy mechanism exists that many feel is no longer fit for purpose. Consultant appointments anchored on the Advisory Appointments Committee, a legally constituted interview dating back to the National Health Service Act 1946, are still at the heart of the consultant appointment process in most areas. Reference Whelan, Jarrett, Meerten, Forster and Bhugra6-Reference Rawnsley8

The training of doctors from medical school to specialist level, including the training of psychiatrists, has, over recent years, increasingly focused on the demonstration of key competencies as a prelude to progression. 9-Reference Naeem, Rutherford and Kenn10 However, for most people this eventually leads to a traditional medical panel interview for a consultant post, which generally does not assess the essential competencies required for carrying out the job successfully. But once appointed, psychiatrists are encouraged by the College to again focus on competencies by gathering information widely from colleagues, patients and relatives through the 360-degree feedback process as part of their ongoing appraisal linked to revalidation. 11

Assessment centres - a better approach?

Selection of staff into a modern healthcare organisation should surely be based on a fair, objective and rounded view of competencies beyond performance at a panel interview. Competency-based selection and assessment processes for managers have been developing since the 1950s and have an extensive research base. Reference Jackson, Jamieson and Khan12 The assessment centre is the core technique for competency-based selection, using consistent standards which can be aligned with the strategic direction of the organisation. Use of such assessment centres has only recently been introduced into medicine. Reference Roy13 Their reliability at selecting the best candidates is based on putting them through a range of work-related tasks, typically during a day-long exercise involving the candidates and a group of observers. Research across a number of different industries has shown that assessment centres, with exercises based around the person specification for the job, have good predictive validity for future job performance, clearly superior to interview alone. Reference Roy13,Reference Ungerson14 Candidates who take part in assessment centres are often impressed by the thoroughness and fairness of the employer, even if they are not appointed. This systematic approach to recruitment and selection leads to better informed decisions than those based on a snapshot of behaviour during a formal interview. Reference Ungerson14

St Andrew's experience

St Andrew's Healthcare is a specialist mental healthcare charity which adopted assessment centres for management posts some years ago and for senior clinical posts in 2003. In total, about 400 medical candidates have been assessed through this process. After some trial and error, we have established a settled system of 1-day assessment centres for the selection of psychiatrists and other senior clinicians after initial shortlisting based on the person specification. Box 1 sets out the key elements of the assessment centre we found to be most helpful in selecting the best candidates.

Initially, psychometric assessments of occupational personality and leadership style were included, but we found these to be of less use than the elements we settled on. Box 2 sums up feedback from our participants, both candidates and observers.

In our experience, service users and multidisciplinary team members are particularly skilled and experienced in spotting good doctors. Often candidates who are nervous and perform poorly in the formal panel interview thrive and excel in the other exercises. On the other hand, candidates who are able to deliver well-rehearsed and polished performances at the panel interview may lack substance in the competency interview or even demonstrate a less-than-ideal attitude towards service users who interview them. Often service users' views encapsulate the feedback from other exercises, from ‘she's a great doctor’ to ‘we'd run rings around him’. Service users generally enjoy the experience and benefit from being genuinely trusted and involved in such important decisions for their future care. Likewise, members of the multidisciplinary team enjoy the day, feel more involved and committed to the team and have already started to form a relationship with the successful candidate that can be grown in further team building exercises when the candidate takes up their post.

Box 1 St Andrew's Healthcare assessment centre, key elements

  1. Service user interview: a group of service users are supported, usually by a social worker, in developing a set of questions for candidates. These vary widely and can often be testing and highly revealing, for example: ‘Are you a nice doctor?’, ‘Do you know a good joke?’, ‘Where have you worked before?’

  2. Competency interview: this interview is typically led by line or medical managers with human resources professionals, who ask about achievements, including team leadership. The interview drills down for specific details of the individual's personal contribution and skills, and typically elicits evidence of team development, management and problem-solving skills in a clinical setting.

  3. Mock ward round: a multidisciplinary team from the recruiting service presents every-day clinical dilemma in a highly realistic, mock ward round led by the candidate. These are usually based closely on actual patients, with their identity appropriately protected. Complex clinical decisions, ethical dilemmas, differences of opinion within the team or inappropriate behaviour by a team member can be played out and the candidate is assessed on their ability to manage the situation.

  4. Panel interview: a traditional medical appointment committee interview.

  5. Feedback and discussion: all observers' views, including those of service users, are fed in and ranked. Agreement is reached on who should be appointed and on the content of feedback to candidates.

Box 2 Observations on assessment centres

  1. Candidates generally find assessment centres searching and tiring, but also an interesting learning opportunity. Most, but not all, see them as fairer than panel interviews and appreciate the effort put in. Not all candidates enjoy the experience, as they tend to be unfamiliar with the concept and have not been able to prepare stock responses for the exercises.

  2. Service users typically enjoy the process, often making a real contribution to appointing the right clinician to the service. Astute, intuitive judgements by service users are common and sometimes key to decision making.

  3. Multidisciplinary team: if they are new to assessment centres, staff are often slightly nervous beforehand but they usually genuinely enjoy the process, feel valued at being involved and make a parallel and equally important contribution to the service users in the selection.

  4. Appointing managers greatly appreciate the assistance of a wider group in discovering the real person behind the candidate's formal presentation and in selecting the best person for the role.

A day at an assessment centre appears generally well spent and is regarded as a valuable learning and development opportunity for all participants. The overall effect for St Andrew's has been a successful recruitment and a clear strengthening of the medical team.

Conclusion

Assessment centres are a way of empowering stakeholders, especially service users, in the recruitment of key clinical staff; they are fairer to candidates and improve the quality of recruitment. For St Andrew's Healthcare they have become an important part of our strategy to develop the senior clinical workforce, together with ongoing professional, team and personal development activities. Anecdotal evidence has shown similar developments in some National Health Service trusts and so we would encourage others to explore this approach.

Footnotes

Declaration of interest

None.

References

1 Littlewood, S, Case, P, Gater, R, Lindsey, C. Recruitment, retention, satisfaction and stress in child and adolescent psychiatrists. Psychiatr Bull 2003; 27: 61–7.Google Scholar
2 Brown, N, Vassilas, C, Patel, A. Recruitment and selection into specialty training in psychiatry. Psychiatr Bull 2007; 31: 401–3.CrossRefGoogle Scholar
3 Brown, TM, Addie, K, Eagles, JM. Recruitment into psychiatry: views of consultants in Scotland. Psychiatr Bull 2007; 31: 411–3.CrossRefGoogle Scholar
4 O'Connor, S, Vize, C. The ‘Catch-22’ of recruitment and retention in psychiatry. Psychiatr Bull 2003; 27: 443–5.Google Scholar
5 Whelan, P, Jarrett, P, Meerten, M, Forster, K, Bhugra, D. MTAS fiasco: lessons for psychiatry. Psychiatr Bull 2007; 31: 425–7.CrossRefGoogle Scholar
6 Rawnsley, K. The responsibilities of consultants in psychiatry within the National Health Service. Psychiatr Bull 1984; 8: 123–6.Google Scholar
7 Royal College of Psychiatrists. Notes of guidance for College representatives on NHS advisory consultant and honorary consultant appointments committees in the UK. Psychiatr Bull 1997; 21: 519–20.Google Scholar
8 Naeem, A, Rutherford, J, Kenn, C. From specialist registrar to consultant: permission to land? Psychiatr Bull 2005; 29: 348–51.Google Scholar
9 Royal College of Psychiatrists. A Competency-Based Curriculum Leading to the Certificate of Completion of Training. Royal College of Psychiatrists, 2009.Google Scholar
10 Jackson, N, Jamieson, F, Khan, A. Assessment in Medical Education and Training. Radcliffe, 2007.Google Scholar
11 Roy, D. Appraisal and revalidation of consultant psychiatrists in the NHS. A report from the Special Committee on Clinical Governance. Psychiatr Bull 2004; 28: 387–90.Google Scholar
12 Ungerson, B. Assessment centres – a review of research findings. Personnel Rev 1974; 3: 413.Google Scholar
13 Patterson, F, Lane, P. Assessment for recruitment. In Assessment in Medical Education and Training (eds Jackson, N, Jamieson, F, Khan, A): 6274. Radcliffe,, 2007.Google Scholar
14 Robinson, I. Human Resource Management in Organisations. Chartered Institute of Personnel and Development, 2006.Google Scholar
Submit a response

eLetters

No eLetters have been published for this article.