Chapter Objectives

This chapter will enable the reader to:

1. • Recognise definitions of the psychometric properties of simulation-based training;

2. • Analyse the psychometric properties of simulation-based assessment in differentiating trainees' performances;

3. • Understand how to measure the reliability of an assessment process.

Five Key Messages

1. There are a wide variety of assessment tools used to assess surgeons using simulation which can collectively provide evidence of both technical and non- technical capabilities.

2. Simulation can provide robust evidence of the level of surgical performance which is reliable and valid.

3. Psychometric analyses can be used to reliably identify those trainees who need targeted support and those who can be fast tracked through training.

4. There is emerging evidence of the validity and reliability of simulators to provide robust feedback on surgical performance.

5. The use of psychometric analyses can identify how an assessment method can be enhanced.

Introduction

The advent of new surgical techniques has brought new challenges for education and training as well as for the assessment and revalidation of surgeons (1–3). These challenges must be set against the backdrop of changing patterns of service delivery, the implementation of evidence-based practice and the increasing expectations of the public in relation to professional evidence and the accountability of competence (4). For the surgical specialties, the reduction in training time and postgraduate specialty training recommendations have halved the surgical case-load that trainees are exposed to (5).