Hostname: page-component-78c5997874-g7gxr Total loading time: 0 Render date: 2024-11-03T02:44:30.654Z Has data issue: false hasContentIssue false
  • English
  • Français

Effects Of The Video Case Study in Preparing Paramedic Preceptors For The Role Of Evaluator

Published online by Cambridge University Press:  28 June 2012

Judy Janing  and
Wesley Sime
Judy Janing*
Affiliation:
IOCAD Emergency Services Group, Emmitsburg, Maryland, USA
Wesley Sime
Affiliation:
University of Nebraska–Lincoln, Lincoln, Nebraska, USA
*
3312 N. 78th St., Omaha, NE 68134, Email: [email protected]
Get access Rights & Permissions [Opens in a new window]

Abstract

Introduction:

Accurate field evaluations are critical in determining paramedic students' competency to provide patient care. The [U.S.] National Paramedic Curriculum does not address the skills needed by evaluators, and requirements to be a preceptor/evaluator vary from state to state. Therefore, it is imperative that educational programs develop an evaluation process that reflects valid performance criteria and assure a high degree of rating consistency among the evaluators. This study sought to determine the effects of using a video case based teaching approach in preparing paramedic preceptors for the role of evaluator.

Hypothesis:

Paramedic preceptors receiving the case-based teaching approach to prepare them for the role of evaluator would demonstrate significantly higher scores on a video posttest than paramedic preceptors who were not prepared for the role of evaluator using the case-based approach.

Methods:

Thirty-four paramedic preceptors from a Midwestern fire-based Emergency Medical Services system were enrolled in this study. Two scripted video student/patient encounters were used to measure evaluation scores in a pretest-posttest comparison of control versus experimental group. The experimental group was given structured rating guidelines and practice applying those guidelines to a case study. Pretest and posttest scores were weighted and analyzed using Analysis of Variance.

Results:

Analysis of the pretest–posttest differences revealed significantly higher scores for the experimental group in the categories containing complex behaviors: communication F(1,16) = 13.21, p <.01, assessment F (1,16) = 8.81, p <.01, and knowledge F (1,16) = 29.64, p <.001. There was no significant difference between groups in the categories containing simple, easily observed behaviors: reliability F (1,16) = .55, p >.05 and cooperativeness F (1,16) = 3.02, p >.05.

Conclusions:

Using the case study method and written guidelines that provide concrete examples of complex behaviors appears to increase reliability of evaluations among preceptors.

Resumen

Introducción:

Las evaluaciones veraces de campo son criticas para determinar la competencia de estudiantes paramédicos para proveer cuidado a los pacientes. El Currículum Paramédico Nacional no contempla las destrezas necesarias para evaluadores, y los requerimientos para ser preceptor/evaluador varia de Estado a Estado. Por lo tanto, es imperativo que programas educacionales desarrollen un proceso de evaluación que refleje criterios validos de actuación y aseguren un alto grado de consistencia entre los evaluadores. Este estudio busca determinar los efectos de usar un video-caso basado en un enfoque para preparar preceptores paramédicos para el papel de evaluadores.

Hipótesis:

Los preceptores paramédicos que reciban el enfoque de enseñanza basada en casos para prepararlos en el papel de evaluadores, deberán demostrar puntuaciones significativamente mas altas en un video post-examen, que los preceptores paramédicos quienes no fueron preparados para el papel de evaluadores utilizando el enfoque basado en casos.

Métodos:

Treinta y cuatro preceptores paramédicos de una base de bomberos del Sistema de Servicios Médicos de Emergencia del Medio-oeste, fueron enrolados en este estudio. Dos videos con guión de encuentro estudiante / paciente fueron utilizados para medir y evaluar la puntuación en examen pre y post, comparado contra el grupo experimental de control. Al grupo experimental se le dieron rangos, guías y practicas aplicando aquellas del estudio de caso. La puntuación pre y post examen file balanceada y analizada utilizando ANOVA.

Resultados:

El análisis de las diferencias pre y post examen revelaron puntuaciones significativamente mas altos para el grupo experimental in las categorías conteniendo comportamientos complejos: comunicación F(1,16) = 13.21, p <.01,calculo F(1,16) = 8.81, p <.01, y conociendo F(1,16) = 29.64, p <.001. No existió diferencia significativa entre grupos de las categorías conteniendo comportamientos simples y fácilmente observables: fiabilidad F(1,16) = 3.02, p >.05.

Keywords

case studycontextual learningeducationfield evaluationparamedicpreceptor
Type
Original Research
Information
Prehospital and Disaster Medicine , Volume 16 , Issue 2: T. Michael Moles Memorial Issue , June 2001 , pp. 81 - 87
Copyright
Copyright © World Association for Disaster and Emergency Medicine 2001

Access options

Get access to the full version of this content by using one of the access options below. (Log in options will check for institutional or personal access. Content may require purchase if you do not have access.)

References

1. Roberts, J, Norman, G: Reliability and learning from the objective structured clinical examination. Medical Education 1990; 24:219–223.CrossRefGoogle ScholarPubMed
2. Metheny, W: Limitations of physician ratings in the assessment of student clinical performance in an obstetrics and gynecology clerkship. Obstetrics & Gynecology 1991; 78:136–141.Google Scholar
3. Noel, G, Herbers, J, Caplow, M, Cooper, G, Pangaro, L, Harvey, J: How well do internal medicine faculty members evaluate the clinical skills of residents?. Annals of Internal Medicine 1992; 117:757–765.CrossRefGoogle ScholarPubMed
4. Orchard, C: Factors that interfere with clinical judgments of students' performance. Journal of Nursing Education 1992; 31:309–313.CrossRefGoogle ScholarPubMed
5. Ferrell, B, Thompson, B: Standardized patients: a long-station clinical examination format. Medical Education 1993; 27:376–381.CrossRefGoogle ScholarPubMed
6. Winckel, C, Reznick, R, Cohen, R, Taylor, B: Reliability and construct validity of a structured technical skills assessment form. American Journal of Surgery 1994; 167: 423–427.CrossRefGoogle ScholarPubMed
7. Miller, G: The assessment of clinical skills/competence/performance. Academic Medicine 1990; 65:563–567.CrossRefGoogle ScholarPubMed
8. Tower, B, Majewski, T: Behaviorally based clinical evaluation. Journal of Nursing Education 1987; 26:120–123.CrossRefGoogle ScholarPubMed
9. Janing, J, Sime, W: Interrater reliability of paramedic student field performance evaluations. Prehospital Emergency Care 1999; 3:265–266.Google Scholar
10. Norman, G, Schmidt, G: The psychological basis of problem-based learning: a review of the evidence. Academic Medicine 1992; 67:557–565.CrossRefGoogle ScholarPubMed
11. Baldwin, T, & Ford, J: Transfer of training: a review and directions for future research. Personnel Psychology 1988; 41; 63–105.Google Scholar