Hostname: page-component-586b7cd67f-2plfb Total loading time: 0 Render date: 2024-11-26T16:11:49.789Z Has data issue: false hasContentIssue false

Training of Medical Students for Mass Casualty Incidents Using Table-Top Gamification

Published online by Cambridge University Press:  21 September 2022

Rafael Castro Delgado*
Affiliation:
Emergency and Disaster Research Unit, Oviedo University, Spain SAMU-Asturias, Spain
Lucía Fernández García
Affiliation:
Emergency and Disaster Research Unit, Oviedo University, Spain
José Antonio Cernuda Martínez
Affiliation:
Emergency and Disaster Research Unit, Oviedo University, Spain
Tatiana Cuartas Álvarez
Affiliation:
Emergency and Disaster Research Unit, Oviedo University, Spain SAMU-Asturias, Spain
Pedro Arcos González
Affiliation:
Emergency and Disaster Research Unit, Oviedo University, Spain
*
Corresponding author: Rafael Castro Delgado, E-mail: [email protected]
Rights & Permissions [Opens in a new window]

Abstract

Introduction:

“Table-top” exercises can improve knowledge and skills related to mass casualty incidents (MCIs) with little logistical efforts. We aim to evaluate the learning process of 5th year medical school students related to MCI response using table-top simulation and measure their methodology perception.

Methods:

A theoretical part plus an MCI simulation board exercise was organized. Knowledge pretest and 1 mo after posttest was scored, and an assessment questionnaire with 27 questions with a Likert-type scale with 3 dimensions: methodology, knowledge acquisition, and skills acquisition was administered. Students did not receive any written or training material between pretest and posttest.

Results:

A total of 108 (80%) completed the evaluation questionnaire, pretest, and posttest. For the pretest, average grade was 4.25 (SD = 1.71) and 42% passed, and for the posttest, average grade was 8.33 (SD = 1.28) and 97 % pass (P < 0.0001). All variables measuring methodology perception scored more than 8, except for the duration of the exercise (7.3). Most knowledge acquisition scored above 9. Self-perception skill acquisition scores were slightly lower, although all above 7.

Conclusions:

“Table-top” methodology is useful for acquiring knowledge and skills related to MCI response. Retention of knowledge is very high. Students consider that this methodology can be very useful for medical studies. Active or nonactive role is a factor that only influences final results in specific items.

Type
Original Research
Creative Commons
Creative Common License - CCCreative Common License - BYCreative Common License - NCCreative Common License - SA
This is an Open Access article, distributed under the terms of the Creative Commons Attribution-NonCommercial-ShareAlike licence (http://creativecommons.org/licenses/by-nc-sa/4.0/), which permits non-commercial re-use, distribution, and reproduction in any medium, provided the same Creative Commons licence is used to distribute the re-used or adapted article and the original article is properly cited. The written permission of Cambridge University Press must be obtained prior to any commercial use.
Copyright
© The Author(s), 2022. Published by Cambridge University Press on behalf of Society for Disaster Medicine and Public Health, Inc

Integrating practical skills in the field of mass casualty incidents (MCIs) requires a complex process until an adequate performance of skills could be applied in real situations. Reference Lennquist1 After the necessary theoretical knowledge, students must know how to integrate it transversally to focus on problem solving. In the field of MCI, you must also be able to acquire a series of practical skills to be applied in a hostile and unstable environment, so training in simulated scenarios would represent one of the last phases of the learning process. Reference Montán, Hreckovski and Dobson2 Simulation is defined as “an artificial representation of a process in the real world, which must be faithful enough to achieve a clear and specific objective, which allows evaluating the training or a certain action”. Reference Gomar-Sancho and Palés-Argullós3 Simulation exercises also have a series of methodological characteristics that differentiate them from the rest of the exercises because they are exercises in which information is handled through role play, Reference Akl, Kairouz and Sackett4 so it is based on decision-making both individually and collectively, facilitating cross-learning and team decision-making.

All simulation exercises are made up of 3 phases 5 : a first information phase (or briefing), in which the main and specific objectives that we want to achieve have to be marked, the working groups are organized, the roles to be performed by each member of the group are assigned, and the necessary information about the situation that is going to develop must be provided; a second phase, in which students face a situation around which the entire simulation revolves; and a third phase of debriefing or evaluation, which consists of an analysis of the exercise carried out. In this phase, the students have the opportunity to comment on what happened and can consider what could or should have happened; it serves to check if the problem has been solved or not throughout the simulation. In the first and second phase (briefing and action), teachers have a similar role to that of a conductor, while in the third stage (debriefing), the teacher becomes pure facilitator of the process, and students become the protagonist of their own learning.

A specific type of simulation exercise is the “table-top” exercises, defined by the WHO as an exercise for filtering relevant information and making key decisions, where participants are tasked to review and discuss the risk communication and related actions they would take at specified stages of the emergency. This allows for testing of emergency risk communication plans in an informal, low-stress environment”. 6 It normally takes place in a classroom and the participants will have a defined role during it. This exercise is carried out by presenting the participants with various situations and alternative solutions. Board exercises have been widely used in emergency professional training plans, Reference Chi, Chao and Chuang7,Reference Morton Hamer, Reed and Greulich8 even for specific situations Reference Achatz, Friemert and Trentzsch9Reference Chung, Gardner and Schonfeld11 and specific centers, Reference Sherman, Leland and Ross12 with good learning outcomes, Reference Whitney, Burke and Lehman-Huskamp13 but there is little experience of use in medical schools. There are studies that analyze this type of exercise in terms of the acquisition of knowledge in nursing students applied to triage, all concluding improvement of knowledge on the subject Reference Evans, Baumberger-Henry and Schwartz14 and better decision-making in those processes that require the participation of different teams with different roles. Reference Evans and Schwartz15 In addition, the performance of the main role allows the rest of the students to understand the importance of leadership in the health response to MCI. Reference Hershkovich, Gilad and Zimlichman16 There are also experiences on the use of immersive virtual reality (RVI) in the study of MCI management and categorization of victims involved in incidents, Reference Ferrandini Price, Escribano Tortosa and Nieto Fernandez-Pacheco17 as well as the use of games in medical teaching. Reference Bochennek, Wittekindt and Zimmermann18

The aim of this work was to evaluate the learning process of 5th course students of Oviedo University Medical School related to MCI response through the use of the table-top simulation by measuring their perception about the methodology and the acquisition of knowledge and skills, and also measure their knowledge improvement.

Methods

The 135 students enrolled in the subject “Preventive Medicine and Public Health” in the 5th year of the Degree in Medicine at the University of Oviedo during the 2018/19 academic year were included in the study. They were organized in 3 groups (45 students each group), all of them receiving the same training and evaluation process. Between March and April, 2 separate sessions per group were organized separated 1 mo. The organization of the first session was (Figure 1): (1) Presentation and exam (15 min): teaching team is presented, purpose and structure of the seminar is explained, and the theoretical knowledge pretest about MCI is carried out; (2) Theoretical explanation (45 min): lecture related to emergency medical services (EMS) organization and to general content related to MCI management and patient triage. The same professor, with extensive teaching and EMS clinical experience, was in charge of the lecture for the 3 groups; (3) Table-top exercise (90 min): after explaining the rules, it was developed on 2 boards (filed board and resources map board); and (4) debriefing, in which professor acted as a facilitator for the students to analyze the decisions taken. Randomly selected students had an active role during the exercise, while the rest acted as spectators, being able to intervene and even help their colleagues with an active role. All the actions carried out on the board were projected on a screen for all students. The roles performed were: emergency coordinator center physician (2), medical commander first advanced life support unit (ALS) physician (1), first advanced life support unit (ALS) nurse (1), rescue command (2), police command (2), emergency medical technician (4), second ALS physician (1), and second ALS nurse (1). Once the roles were distributed, teachers present to the students the case to be developed, consisting of a bus accident, with 25 passengers, which crashed with a gas station, producing an explosion and fire. Figurines corresponding to the accident itself were placed on 1 of the boards, and a map of the region was placed on a second board, with figurines representing the different resources available. Students with an active role were making the decisions they considered appropriate based on the theoretical knowledge previously explained, and taking into account possible problems that may arise during the development of the exercise (Figure 2). Through a Web-cam connected to the projector, the students who had a passive role could observe the development of the exercise and intervene and provide creative and innovative solutions to the new problems that arose during the development of the exercise. Once the case was finalized, a debriefing (30 min) was performed about the development and what was the resolution of the case.

Figure 1. Organization of the sessions.

Figure 2. Table top scenario and students playing roles.

After the exercise, students were invited to complete the self-perception questionnaire (Appendix 1), using a 10-point Likert-type scale (minimum 1 point and maximum 10 points) from which 27 variables grouped in 3 dimensions were analyzed at the end of the exercise: perception on the methodology, perception on the acquisition of knowledge, and perception on the acquisition of skills. Median and interquartile range (IQR) were calculated. Cronbach’s alpha coefficient was calculated to assess the internal validity of the questionnaire in each of the dimensions. A Mann-Whitney U test was used to compare active and nonactive roles results.

The students completed a pretest knowledge consisting of 10 multiple-choice questions, and after 1 month, the same test was repeated. Students with more than 50% correct answers passed the exam. Students were not provided any type of material, apart from the theoretical introduction and the board exercise to evaluate only what was learned and acquired during the exercise. It was not compulsory for the students to answer the self-perception questionnaire, and, if so, they were excluded from the study. They were informed that this would have no effect on their final grade.

Results

Of the 135 students enrolled in the subject “Preventive Medicine and Public Health” in the 5th year of the Degree in Medicine at the University of Oviedo, 108 students (67 female, 37 male and 4 undetermined) who answered the pretest, posttest, and self-perception questionnaire were in included in the study (80% response rate). Cronbach values to asses internal validity were 0.86 for methodology perception, 0.91 for knowledge acquisition perception and 0.87 for skills acquisition perception. A total of 27 students (25%) had an active role. Average age was 22.98 (SD = 2.55). Students had previously had 0.88 h (SD = 0.87) of table-top experience before this exercise, and had had 0.95 h (SD = 3.02) of study regarding disasters and MCIs during medical school. Median for methodology perception was 9 (IQR = 2), acquisition of knowledge perception median = 9 (IQR = 2) and skill acquisition perception median = 8 (IQR = 2). Table 1 shows the results for each variable. Students who developed an active role perceived a better acquisition of knowledge related to MCI roles (P = 0.048); and better perception regarding multidisciplinary team coordination skills (P = 0.014), but no statistical differences were found in the rest of the perceived skills analyzed. Posttest results (mean = 8.33; SD = 1.28; 97% pass), were significantly better (P < 0.001) than pretest exam results (mean = 4.25; SD = 1.71; 42% passed). A total of 97% of students improved their results.

Table 1. Median, IQR, and differences by group of the variables studied

* significance <0.05.

Discussion

The use of this methodology, through the recreation of scenarios that simulate an MCI, allows to involve students in complex situations in a controlled environment. It also allows the re-creation of a stressful environment that brings students closer to the stress experienced in a real situation of these characteristics, and covers a teaching need in medical schools. Reference Barrimah, Adam and Al-Mohaimeed19 Although it has been previously published that active student participation facilitates the acquisition of skills and knowledge, Reference Huang, Tseng and Jenq20 we have found differences in only 2 items. This finding is relevant because we can see that this methodology is useful for all participating students, and not only for active role students.

One of the points to highlight in this type of exercise is its innovation, as we have not found previous studies that develop this type of exercise in medical university students; we have found teaching experiences on disasters in medical schools, Reference Kommor, Hodge and Ciottone21,Reference Wiesner, Kappler and Shuster22 but not with the use of the table-top methodology. Another point to highlight is that students improve their knowledge related to MCI without complex technological resources nor a great logistical deployment; a board and a token are enough to re-create the situation or incident that we want to develop. The general interest expressed by this teaching methodology is similar to that expressed by medical students in carrying out disaster response exercises. Reference Jasper, Wanner and Berg23

Regarding the students’ perception of this methodology, high scores obtained indicate a positive perception. No differences were found between the active role and the spectator, which facilitates the development of the exercises with a significant number of students. These results are very positive for our work, because it shows a very positive general perception of the student. In the case of immersion, it shows that this type of simulation exercise brings the student to manage MCI closer to those experienced in a real situation, reinforcing their motivation for learning. Reference Mahler, Großschedl and Harms24

The perception of the students related to the acquisition of knowledge through this method also obtains very high scores, something that is congruent with the significant increase in the grades obtained in the posttest. Other studies have also shown that simulation training of medical students improves knowledge acquisition. Reference Offiah, Ekpotu and Murphy25

On the other hand, it is worth mentioning the low number of previous hours devoted to studying MCI during medical training, which shows the need to deepen this field of knowledge during medical studies. Reference Pollard, Bachmann and Greer26 The limited number of times during medical studies that they had attended classes based on table-top gamification methodology may be also something to improve.

Regarding the student’s perception of the acquisition of skills, results were slighter lower compared with the previous sections. Even so, we consider the positive results, because it is achieved that the students internalize difficulties regarding managing MCI, and within the resources available, they get as close as possible to the reality of what an MCI is. The fact that playing an active role suggests a better perception related to the improvement of multidisciplinary team coordination skills makes us think that decision-making training, similar to our active role scenarios, can be useful in other fields of medicine that involve teamwork tasks, and that the development of other specific skills in MCIs is not related to the role the student play.

In the open response section, most of the comments were positive about the exercise. Most consider exercise a very useful tool to put themselves in a situation and improve acquiring knowledge and skills. Above all, active participation and immersion in decision-making stood out. Other students highlighted not having been able to participate as an active role, and that, if they had, they would have acquired more knowledge. Among the weakest points of the exercise, the excessively long duration and the fact that it is not possible for all students to develop an active role stood out. However, we have not found many perception differences related to active or nonactive role.

Among the limitations that we found, firstly highlighting the excessive number of students per group, which meant that not all students could participate actively in the exercise through an active role. This has had a significant influence on the time in which they rated the degree of satisfaction after the exercise, because a percentage of students demanded that they had not been able to participate and, if they had been, they consider that they would have acquired more knowledge and skills. Smaller groups of students would have allowed 2 different cases to be raised, as well as the active participation of a greater number, or even the entire student body. By developing the exercises with smaller groups, it is also guaranteed that the space is ideal, and that all students can follow the course of the exercise and perceive that they are integrated into it.

As a conclusion, table-top exercises increase students’ motivation, their theoretical knowledge, and their skills perception to respond to MCI, with a high degree of retention of knowledge. Students consider it an attractive activity from the teaching point of view, and a good complement to the theoretical classes, which will also improve promotion of the EMS field of knowledge among medical students. It is a cheap technique that can be used in many different educational settings. It is necessary to adapt the number of students per group and their involvement in the different roles. An active or nonactive role is a factor that influences final results only in specific items.

Data availability

The datasets used and/or analyzed during the current study are available from the corresponding author on reasonable request.

Author contributions

R.C.D. designed the study, participated in the teaching procedure, analyzed data, wrote manuscript and approved final version; L.F.G. participated in the teaching procedure, analyzed data, wrote manuscript and approved final version; J.A.C.M. analyzed data, wrote manuscript and approved final version; T.C.A. participated in the teaching procedure, wrote manuscript and approved final version; P.A.G. designed the study, analyzed data, wrote manuscript and approved final version. All authors have read and approved the manuscript

Funding

No funding. Approved as Teaching Innovation Project in Oviedo University (Code PINN-18-A-098).

Conflict of interest

The authors declare that they have no competing interests.

Ethical standards

Not applicable. Local ethics committee ruled that no formal ethics approval was required in this particular case. Students were informed that they agreed to participate by filling the questionnaire.

APPENDIX 1. STUDENT PERCEPTION QUESTIONNAIRE

EVALUATION OF THE UTILITY OF A “TABLE-TOP” EXERCISE FOR THE ACQUISITION OF KNOWLEDGE ON THE PREHOSPITAL RESPONSE TO INCIDENTS OF MULTIPLE VICTIMS (MCI)

AGE:

SEX:

ROLE DURING THE EXERCISE: Active Vs Spectator

IN CASE OF ACTIVE ROLE, SPECIFY:

Rate from 1 to 10 your degree of agreement or disagreement with the following statements, with 1 not agreeing at all and 10 totally agreeing

PERCEPTION ON THE METHODOLOGY

The use of table-top “gamification” exercises increases my interest in the subject of study.

Table-top “gamification” exercises facilitate the acquisition of knowledge

Table-top “gamification” exercises facilitate the acquisition of skills

Using table-top “gamification” techniques increases my motivation to attend class

The use of table-top “gamification” techniques facilitates the acquisition of teamwork skills.

The previous explanations about the development of the exercise were adequate

The duration of the theoretical introduction has been adequate

The duration of the exercise has been adequate

The use of table-top gamification techniques in medical studies facilitates the immersion of the student in real cases

In general, I have found the use of table-top gamification interesting for its application in medical studies

Indicate the number of times during your medical studies that you have attended classes based on table-top gamification methodology

KNOWLEDGE ACQUISITION

During medical studies, the hours spent so far studying multiple casualty incidents have been:

I have understood the different roles involved in the prehospital response to MCI

I have understood the importance of communication between different response services

I have understood the organizational difficulties inherent in an MCI

I have understood the importance of triage in an MCI

I have understood the importance of equipment safety before an MCI

I have understood the importance of the chain of command to organize the response to an MCI

I have understood the importance of communications in responding to an MCI

I have understood the functions of the doctor before an MCI

I have understood the functions of the nursing staff when faced with an MCI

I have understood the functions of the health emergency technicians before an MCI

I have understood the functions of rescue teams before an MCI

I have understood the functions of law enforcement before an MCI

SKILLS ACQUISITION

The use of table-top gamification in MCI has allowed me to improve my skills to coordinate multidisciplinary teams

The use of table-top gamification in MCI has allowed me to acquire leadership skills

The use of table-top gamification in MCI has allowed me to acquire skills in scene safety assessment

The use of table-top gamification in MCI has allowed me to acquire skills in sectorization of the scene

The use of table-top gamification in MCI has allowed me to acquire skills in triage

References

Lennquist, S. Education and training in disaster medicine. Scan J Trauma Emerg Med. 2005;94:300-310.Google ScholarPubMed
Montán, KL Hreckovski, B, Dobson, B, et al. Development and evaluation of a new simulation model for interactive training of the medical response to major incidents and disasters. Eur J Trauma Emerg Surg. 2024;40(4):429-443. doi: 10.1007/s00068-013-0350-y CrossRefGoogle Scholar
Gomar-Sancho, C, Palés-Argullós, J. ¿Por qué la simulación en la docencia de las ciencias de salud sigue estando infrautilizada?. Educ Med. 2011;14(2):101-103 Google Scholar
Akl, EA, Kairouz, VF, Sackett, KM, et al. Educational games for health professionals. Cochrane Database Syst Rev. 2013;2013(3):3:CD006411. doi: 10.1002/14651858.CD006411.pub4.Google ScholarPubMed
UNDRR. Guidelines for developing emergency simulations and drills. Washington, DC: Pan American Health Organization; 2011 Google Scholar
Chi, CH, Chao, WH, Chuang, CC, et al. Emergency medical technicians’ disaster training by tabletop exercise. Am J Emerg Med. 2001;19(5):433-436. doi: 10.1053/ajem.2001.24467 CrossRefGoogle ScholarPubMed
Morton Hamer, MJ, Reed, PL, Greulich, JD, et al. Economic community of West African States disaster preparedness tabletop exercise: building regional capacity to enhance health security. Disaster Med Public Health Prep. 2019;13(3):400-404. doi:10.1017/dmp.2018.44 CrossRefGoogle ScholarPubMed
Achatz, G, Friemert, B, Trentzsch, H, et al. Terror and disaster surgical care: training experienced trauma surgeons in decision making for a MASCAL situation with a tabletop simulation game. Eur J Trauma Emerg Surg. 2020;46(4):717-724. doi: 10.1007/s00068-020-01441-x CrossRefGoogle ScholarPubMed
Sandström, BE, Eriksson, H, Norlander, L, et al. Training of public health personnel in handling CBRN emergencies: a table-top exercise card concept. Environ Int. 2014;72:164-169 CrossRefGoogle ScholarPubMed
Chung, S, Gardner, AH, Schonfeld, DJ, et al. Addressing children’s needs in disasters: a regional pediatric tabletop exercise. Disaster Med Public Health Prep. 2018;12(5):582-586. doi: 10.1017/dmp.2017.137.CrossRefGoogle ScholarPubMed
Sherman, M, Leland, F, Ross, B, et al. Simopoly: improving simulation center operations through a tabletop simulation exercise. Simul Healthc. 2014;9(5):304-311. doi: 10.1097/SIH.0000000000000051 CrossRefGoogle ScholarPubMed
Whitney, RE, Burke, RV, Lehman-Huskamp, K, et al. On shaky ground: learner response and confidence after tabletop earthquake simulation. Pediatr Emerg Care. 2016;32(8):520-524. doi: 10.1097/PEC.0000000000000681.CrossRefGoogle ScholarPubMed
Evans, CA, Baumberger-Henry, M, Schwartz, R, et al. Nursing students’ transfer of learning during a disaster tabletop exercise. Nurse Educ. 44(5):278-283. doi: 10.1097/NNE.0000000000000602 CrossRefGoogle Scholar
Evans, CA, Schwartz, R. Using tabletop exercises as an innovative and practical teaching strategy in response to external disaster scenarios. Nurs Educ Perspect. 2019;40(1):62-64. doi: 10.1097/01.NEP.0000000000000308 CrossRefGoogle ScholarPubMed
Hershkovich, O, Gilad, D, Zimlichman, E, et al. Effective medical leadership in times of emergency: a perspective. Disaster Mil Med. 2016;2:4 doi10.1186/s40696-016-0013-8 CrossRefGoogle ScholarPubMed
Ferrandini Price, M, Escribano Tortosa, D, Nieto Fernandez-Pacheco, A, et al. Comparative study of a simulated incident with multiple victims and immersive virtual reality. Nurse Educ Today. 2018;71:48-53. doi: 10.1016/j.nedt.2018.09.006.CrossRefGoogle ScholarPubMed
Bochennek, K, Wittekindt, B, Zimmermann, S-Y, et al. More than mere games: a review of card and board games for medical education. Med Teach. 2007;29(9):941-948. doi: 10.1080/01421590701749813 CrossRefGoogle Scholar
Barrimah, I, Adam, I, Al-Mohaimeed, A. Disaster medicine education for medical students: is it a real need? Med Teach. 2016;38(Suppl 1):S60-S65. doi: 10.3109/0142159X.2016.1142515.CrossRefGoogle ScholarPubMed
Huang, C-D, Tseng, H-M, Jenq, C-C, et al. Active learning of medical students in Taiwan: a realist evaluation. BMC Med Educ. 2020;20(1):487. doi: 10.1186/s12909-020-02392-y.CrossRefGoogle ScholarPubMed
Kommor, MB, Hodge, B, Ciottone, G. Development and implementation of a disaster medicine certificate series (DMCS) for medical students. Prehosp Disaster Med. 2019;34(2):197-202. doi: 10.1017/S1049023X19000165 CrossRefGoogle ScholarPubMed
Wiesner, L, Kappler, S, Shuster, A, et al. Disaster training in 24 hours: evaluation of a novel medical student curriculum in disaster medicine. J Emerg Med. 2018;54(3):348-353. doi: 10.1016/j.jemermed.2017.12.008 CrossRefGoogle ScholarPubMed
Jasper, EH, Wanner, GK, Berg, D, et al. Implementing a disaster preparedness curriculum for medical students. South Med J. 2017;110(8):523-527. doi: 10.14423/SMJ.0000000000000681 CrossRefGoogle ScholarPubMed
Mahler, D, Großschedl, J, Harms, U. Does motivation matter? - the relationship between teachers’ self-efficacy and enthusiasm and students’ performance. PLoS One. 2018;13(11):e0207252. doi: 10.1371/journal.pone.0207252 CrossRefGoogle ScholarPubMed
Offiah, G, Ekpotu, LP, Murphy, S, et al. Evaluation of medical student retention of clinical skills following simulation training. BMC Med Educ. 2019;19(1):263. doi: 10.1186/s12909-019-1663-2 CrossRefGoogle ScholarPubMed
Pollard, KA, Bachmann, DJ, Greer, M, et al. Development of a disaster preparedness curriculum for medical students: a pilot study of incorporating local events into training opportunities. Am J Disaster Med. 2015;10(1):51-59. doi: 10.5055/ajdm.2015.0188 CrossRefGoogle ScholarPubMed
Figure 0

Figure 1. Organization of the sessions.

Figure 1

Figure 2. Table top scenario and students playing roles.

Figure 2

Table 1. Median, IQR, and differences by group of the variables studied