Hostname: page-component-78c5997874-m6dg7 Total loading time: 0 Render date: 2024-11-19T07:28:59.929Z Has data issue: false hasContentIssue false
  • English
  • Français

Using a Logic Model to Enable and Evaluate Long-Term Outcomes of a Mass Casualty Training Program: A Single Center Case Study

Published online by Cambridge University Press:  28 May 2021

Nicholas B Dadario ,
Simon Bellido ,
Andrew Restivo ,
Miriam Kulkarni ,
Maninder Singh Open the ORCID record for Maninder Singh [Opens in a new window] ,
Andrew Yoon ,
Jared Shapiro ,
Frank Quintero ,
Tianna Tagami  and
Christina J Yang
...Show all authors
Nicholas B Dadario
Affiliation:
Robert Wood Johnson School of Medicine, Rutgers University, New Brunswick, NJ, USA
Simon Bellido
Affiliation:
White Plains Hospital Center, Emergency Medicine, White Plains, NY, USA
Andrew Restivo
Affiliation:
Department of Emergency Medicine, Montefiore Medical Center, Weiler Division, Bronx, NY, USA Albert Einstein College of Medicine, Bronx, NY, USA
Miriam Kulkarni
Affiliation:
Department of Emergency Medicine, St. John’s Riverside Hospital, Yonkers, NY, USA
Maninder Singh
Affiliation:
Albert Einstein College of Medicine, Bronx, NY, USA Department of Emergency Medicine, Jacobi Medical Center, Bronx, NY, USA
Andrew Yoon
Affiliation:
Albert Einstein College of Medicine, Bronx, NY, USA Department of Emergency Medicine, Montefiore Medical Center, Moses Division, Bronx, NY, USA
Jared Shapiro
Affiliation:
Environmental Health and Safety, Montefiore Health System, Bronx, NY, USA
Frank Quintero
Affiliation:
White Plains Hospital Center, Emergency Medicine, White Plains, NY, USA
Tianna Tagami
Affiliation:
MGH Institute of Health Professions, Boston, MA, USA Pearson Education, Boston, MA, USA
Christina J Yang
Affiliation:
Albert Einstein College of Medicine, Bronx, NY, USA Department of Otorhinolaryngology, Montefiore Medical Center, Bronx, NY, USA
Farrukh N Jafri*
Affiliation:
White Plains Hospital Center, Emergency Medicine, White Plains, NY, USA Albert Einstein College of Medicine, Bronx, NY, USA
*
Corresponding author: Farrukh N Jafri, Email: [email protected].
Get access Rights & Permissions [Opens in a new window]

Abstract

Purpose:

Global health disasters are on the rise and can occur at any time with little advance warning, necessitating preparation. The authors created a comprehensive evidence-based Emergency Preparedness Training Program focused on long-term retention and sustained learner engagement.

Method:

A prospective observational study was conducted of a simulation-based mass casualty event training program designed using an outcomes-based logic model. A total of 25 frontline healthcare workers from multiple hospital sites in the New York metropolitan area participated in an 8-hour immersive workshop. Data was collected from assessments, and surveys provided to participants 3 weeks prior to the workshop, immediately following the workshop, and 3 months after completion of the workshop.

Results:

The mean percentage of total knowledge scores improved across pre-workshop, post-workshop and retention (3 months post-workshop) assessments (53.2% vs. 64.8% vs. 67.6%, P < 0.05). Average comfort scores in the core MCI competencies increased across pre-workshop, post-workshop and retention self-assessments (P < 0.01). Of the participants assessed at 3 months retention (n = 14, 56%), 50.0% (n = 7) assisted in updating their hospital’s emergency operations plan and 50.0% (n = 7) pursued further self-directed learning in disaster preparedness medicine.

Conclusions:

The use of the logic model provided a transparent framework for the design, implementation, and evaluation of a competency-based EPT program at a single academic center.

Keywords

mass casualty incidentsmedical simulationemergency preparednessemergency medicinelogic model
Type
Original Research
Information
Disaster Medicine and Public Health Preparedness , Volume 16 , Issue 3 , June 2022 , pp. 1116 - 1122
Copyright
© Society for Disaster Medicine and Public Health, Inc. 2021

Access options

Get access to the full version of this content by using one of the access options below. (Log in options will check for institutional or personal access. Content may require purchase if you do not have access.)

References

Lyznicki, J, Subbarao, I, Benjamin, GC, James, JJ. Developing a consensus framework for an effective and efficient disaster response health system: a national call to action. Disaster Med Public Health Prep. 2007;1(1 Suppl):S51-S54.Google ScholarPubMed
Epstein, SK, Burstein, JL, Case, RB, et al. The National Report Card on the state of emergency medicine: Evaluating the emergency care environment state by state 2009 edition. Ann Emerg Med. 2009;53(1):4-148.CrossRefGoogle ScholarPubMed
Report Card Task Force Members; ACEP Staff. America’s emergency care environment, a state-by-state Report Card: 2014 edition. Ann Emerg Med. 2014;63(2):97-242.Google Scholar
Resnick, L. It Takes a Team - The 2013 Boston Marathon: Preparing for and recovering from a mass-casualty event. Needham, MA: JBJS and JOSPT; 2014.Google Scholar
Tobert, D, von Keudell, A, Rodriguez, EK. Lessons from the Boston Marathon Bombing: An orthopedic perspective on preparing for high-volume trauma in an urban academic center. J Orthop Trauma. 2015;29 Suppl 10:S7-S10.CrossRefGoogle Scholar
Walls, RM, Zinner, MJ. The Boston Marathon response: Why did it work so well?. JAMA. 2013;309(23):2441-2442.CrossRefGoogle ScholarPubMed
Subbarao, I, Lyznicki, JM, Hsu, EB, et al. A consensus-based educational framework and competency set for the discipline of disaster medicine and public health preparedness. Disaster Med Public Health Prep. 2008;2(1):57-68.CrossRefGoogle ScholarPubMed
Scott, LA, Smith, C, Jones, EM, Manaker, LW, Seymore, AC, Fulkerson, J. Regional approach to competency-based patient care provider disaster training: the Center for Health Professional Training and Emergency Response. South Med J. 2013;106(1):43-48.Google Scholar
Hsu, EB, Thomas, TL, Bass, EB, Whyne, D, Kelen, GD, Green, GB. Healthcare worker competencies for disaster training. BMC Med Educ. 2006;6:19.CrossRefGoogle ScholarPubMed
Scott, LA, Swartzentruber, DA, Davis, CA, Maddux, PT, Schnellman, J, Wahlquist, AE. Competency in chaos: Lifesaving performance of care providers utilizing a competency-based, multi-actor emergency preparedness training curriculum. Prehosp Disaster Med. 2013;28(4):322-333.CrossRefGoogle ScholarPubMed
Scott, LA, Carson, DS, Greenwell, IB. Disaster 101: A novel approach to disaster medicine training for health professionals. J Emerg Med. 2010;39(2):220-226.CrossRefGoogle ScholarPubMed
Rossati A. Global warming and its health impact. Int J Occup Environ Med. 2017;8(1):7-20.CrossRefGoogle Scholar
Tekola, B, Myers, L, Lubroth, J, Plee, L, Calistri, P, Pinto, J. International health threats and global early warning and response mechanisms. Rev Sci Tech. 2017;36(2):657-670.Google ScholarPubMed
Evers, U, Jones, SC, Iverson, D, Caputi, P. ʼGet Your Life Backʼ: Process and impact evaluation of an asthma social marketing campaign targeting older adults. BMC Public Health. 2013;13:759.CrossRefGoogle ScholarPubMed
Kaplan, SA, Garrett, KE. The use of logic models by community-based initiatives. Eval Program Plann. 2005;28(2):167-172.Google Scholar
Sitaker, M, Jernigan, J, Ladd, S, Patanian, M. Adapting logic models over time: The Washington State heart disease and stroke prevention program experience. Prev Chronic Dis. 2008;5(2):A60.Google ScholarPubMed
Loberti, AM, Dewsbury, BM. Using a logic model to direct backward design of curriculum. J Microbiol Biol Educ. 2018;19(3):19.3.105.CrossRefGoogle ScholarPubMed
Goeschel, CA, Weiss, WM, Pronovost, PJ. Using a logic model to design and evaluate quality and patient safety improvement programs. Int J Qual Health Care. 2012;24(4):330-337.CrossRefGoogle ScholarPubMed
Armstrong, EG, Barsion, SJ. Using an outcomes-logic-model approach to evaluate a faculty development program for medical educators. Acad Med. 2006;81(5):483-488.Google ScholarPubMed
Kellogg Foundation, WK. Using logic models to bring together planning, evaluation and action: Logic model development guide; 2004.Google Scholar
Ten Cate, O. Nuts and bolts of entrustable professional activities. J Grad Med Educ. 2013;5(1):157-158.CrossRefGoogle ScholarPubMed
Fink, LD. 1: Evaluating teaching: A new approach to an old problem. To Improve the Academy. 2008;26(1):3-21.Google Scholar
Federal Emergency Management Agency. National Incident Management System (NIMS). https://training.fema.gov/nims/. Accessed June 12, 2019.Google Scholar
Supplementary material: File

Dadario et al. supplementary material

Dadario et al. supplementary material

Download Dadario et al. supplementary material(File)
File 87.4 KB