Hostname: page-component-cd9895bd7-gvvz8 Total loading time: 0 Render date: 2025-01-03T14:04:59.610Z Has data issue: false hasContentIssue false
  • English
  • Français

Prospective evaluation of data-driven models to predict daily risk of Clostridioides difficile infection at 2 large academic health centers

Published online by Cambridge University Press:  19 September 2022

Meghana Kamineni Open the ORCID record for Meghana Kamineni [Opens in a new window] ,
Erkin Ötleş Open the ORCID record for Erkin Ötleş [Opens in a new window] ,
Jeeheh Oh ,
Krishna Rao ,
Vincent B. Young Open the ORCID record for Vincent B. Young [Opens in a new window] ,
Benjamin Y. Li ,
Lauren R. West ,
David C. Hooper ,
Erica S. Shenoy Open the ORCID record for Erica S. Shenoy [Opens in a new window]  and
John G. Guttag
...Show all authors
Meghana Kamineni*
Affiliation:
Electrical Engineering and Computer Science Department, Massachusetts Institute of Technology, Cambridge, Massachusetts
Erkin Ötleş
Affiliation:
Medical Scientist Training Program, University of Michigan Medical School, Ann Arbor, Michigan Department of Industrial and Operations Engineering, University of Michigan College of Engineering, Ann Arbor, Michigan
Jeeheh Oh
Affiliation:
Division of Computer Science and Engineering, University of Michigan College of Engineering, Ann Arbor, Michigan
Krishna Rao
Affiliation:
Department of Internal Medicine, Division of Infectious Diseases, University of Michigan Medical School, Ann Arbor, Michigan
Vincent B. Young
Affiliation:
Department of Internal Medicine, Division of Infectious Diseases, University of Michigan Medical School, Ann Arbor, Michigan
Benjamin Y. Li
Affiliation:
Medical Scientist Training Program, University of Michigan Medical School, Ann Arbor, Michigan Division of Computer Science and Engineering, University of Michigan College of Engineering, Ann Arbor, Michigan
Lauren R. West
Affiliation:
Infection Control Unit, Massachusetts General Hospital, Boston, Massachusetts
David C. Hooper
Affiliation:
Infection Control Unit, Massachusetts General Hospital, Boston, Massachusetts Division of Infectious Diseases, Massachusetts General Hospital, Boston, Massachusetts Harvard Medical School, Boston, Massachusetts
Erica S. Shenoy
Affiliation:
Infection Control Unit, Massachusetts General Hospital, Boston, Massachusetts Division of Infectious Diseases, Massachusetts General Hospital, Boston, Massachusetts Harvard Medical School, Boston, Massachusetts
John G. Guttag
Affiliation:
Electrical Engineering and Computer Science Department, Massachusetts Institute of Technology, Cambridge, Massachusetts
Jenna Wiens
Affiliation:
Division of Computer Science and Engineering, University of Michigan College of Engineering, Ann Arbor, Michigan
Maggie Makar
Affiliation:
Electrical Engineering and Computer Science Department, Massachusetts Institute of Technology, Cambridge, Massachusetts Division of Computer Science and Engineering, University of Michigan College of Engineering, Ann Arbor, Michigan
*
Author for correspondence: Meghana Kamineni, Massachusetts Institute of Technology, 77 Massachusetts Ave, Cambridge, MA 02142. E-mail: [email protected]
Get access Rights & Permissions [Opens in a new window]

Abstract

Many data-driven patient risk stratification models have not been evaluated prospectively. We performed and compared the prospective and retrospective evaluations of 2 Clostridioides difficile infection (CDI) risk-prediction models at 2 large academic health centers, and we discuss the models’ robustness to data-set shifts.

Type
Concise Communication
Information
Infection Control & Hospital Epidemiology , Volume 44 , Issue 7 , July 2023 , pp. 1163 - 1166
Check for updates
Copyright
© The Author(s), 2022. Published by Cambridge University Press on behalf of The Society for Healthcare Epidemiology of America

Access options

Get access to the full version of this content by using one of the access options below. (Log in options will check for institutional or personal access. Content may require purchase if you do not have access.)

References

Kelly, CJ, Karthikesalingam, A, Suleyman, M, et al. Key challenges for delivering clinical impact with artificial intelligence. BMC Med 2019;17:195.CrossRefGoogle ScholarPubMed
Brajer, N, Cozzi, B, Gao, M, et al. Prospective and external evaluation of a machine learning model to predict in-hospital mortality of adults at time of admission. JAMA Netw Open 2020;3:e1920733.CrossRefGoogle ScholarPubMed
Fleuren, LM, Klausch, TLT, Zwager, CL, et al. Machine learning for the prediction of sepsis: a systematic review and meta-analysis of diagnostic test accuracy. Intensive Care Med 2020;46:383–400.CrossRefGoogle ScholarPubMed
Nagendran, M, Chen, Y, Lovejoy, CA, et al. Artificial intelligence versus clinicians: systematic review of design, reporting standards, and claims of deep learning studies. BMJ 2020;368:m689.CrossRefGoogle ScholarPubMed
Finlayson, SG, Subbaswamy, A, Singh, K, et al. The clinician and dataset shift in artificial intelligence. N Engl J Med 2021;385:283–286.CrossRefGoogle ScholarPubMed
Menon, A, Perry, DA, Motyka, J, et al. Changes in the association between diagnostic testing method, polymerase chain reaction ribotype, and clinical outcomes from Clostridioides difficile infection: one institution’s experience. Clin Infect Dis 2021;73:e2883–e2889.CrossRefGoogle ScholarPubMed
Wong, A, Ötleş, E, Donnelly, JP, et al. External validation of a widely implemented proprietary sepsis prediction model in hospitalized patients. JAMA Intern Med 2021;181:1065–1070.CrossRefGoogle ScholarPubMed
Dubberke, ER, Carling, P, Carrico, R, et al. Strategies to prevent Clostridium difficile infections in acute-care hospitals: 2014 update. Infect Control Hosp Epidemiol 2014;35:628–645.CrossRefGoogle ScholarPubMed
Oh, J, Makar, M, Fusco, C, et al. A generalizable, data-driven approach to predict daily risk of Clostridium difficile infection at two large academic health centers. Infect Control Hosp Epidemiol 2018;39:425–433.CrossRefGoogle ScholarPubMed
Perry, DA, Shirley, D, Micic, D, et al. External validation and comparison of Clostridioides difficile severity scoring systems. Clin Infect Dis 2022;74:2028–2035.CrossRefGoogle ScholarPubMed
Ötleş, E, Oh, J, Li, B, et al. Mind the performance gap: examining dataset shift during prospective validation. Proceedings of the 6th Machine Learning for Healthcare Conference. PMLR 2021;149:506–534.Google Scholar
Supplementary material: File

Kamineni et al. supplementary material

Kamineni et al. supplementary material

Download Kamineni et al. supplementary material(File)
File 10.7 KB