Hostname: page-component-586b7cd67f-2plfb Total loading time: 0 Render date: 2024-11-21T19:11:25.359Z Has data issue: false hasContentIssue false

A one-year hospital system review of plasma next-generation sequencing in a mixed population

Published online by Cambridge University Press:  19 November 2024

Ty C. Drake*
Affiliation:
Memorial Hermann –Texas Medical Center, Houston, TX, USA
Jessica Babic
Affiliation:
Memorial Hermann –Texas Medical Center, Houston, TX, USA
Audrey Wanger
Affiliation:
Department of Pathology and Laboratory Medicine, The University of Texas Health Science Center at Houston, Houston, TX, USA
Violeta Chavez
Affiliation:
Department of Pathology and Laboratory Medicine, The University of Texas Health Science Center at Houston, Houston, TX, USA
*
Corresponding author: Ty C. Drake; Email: [email protected]

Abstract

Objective:

To describe the use of plasma next-generation sequencing (NGS) and determine if it provided additional information from routine tests or lead to change in antimicrobial management.

Design and Setting:

This retrospective cohort study evaluated patients with a NGS test performed who were admitted to a hospital health system in the greater Houston area between May 2022 and May 2023.

Patients:

In total, 143 NGS tests were ordered in the span of one year for 135 unique patients. Most patients were ≥ 18 years (74.1%), White/Caucasian (43.7%), male (61.5%), and immunocompetent (54.1%). Eight patients had repeat tests during the study period, four being after an initial rejected test, and the rest being greater than 7 days from the initial test.

Results:

Of the 139 NGS tests performed, 56 (40%) were positive. When compared to routine testing, 49 (35%) were negative when routine testing was negative, 15 (11%) positive were concordant with routine testing, 29 (21%) positive were discordant from routine testing, 17 (12%) negative while routine testing was positive, and 29 (21%) were positive while routine testing was negative. Documented changes in antimicrobial due to NGS occurred after 16 (13.6%) tests, with the majority of these changes occurring in immunocompromised patients (14/16 [88%]).

Conclusions:

NGS provided additional data when compared to routine testing but rarely resulted in antimicrobial changes. The majority of changes occurred in immunocompromised patients. Diagnostic stewardship is a vital component for this type of NGS testing and others in which guidelines do not exist.

Type
Original Article
Creative Commons
Creative Common License - CCCreative Common License - BY
This is an Open Access article, distributed under the terms of the Creative Commons Attribution licence (https://creativecommons.org/licenses/by/4.0/), which permits unrestricted re-use, distribution and reproduction, provided the original article is properly cited.
Copyright
© The Author(s), 2024. Published by Cambridge University Press on behalf of The Society for Healthcare Epidemiology of America

Introduction

Clinical microbiology is a science that continues to be vital in the diagnosis of infectious disease (ID). The interpretation in microbiology depends on the quality and type of specimens submitted for analysis. The IDSA and ASM guideline for utilization of microbiology describes the types of samples and testing that aid physicians in quickly and accurately diagnosing ID in their patient. Reference Miller, Binnicker and Campbell1 Although culture and serology remain the gold standard for most ID diagnoses, molecular testing has made significant strides in respiratory and sexually transmitted infections. Reference Muralidhar2 The advent of molecular diagnostics and more recently, plasma microbial cell-free DNA (mcfDNA) next-generation sequencing (NGS) has become a coveted method for rapid results. A recently available test uses mcfDNA NGS from plasma to identify potential pathogenic organisms (The Karius Test®, Karius Inc., Redwood City, CA). This test is marketed as a non-invasive rapid detection test for 1,250 clinically relevant bacteria, viruses, fungi, and eukaryotic parasites and recently has added genetic resistance markers to their panel. 3

The cost of NGS is high and currently not reimbursed by Centers for Medicare and Medicaid Services (CMS). The Karius Test® is currently designated as a Breakthrough Device by the US Food and Drug Admiration (FDA) for immunocompromised patients with suspected lung infections. Karius utilizes proprietary algorithm used to provide the number of organisms present in the patient sample that is above a certain threshold. Metagenomic sequencing, employed in shotgun diagnostics, faces substantial challenges primarily revolving around high costs and limited clinical significance. Shotgun diagnostics can yield vast amounts of information, but distinguishing between pathogenic and commensal organisms, as well as discerning their roles in disease, presents an ongoing challenge. This lack of specificity hampers the translation of metagenomic sequencing results into actionable clinical insights, limiting its current utility in routine diagnostics where cost-effectiveness and meaningful clinical interpretation are paramount.

The goals of this retrospective analysis is to describe the use of plasma NGS and determine if it provided additional information from routine tests or lead to change in antimicrobial management.

Methods

This retrospective cohort study was performed at an 11-hospital health system in the greater Houston area in hospitalized patients for whom NGS was ordered between May 2022 and May 2023. Repeat tests on the same patient were included if ordered greater than 7 days from previous test. Tests that did not result due to an inadequate sample were excluded.

NGS was ordered via a downtime form based on institutional criteria, which included (1) ordered by an ID physician and (2) discussed with an ID pharmacist and/or a medical microbiologist prior to sending. NGS testing was limited to patients with negative routine testing for at least 48 hours, in addition to other criteria listed in Supplemental Table 1. Plasma was collected by the hospital staff and sent to the laboratory for testing. The plasma NGS testing used in this study was the Karius Test® (Karius Inc., Redwood City, CA).

Data elements including patient demographics, routine testing, and antibiotic changes were collected via retrospective chart review. Patients were considered immunocompromised if diagnosed as having human immunodeficiency virus (HIV), a solid organ transplant, active malignant tumor, or actively on immunosuppressive therapy. Routine testing included cerebrospinal fluid, blood, respiratory, and wound cultures. Additionally, singular viral PCR testing from the aforementioned sites were included. Biopsies sent for broad range sequencing were also analyzed within a 7-day period. Serologies (eg, EBV, CMV, Rickettsia, Brucella) were also included as routine studies. Yeast species were only identified if from a sterile site or requested by treating team. Enterococcus species were only identified if from blood or requested by treating team. Results were considered concordant for these organisms if NGS detected any species and routine testing did not provide species identification.

Antimicrobial changes were considered directly attributable to the NGS test if the treating team documented in electronic health record that antimicrobial change was made due to NGS testing result.

This intuitional review board of the University of Texas Health Science Center at Houston and Memorial Hermann Hospital (HSC-MS-0920) approved this study.

Results

A total of 143 tests were performed in 135 patient encounters during the study period. Four samples were rejected from processing due to receipt later than 4 days and not meeting internal quality control standards. Eight patients had repeat tests during the study period, four being after an initial rejected test, and the rest being greater than 7 days apart from the initial test.

Most patients were adults (74.1%), White/Caucasian (43.7%), and male (61.5%). Furthermore, 45.9% patients were immunocompromised: 28 patients with solid organ transplant, 8 patients with malignant tumor, 7 patients with HIV/AIDS, and 19 with other immunocompromising conditions (Table 1). Despite institutional testing criteria limiting NGS testing to IDs physicians and in patients with negative routine testing for at least 48 hours, there were 11% (5/134) ordered by non-ID providers and 13% (7/134) within 2 days of admission.

Table 1. Patient encounter demographics

Of the 139 tests completed, 73 were positive for at least one organism. Thirty one were positive for more than one organism (Table 2). The diversity of microorganisms identified were the following: 31 gram-positives, 28 gram-negatives, 23 anaerobes, 5 atypical, 14 fungi, and 32 viruses (Supplemental Table 2).

Table 2. NGS test characteristics

In total, NGS identified 92 additional organisms (65 bacterial, 19 viral, and 8 fungal) but did not identify 48 organisms that were confirmed from routine microbiological testing (30 bacterial, 11 viral, 6 fungal, and 1 parasite). NGS was concordant for 39 organisms (22 bacterial, 13 viral, and 6 fungal) when compared to routine testing (Supplemental Table 3). When comparing each test, 49 NGS samples were negative when routine testing was also negative, 15 positive results were concordant with routine testing, 29 positive results were discordant from routine testing, with 11 being completely discordant, 17 were negative while routine testing had a positive result, and 29 were positive while other testing was negative (Table 3). Concordant results are based on all organisms matching when comparing NGS results and routine testing. Each NGS test and corresponding routine testing can reviewed in Supplemental Tables 69.

Table 3. NGS versus routine tests organism concordance

*Based on at least one mismatched organism. Additional organisms were not included in calculations.

Out of the 139 tests, 52 had antibiotics changed within 2 days of the NGS result being reported. Sixteen of these changes were directly attributed to the NGS result (9 escalations and 7 de-escalations), with the majority of these changes occurring in immunocompromised patients (14/16, 88%) (Table 4).

Table 4. Antimicrobial changes

Discussion

Plasma NGS demonstrated limited benefit in our patient population. It is difficult to ascertain which patients would benefit most consistently from NGS, as there was no apparent pattern to the patients who had positive results, nor did the result of NGS change therapy in most cases. However, there does appear to be a lower threshold to change therapy based on NGS in immunocompromised patients. Testing at will with no additional criteria is likely not appropriate and should not replace a thorough history and physical by the clinician. Reference Davis4

Thirty-seven percent of tests had antimicrobial changes within 2 days, with only a third of these being documented due to NGS. Although the impact of NGS varies significantly in current literature (7% to 56% Reference Morales5 ), our findings appear to be inline with others’ experiences. Determination of NGS impact varies greatly among studies, mostly being based on clinical judgment. NGS uses a shotgun approach for detecting organisms, making it hard to determine commensal organisms versus pathogenic. It is up to the treating physician to determine if therapy should be changed based off of the NGS results and patient presentation. Recent literature has made an attempt to standardize criteria for clinical impact of NGS Reference Hogan, Yang and Garner6 but still relies heavily on clinical judgment.

There was little correlation found between NGS and routine culture concordance or discordance with antimicrobial changes. Fifty percent of antimicrobial changes due to NGS were when we already had positive cultures of these, 3 NGS results were completely discordant with routine testing. These results offer little insight into understanding the number of organisms which appear in the NGS versus regular culture. Presumably, molecular testing is more sensitive; however, with different results in culture and NGS, the question becomes whether the NGS testing is sensitive enough to determine infectious causes. Furthermore, when a possible pathogen is identified it can be hard to direct therapy given no susceptibilities are available. In one case, NGS identified Pseudomonas aeruginosa and the patient was originally started on meropenem; however, once the cultures grew, the susceptibilities showed resistance to meropenem. The most recent panel released by NGS will now provide some antimicrobial resistance data, potentially reducing inappropriate therapy in the future for select organisms.

Clouding the picture further, a negative NGS result does not guarantee the absence of infection. In this review, 17 patients (12%) had pathogens on routine testing which were not identified by the NGS (Table 3), suggesting that NGS testing may not be a suitable method to “rule out” infectious causes. This was not isolated to our review. Similarly, Bergin et al. found that the addition of NGS in immunocompromised patients with pneumonia identified a potential pathogen in 21 more patients compared to usual care but failed to identify similar pathogens compared to usual care in 25 patients. Reference Bergin, Chemaly and Dadwal7 A point to remember is that NGS results may have a number of organisms that will appear in the analytical results, though only the organisms recorded above a proprietary threshold will be reported in the patient result. In cases where the physician is concerned about an organism, a call to the company can lead to a conversation about other organisms present which did not exceed the infection threshold. In addition, the list of organisms that NGS is currently capable of detecting is not exhaustive. One deceased patient had a blood sample taken for NGS testing 2 days prior to death. The autopsy revealed that the immediate cause of death was aortic root rupture secondary to aortic valve replacement with disseminated fungal disease. The Formalin-Fixed Paraffin-Embedded blocks from autopsy were sent for sequencing and revealed that the organism causing the infection was an Exerohilum spp., which this NGS currently does not identify.

Although there are short comings to NGS testing, there are instances in which NGS test resulted in an organism that was not and likely would not have been identified or would have resulted in delayed treatment with current available testing. In one case, NGS testing revealed a Legionella longbeachae which did cause a change in therapy. This organism is not easily culturable and would not have been identified in other routine studies. In another case, the identification of a Mycobacterium abscessus from a pediatric patient with a tooth abscess was detected 4 days prior to AFB gram stain. Torque teno virus, which has no commercial diagnostic test, has popped up on the radar in the clinical laboratory with NGS. It has been associated with liver disease, though it has also been found in healthy individuals. Reference Webb, Rakibuzzaman and Ramamoorthy8

Although our study attempted to be as objective as possible, by only looking at the antimicrobial changes and discordance between routine tests, there are some limitations to this. First, we are unable to capture any possible potential advantages and disadvantages to using NGS testing. For example, avoidance of and/or unnecessary further diagnostic evaluation prompted by NGS. Second, we only looked at cultures collected within a 7-day window before or after the NGS test. Although this gives us an accurate representation of potential clinical status around the time of NGS, there were likely organisms that were present when NGS was collected that were not identified by routine tests during this time frame. Lastly, this review was limited greatly by chart documentation and ordering of NGS via a downtime form. Documentation surrounding reason for ordering and result utilization are limited, and ordering criteria was loosely followed, creating a more heterogeneous patient population outside of the institutional criteria.

There is no doubt that novel results from case studies are impressive. Reference Caldararo, Algazaq and Schmidt9Reference Kalyatanda, Rand and Lindner11 However, it is difficult to ascertain when NGS testing should be utilized, and it is unrealistic to utilize on all patients when the culprit of infection is unidentifiable by routine methods due to cost. As NGS becomes prominent and referenced as a potential diagnosis option in guidelines, a consensus-driven guidance would be helpful. Reference Fowler, Durack and Selton-Suty12 However, based on the multiple published multi-center accounts, there does not appear to be a clear-cut population that would benefit from routine NGS testing. Reference Hogan, Yang and Garner6,Reference Bell13Reference Wilson, Sample and Zorn15 A continuous diagnostic stewardship program is prudent as the cost of NGS is high and does not often provide conclusive diagnostic results.

Supplementary material

The supplementary material for this article can be found at https://doi.org/10.1017/ash.2024.460.

Acknowledgments

None.

Financial support

None.

Competing interests

None.

Research transparency and reproducibility

None.

References

Miller, JM, Binnicker, MJ, Campbell, S, et al. A guide to utilization of the microbiology laboratory for diagnosis of infectious diseases: 2018 update by the infectious diseases society of America and the American society for microbiology. Clin Infect Dis 2018;67:813816. doi: 10.1093/cid/ciy584 CrossRefGoogle Scholar
Muralidhar, S. Molecular methods in the laboratory diagnosis of sexually transmitted infections. Indian J Sex Transm Dis AIDS 2015;36:917. doi: 10.4103/0253-7184.156686 CrossRefGoogle ScholarPubMed
Karius. Karius test, https://kariusdx.com/. Accessed July 31, 2024.Google Scholar
Davis, JLMJ. History and Physical Examination. 2 ed. Murray and Nadel’s Textbook of Respiratory Medicine; 2016. 263277.Google Scholar
Morales, M. The next big thing? Next-generation sequencing of microbial cell-free DNA using the Karius test. Clin Microbiol Newsl 2021;43:6980.CrossRefGoogle Scholar
Hogan, CA, Yang, S, Garner, OB, et al. Clinical impact of metagenomic next-generation sequencing of plasma cell-free DNA for the diagnosis of infectious diseases: a multicenter retrospective cohort study. Clin Infect Dis 2021;72:239245. doi: 10.1093/cid/ciaa035 CrossRefGoogle ScholarPubMed
Bergin, SP, Chemaly, RF, Dadwal, SS, et al. Plasma microbial cell-free DNA sequencing in immunocompromised patients with pneumonia: a prospective observational study. Clin Infect Dis 2024;78:775784. doi: 10.1093/cid/ciad599 CrossRefGoogle ScholarPubMed
Webb, B, Rakibuzzaman, A, Ramamoorthy, S. Torque teno viruses in health and disease. Virus Res 2020;285:198013. doi: 10.1016/j.virusres.2020.198013 CrossRefGoogle ScholarPubMed
Caldararo, M, Algazaq, J, Schmidt, E, et al. Atypical pathogens presenting with pulmonary consolidations detected by cell-free DNA next-generation sequencing in patients with hematologic malignancies. Infect Dis Clin Pract 2022;30(2):e1101. doi: 10.1097/ipc.0000000000001101 CrossRefGoogle ScholarPubMed
Downey, RD, Russo, SM, Hauger, SB, et al. Identification of an emergent pathogen, bartonella vinsonii, using next-generation sequencing in a patient with culture-negative endocarditis. J Pediatric Infect Dis Soc 2021;10:213216. doi: 10.1093/jpids/piaa014 CrossRefGoogle Scholar
Kalyatanda, G, Rand, K, Lindner, MS, et al. Rapid, noninvasive diagnosis of balamuthia mandrillaris encephalitis by a plasma-based next-generation sequencing test. Open Forum Infect Dis 2020;7:ofaa189. doi: 10.1093/ofid/ofaa189 CrossRefGoogle ScholarPubMed
Fowler, VG, Durack, DT, Selton-Suty, C, et al. The 2023 duke-international society for cardiovascular infectious diseases criteria for infective endocarditis: updating the modified duke criteria. Clin Infect Dis 2023;77:518526. doi: 10.1093/cid/ciad271 CrossRefGoogle ScholarPubMed
Bell, DT. Deciphering the potential of plasma cell-free metagenomic next-generation sequencing using the Karius test. Curr Opin Infect Dis 2023;36:420425. doi: 10.1097/QCO.0000000000000942 CrossRefGoogle ScholarPubMed
Francisco, DMA, Woc-Colburn, L, Carlson, TJ, Lasco, T, Barrett, M, Al Mohajer, M. The effect of a plasma next-generation sequencing test on antimicrobial management in immunocompetent and immunocompromised patients-A single-center retrospective study. Antimicrob Steward Healthc Epidemiol 2023;3:e31. doi: 10.1017/ash.2022.356 CrossRefGoogle ScholarPubMed
Wilson, MR, Sample, HA, Zorn, KC, et al. Clinical metagenomic sequencing for diagnosis of meningitis and encephalitis. N Engl J Med 2019;380:23272340. doi: 10.1056/NEJMoa1803396 CrossRefGoogle Scholar
Figure 0

Table 1. Patient encounter demographics

Figure 1

Table 2. NGS test characteristics

Figure 2

Table 3. NGS versus routine tests organism concordance

Figure 3

Table 4. Antimicrobial changes

Supplementary material: File

Drake et al. supplementary material

Drake et al. supplementary material
Download Drake et al. supplementary material(File)
File 52.6 KB