Hostname: page-component-586b7cd67f-dlnhk Total loading time: 0 Render date: 2024-11-22T20:49:59.840Z Has data issue: false hasContentIssue false
  • English
  • Français

Comparison of PECARN, CATCH, and CHALICE clinical decision rules for pediatric head injury in the emergency department

Published online by Cambridge University Press:  02 October 2018

Mark McGraw  and
Todd Way
Mark McGraw*
Affiliation:
Memorial University of Newfoundland School of Medicine, St. John’s, NL
Todd Way
Affiliation:
Department of Emergency Medicine, Saint John Regional Hospital, St. John, NB
*
Correspondence to: Dr. Mark McGraw, Medical Education 3DS, PO Box 2100, Saint John, NB E2L 4L2; Email: [email protected]

Abstract

An abstract is not available for this content. As you have access to this content, full HTML content is provided on this page. A PDF of this content is also available in through the ‘Save PDF’ action button.

Keywords

CATCHCHALICEclinical decision rulesemergency departmenthead injuryPECARNpediatric head injurypediatrics
Type
Commentary
Information
Canadian Journal of Emergency Medicine , Volume 21 , Issue 1 , January 2019 , pp. 120 - 124
Copyright
Copyright © Canadian Association of Emergency Physicians 2018 

Clinical question: What is the diagnostic accuracy of the PECARN, CATCH, and CHALICE clinical decision rules for pediatric head injury, and are the clinical decision rules valid when applied to a novel data set?

Article chosen: Babl FE, Borland ML, Phillips N, et al. Accuracy of PECARN, CATCH, and CHALICE head injury decision rules in children: a prospective cohort study. Lancet (London, England) 2017;389(10087):2393-402.

Objectives: The primary objective of the study was to determine the diagnostic accuracy and provide external validation for the PECARN, CATCH, and CHALICE clinical decision rules in a clinically homogeneous cohort of children. The secondary objective of this study was to perform a direct comparison of the three decision rules by assessing for the presence of traumatic brain injury (TBI) on computed tomography (CT) or the requirement for neurointervention.

BACKGROUND

Head trauma is one of the most common complaints in children presenting to emergency departments (EDs), and it is estimated that over 630,000 children present to EDs annually in the United States.Reference Thurman1 Although most children presenting with a complaint of head trauma will not have a TBI, prompt neuroimaging by CT remains the gold standard in ruling out intracranial pathology. However, exposure to ionizing radiation during CT scans has been shown to increase rates of brain tumors and leukemias in children with an excess relative risk of 0.016 and 0.033 per mGy, respectively.Reference Brenner and Hall2-Reference de Gonzalez, Salotti and McHugh4 While the absolute risk is low, overall rates of CT use in pediatric head injury are estimated to be 15% in Canada and 33% in the United States, creating significant population level risks.Reference Pearce, Salotti and Little5-Reference Stanley, Hoyle and Dayan7 To prevent unnecessary exposure, standardize care, and reduce unnecessary healthcare expenditure, clinical decision rules are used to determine which patients require imaging. Prior to this study, the diagnostic accuracy of PECARN, CATCH, and CHALICE had not been directly compared or externally validated.

POPULATION STUDIED

This study enrolled all children under 18 years of age presenting to one of 10 pediatric EDs in Australia and New Zealand with head injuries of any severity. Exclusion criteria for the study were patients who presented with trivial facial injuries only, were referred from triage directly to an external provider, received neuroimaging prior to being transferred to a study site, or did not wait to be seen.

STUDY DESIGN

The study was a prospective multicentre observational study conducted in Australia and New Zealand from April 11, 2011, to November 30, 2014. Data were collected on all children that met inclusion criteria. For each rule, the authors recorded the inclusion and exclusion criteria, predictor variables, and outcome measures for each study participant. Follow-up telephone interviews were conducted with all patients in the study who did not receive neuroimaging at the time of presentation, and data were recorded for any patients with subsequent presentations resulting in neuroimaging.

Figure 1. PECARN, CATCH, and CHALICE Clinical Decision rules for pediatric head injury.

OUTCOME MEASURES

The primary outcome was the diagnostic accuracy of each clinical decision rule, according to its own rule-specific outcome: clinically significant TBI (cTBI) for PECARN, need for neurological intervention in CATCH, and clinically significant intracranial injury in CHALICE. The secondary outcome of the study was a comparison of the ability of each rule to predict a standardized outcome of cTBI in a homogeneous cohort of children.

RESULTS

During the study period, 29,433 patients under age 18 presented with head injuries to the participating EDs, and 20,137 were eligible for analysis. The mean age was 5.7 years, 63.7% were male, and 95.4% of the patients presented with a Glasgow Coma Scale of 15. The most common mechanism of injury was a fall (70.1%), and the most common symptoms were headache (20.5%), vomiting (17.1%), or witnessed disorientation (14.6%); 2,106 (10%) patients received a CT scan, 4,544 (23%) were admitted to a hospital (inpatient ward, short-stay ward, or intensive care unit), 83 (<1%) received neurosurgery, and 15 (<1%) died.

PECARN criteria were applicable for 4,011 children under age 2 years and 11,152 patients over age 2 years. Criteria were positive for 1,872 children under age 2 years, 42 of whom had cTBI, and there were no missed cases of cTBI in this group. In the PECARN group over age 2 years, 6,084 children met the criteria, and 117 had cTBI. One study participant with cTBI was missed in the PECARN group over 2 years of age. The missed patient had signs of a basilar skull fracture and would have been positive in the CHALICE criteria but also missed in CATCH.

High-risk criteria for CATCH were applicable in 4,957 patients, and 799 of the patients had a positive decision rule. Neurological intervention was required for 20 patients who were positive for the rule and 1 patient negative for the rule. Combined high- and medium-risk criteria from CATCH were also applicable for 4,957 patients, and 2,225 were positive for the combined criteria. Brain injury on CT was found in 125 patients who were screened positive for the rule and 16 who were screened negative and were missed.

CHALICE criteria were applicable for 20,029 patients in the study, with 4,673 patients screening positive for the criteria. Clinically significant intracranial injury occurred in 370 of the patients who were positive for the rule and 31 patients were negative for the rule, two of whom required neurosurgery.

The diagnostic accuracy of the rules is given in Table 1. PECARN had the highest sensitivity of the three rules at 100.0% and 99.0% for children ages <2 years and ≥2 years, respectively.

Table 1. Diagnostic accuracy of PECARN, CATCH, and CHALICE clinical decision rules using rule-specific criteria and outcomes for children presenting to the emergency department with a mild head injury

CT=computed tomography; NPV=negative predictive value; PPV=positive predictive value.

Results of the secondary outcome for the study are given in Table 2. PECARN missed the fewest patients and had the highest sensitivity overall; however, confidence intervals on all three rules overlapped, indicating that none of the rules were superior in this cohort.

Table 2. Summary of the secondary outcomes assessing the diagnostic accuracy of PECARN, CATCH, and CHALICE clinical decision rules in determining clinically important TBI, TBI on CT, and the requirement for neurosurgery

CI=confidence interval; CT=computed tomography; TBI=traumatic brain injury.

Validity of results

This study was a large prospective multicentre observational study with a robust design, clear selection criteria, and appropriate power to provide external validation of the rules. The study was not designed to compare the rules statistically, because the three rules have fundamentally different end points: PECARN was designed to identify children at very low risk of cTBI who do not require a CT, whereas CHALICE and CATCH were designed to identify children at high risk who would benefit from the use of a CT scan.

Objections to the direct comparison of the rules due to the difference in their outcomes were published in a subsequent issue of The Lancet from the authors of CATCH and PECARN.Reference Osmond8, Reference Kuppermann, Holmes and Dayan9 The authors of this study acknowledge this discrepancy but suggest that the results of the study are clinically relevant as they address the pragmatic question of what clinical decision rule a physician should use to determine whether a pediatric patient presenting with a head injury requires a CT.Reference Babl, Oakley and Borland10 The authors used a reasonable approach to objectively compare the rules by ensuring that data were collected to appropriately evaluate each rule and that follow-up was sufficient. Despite the difference in their intended use, the direct comparison of the diagnostic accuracies amongst the rules on a novel data set compiled using each rules inclusion and exclusion criteria, predictor variables, and outcomes still provides clinicians with clinically relevant information.

COMMENTARY

All three rules had excellent sensitivities and performed well in assessing the secondary outcome of cTBI, suggesting that all were appropriate for use in assessing mild head injury in the ED. However, application of the rules to the study participants would have resulted in large differences in CT rates for patients. The baseline rate for CT in this study was 8.3%. Application of the CHALICE or CATCH rules would have resulted in an adjusted CT rate of 22.0% or 30.2%, an increase of 165.1% to 263.9%, respectively. Unfortunately, determining the rates of CT use by a retrospective application of PECARN criteria is not possible. However, preliminary studies assessing the impact of implementing PECARN criteria on CT rates have demonstrated reduced rates, in centres with high baseline CT rates, or stable rates in centres with baseline CT rates below 10%.Reference Bressan, Romanato and Mion11-Reference Nigrovic, Stack and Mannix14 It is suggested that the reduced rates are linked to the rules inclusion of an option for physician observation in the ED, which has been shown independently to reduce CT rates without worsening outcomes for patients.Reference Schonfeld, Fitz and Nigrovic15

CONCLUSION

The results of this study provide external validation of the PECARN, CATCH, and CHALICE clinical decision rules. Application of the PECARN clinical decision rule resulted in the fewest missed patients with cTBI. The analysis of the comparison cohort suggests that the PECARN rule had a higher sensitivity for identifying cTBI; however, the 95% confidence intervals of all three rules overlapped, and none could be deemed superior.

Competing interests

None declared.

References

REFERENCES

1.Thurman, DJ. The epidemiology of traumatic brain injury in children and youths: a review of research since 1990. J Child Neurol 2016;31(1):20-27.Google Scholar
2.Brenner, DJ, Hall, EJ. Computed tomography – an increasing source of radiation exposure. N Engl J Med 2007;357(22):2277-2284.Google Scholar
3.Brenner, DJ. Estimating cancer risks from pediatric CT: going from the qualitative to the quantitative. Pediatr Radiol 2002;32(4):228-231.Google Scholar
4.de Gonzalez, AB, Salotti, JA, McHugh, K, et al. Relationship between paediatric CT scans and subsequent risk of leukaemia and brain tumours: assessment of the impact of underlying conditions. Br J Cancer 2016;114:388.Google Scholar
5.Pearce, MS, Salotti, JA, Little, MP, et al. Radiation exposure from CT scans in childhood and subsequent risk of leukaemia and brain tumours: a retrospective cohort study. Lancet 2012;380(9840):499-505.Google Scholar
6.Klassen, TP, Reed, MH, Stiell, IG, et al. Variation in utilization of computed tomography scanning for the investigation of minor head trauma in children: a Canadian experience. Acad Emerg Med 2008;7(7):739-744.Google Scholar
7.Stanley, RM, Hoyle, JD, Dayan, PS, et al. Emergency department practice variation in computed tomography use for children with minor blunt head trauma. J Pediatr 2014;165(6):1201-6.e2.Google Scholar
8.Osmond, MH. Head injury decision rules in children. Lancet 2017;390(10101):11487.Google Scholar
9.Kuppermann, N, Holmes, JF, Dayan, PS. Head injury decision rules in children. Lancet 2017;390(10101):1487-1488.Google Scholar
10.Babl, FE, Oakley, E, Borland, ML, et al. Head injury decision rules in children – authors’ reply. Lancet 2017;390(10101):1488.Google Scholar
11.Bressan, S, Romanato, S, Mion, T, et al. Implementation of adapted PECARN decision rule for children with minor head injury in the pediatric emergency department. Acad Emerg Med 2012;19(7):801-807.Google Scholar
12.Lorton, F, Poullaouec, C, Legallais, E, et al. Validation of the PECARN clinical decision rule for children with minor head trauma: a French multicenter prospective study. Scand J Trauma Resusc Emerg Med 2016;24(1):98.Google Scholar
13.Ide, K, Uematsu, S, Tetsuhara, K, et al. External validation of the PECARN head trauma prediction rules in Japan. Acad Emerg Med 2017;24(3):308-314.Google Scholar
14.Nigrovic, LE, Stack, AM, Mannix, RC, et al. Quality improvement effort to reduce cranial CTs for children with minor blunt head trauma. Pediatrics 2015;136:e227.Google Scholar
15.Schonfeld, D, Fitz, BM, Nigrovic, LE. Effect of the duration of emergency department observation on computed tomography use in children with minor blunt head trauma. Ann Emerg Med 2013;62(6):597-603.Google Scholar
Figure 0

Figure 1. PECARN, CATCH, and CHALICE Clinical Decision rules for pediatric head injury.

Figure 1

Table 1. Diagnostic accuracy of PECARN, CATCH, and CHALICE clinical decision rules using rule-specific criteria and outcomes for children presenting to the emergency department with a mild head injury

Figure 2

Table 2. Summary of the secondary outcomes assessing the diagnostic accuracy of PECARN, CATCH, and CHALICE clinical decision rules in determining clinically important TBI, TBI on CT, and the requirement for neurosurgery