Hostname: page-component-cd9895bd7-dzt6s Total loading time: 0 Render date: 2024-12-24T12:30:07.615Z Has data issue: false hasContentIssue false

Screening for Cognitive Impairment, Being Cognizant of the Liminal Deities and Demons

Published online by Cambridge University Press:  10 July 2020

Chetan Vekhande
Affiliation:
Division of Neurology, Department of Medicine, University of Alberta, Edmonton, Canada
Bei Jiang
Affiliation:
Department of Mathematical and Statistical Sciences, University of Alberta, Edmonton, Canada
Mahesh Kate*
Affiliation:
Department of Neurosciences, Alberta Health Services, Edmonton, Canada
*
Correspondence to: Mahesh Kate, Neurologist, Alberta Health Services, 1T1-14, OPR, UAH, 8440 112 St NW, EdmontonABT6G2B7, Canada. Email: [email protected]
Rights & Permissions [Opens in a new window]

Abstract

Type
Editorial
Copyright
Copyright © The Author(s), 2020. Published by Cambridge University Press on behalf of The Canadian Journal of Neurological Sciences Inc.

In patients with transient ischemic attack (TIA) and minor stroke, one in five patients have persistent cognitive impairment (CI) at 3 months. Reference Sivakumar, Kate, Jeerakathil, Camicioli, Buck and Butcher1 This proportion may reach up to 60% in patients with moderate to severe stroke and multiple associated vascular comorbidities. According to the latest estimates, there are 405,000 individuals in Canada experiencing the effects of stroke, Reference Krueger, Koot, Hall, O’Callaghan, Bayley and Corbett2 and with the most conservative approximation, a total of 100,000 may be having CIs of varying grades, some diagnosed and treated, others are not. Furthermore, Vascular CI may be progressive and invariably affects recovery from stroke in a multifactorial process. Canadian Stroke Best Practices recommendation suggests that all patients with TIA and Stroke should be considered high risk for CI and may be screened with a standardised test like Montreal Cognitive Assessment (MoCA). Reference Lanctôt, Lindsay, Smith, Sahlas, Foley and Gubitz3 MoCA is continuous 30 points scale devised to screen mild CI. The proposed cut-off values for diagnosis of vascular dementia (16.5–24) and vascular mild CI (26–27) have been variable with varying sensitivities (77%–92%). Reference Ghafar, Miptah and O’Caoimh4 The specificity of MoCA for diagnosing vascular dementia is higher >90% compared to diagnosing vascular mild CI < 80%. Lack of uniform threshold value and equivocal clinical validity is an obstacle in consistent implementation of a cognitive screening tool in patients with TIA and stroke. Reference Quinn, Elliott and Langhorne5

Zaidi et al. Reference Zaidi, Rich, Sunderland, Binns and Truong6 propose a novel approach with differential tiering of cut-off value for MoCA and sequential additional cognition speed processing testing for accurate categorisation of patients with possible vascular CI. A total of 161 patients after median of 11 months after an index event, with a mean ± standard deviation (SD) of 14.6 ± 2.9 years of education and MoCA score >18, were recruited. A >1.5 SD variation from normative data in multidomain neuropsychological assessment scores was considered as the gold standard for diagnosis of vascular CI. The authors derive a tiered cut-off values for low probability of CI (>27), high probability of CI (<24), and indeterminate probability of CI (24–27). Patients with indeterminate probability were further categorised with symbol digit modalities test (SDMT), coding score, and learning score. This approach led to accurate classification of 79% of patients across the entire sample. This indeed is an incremental step bolstering the utility of cognitive screening tool thus leading to early diagnosis with detailed assessment. However, this is a very selective group of patients, which may affect reproducibility of results, and one in five patients can still be misclassified thus preventing appropriate referral and management.

The approach described in the article has improved the discriminant function of MoCA but has brought forth important shortcomings of using frequentist binary approach. Application of cut-off values makes screening tools easy to use in the clinic; nevertheless, it has an inherent fallacy of having false positive and false negative allocations. This is further compounded due to “reference standard bias” which assumes that the neuropsychological assessment is gold standard which is far from truth. Reference Lu, Dendukuri, Schiller and Joseph7 A clinical diagnosis with multidomain neuropsychological assessment may have a wide range of sensitivity from 39%–98% and specificity from 33%–100% compared to neuropathological diagnosis of Alzheimer’s disease with strong negative correlation (−0.79). Reference Wollman and Prohovnik8 This is contrary to our presumption that gold standard test has a 100% sensitivity and 100% specificity, thus making a trade-off of imperfect reference test and effect thereof. The second issue is assumption of “conditional independence” of two tests that the diagnostic error due to the imperfect – reference test is independent of the diagnostic test being assessed. Reference García Barrado, Coart and Burzykowski9 MoCA, SDMT, and neuropsychological assessment apply similar principles of multidomain cognitive testing and hence are not independent tests. A possible example of independent test would be imaging- or blood-based biomarker. The two issues discussed above can be partially mitigated when the sensitivity and specificity of imperfect reference standard (like neuropsychological test) are known, with help of “correction methods.” Reference Chikere, Wilson, Graziadio, Vale and Allen10

A pragmatic approach would be to use Bayesian rules (applying the knowledge of pre-test probability, likelihood ratio, and post-test probability) as an extension to the proposed scoring system by Zaidi et al. Reference Zaidi, Rich, Sunderland, Binns and Truong6 for classification of stroke patients with CI. Reference Brush, Lee, Sherbino, Taylor-Fishwick and Norman11 The pre-test probability of patients attending the stroke clinic having CI is modified by the presence of clinical (increasing age, severe neurological deficits at baseline, presence of delirium, aphasia, neurological comorbidities like epilepsy and mental health issues) and imaging variables (infarct volume and markers of small vessel disease, perivascular spaces, microbleeds, brain atrophy, and white matter hyperintensities) (Figure 1). Reference Sivakumar, Riaz, Kate, Jeerakathil, Beaulieu and Buck12 Presence and progression of white matter hyperintensity on magnetic resonance imaging increases the odds of CI by 1.9 times and 6 times, respectively. Reference Sivakumar, Riaz, Kate, Jeerakathil, Beaulieu and Buck12,Reference Jiménez-Balado, Riba-Llena, Abril, Garde, Penalba and Ostos13 Once we have a pre-test probability, subsequently the positive and negative likelihood ratio of MoCA with three-tiered score to classify low or high probability of CI (5.4 and 0.18, respectively) can guide the trajectory of post-test probability. In the indeterminate group, addition of SDMT, coding and learning scores further improve the classification to high or low probability of CI. Further research is needed to quantify the magnitude and interaction of clinical and imaging modifiers with the cognitive screening tools.

Figure 1: Effect of small vessel disease burden on prior (pre-test) probability and posterior (post-test) probability for cognitive screening tool. (A) In patients without small vessel disease, the likelihood of high and low probability of cognitive impairment is symmetrical; it is governed by the test characteristics alone. A three-tiered approach would be appropriate. (B) In patients with varying small vessel disease burden, the likelihood of high and low probability of cognitive impairment is asymmetrical. A negative test (high scores in Montreal Cognitive Assessment) is less likely associated with low probability of cognitive impairment due to good cognitive and brain reserve.

To conclude, universal cognitive assessment in patients with stroke, TIA, and covert stroke with a rapid screening test like MoCA, SDMT in a tiered pattern is feasible and aids early diagnosis and treatment. However, the screening must be administered with a Bayesian approach with anchoring and adjusting heuristics to determine accurate pre-test probability and thus maximise post-test probability for appropriate classification of CI. Even if the patient is categorised as low probability of CI due to high scores of the screening tool, if the pre-test probability for CI is high, they should be referred for detailed cognitive evaluation so the chances of misclassification are reduced.

Disclosures

The authors have no conflicts of interest to declare.

Statement of Authorship

CV, drafted manuscript, review of literature; BJ, critical review and revision of the manuscript, review of literature, analysis; MK, concept critical review and revision, analysis, figure, review of literature review.

References

Sivakumar, L, Kate, M, Jeerakathil, T, Camicioli, R, Buck, B, Butcher, K. Serial Montreal cognitive assessments demonstrate reversible cognitive impairment in patients with acute transient ischemic attack and minor stroke. Stroke. 2014;45:1709–15.CrossRefGoogle ScholarPubMed
Krueger, H, Koot, J, Hall, RE, O’Callaghan, C, Bayley, M, Corbett, D. Prevalence of individuals experiencing the effects of stroke in Canada: trends and projections. Stroke. 2015;46:2226–31.CrossRefGoogle ScholarPubMed
Lanctôt, KL, Lindsay, MP, Smith, EE, Sahlas, DJ, Foley, N, Gubitz, G, et al. Canadian stroke best practice recommendations: mood, cognition and fatigue following Stroke, 6th edition update 2019. Int J Stroke. 2019;121.Google ScholarPubMed
Ghafar, MZAA, Miptah, HN, O’Caoimh, R. Cognitive screening instruments to identify vascular cognitive impairment: a systematic review. Int J Geriatr Psychiatry. 2019;34:1114–27.CrossRefGoogle ScholarPubMed
Quinn, TJ, Elliott, E, Langhorne, P. Cognitive and mood assessment tools for use in stroke. Stroke. 2018;49:483–90.CrossRefGoogle ScholarPubMed
Zaidi, K-H, Rich, JB, Sunderland, KM, Binns, MA, Truong, L, et al. Methods for improving screening for vascular cognitive impairment using the Montreal Cognitive Assessment. Can J Neurol Sci. 2020. doi: 10.1017/cjn.2020.121 CrossRefGoogle ScholarPubMed
Lu, Y, Dendukuri, N, Schiller, I, Joseph, L. A Bayesian approach to simultaneously adjusting for verification and reference standard bias in diagnostic test studies. Stat Med. 2010;29:2532–43.CrossRefGoogle ScholarPubMed
Wollman, DE, Prohovnik, I. Sensitivity and specificity of neuroimaging for the diagnosis of Alzheimer’s disease. Dialogues Clin Neurosci. 2003;5:8999.Google ScholarPubMed
García Barrado, L, Coart, E, Burzykowski, T. Estimation of diagnostic accuracy of a combination of continuous biomarkers allowing for conditional dependence between the biomarkers and the imperfect reference-test. Biometrics. 2017;73:646–55.CrossRefGoogle ScholarPubMed
Chikere, CMU, Wilson, K, Graziadio, S, Vale, L, Allen, AJ. Diagnostic test evaluation methodology: a systematic review of methods employed to evaluate diagnostic tests in the absence of gold standard - an update. PLoS One. 2019;14:125.Google Scholar
Brush, JE, Lee, M, Sherbino, J, Taylor-Fishwick, JC, Norman, G. Effect of teaching Bayesian methods using learning by concept vs learning by example on medical students‘ ability to estimate probability of a diagnosis: a randomized clinical trial. JAMA Netw Open. 2019;2:e1918023.10.1001/jamanetworkopen.2019.18023CrossRefGoogle ScholarPubMed
Sivakumar, L, Riaz, P, Kate, M, Jeerakathil, T, Beaulieu, C, Buck, B, et al. White matter hyperintensity volume predicts persistent cognitive impairment in transient ischemic attack and minor stroke. Int J Stroke. 2017;12:264–72.Google ScholarPubMed
Jiménez-Balado, J, Riba-Llena, I, Abril, O, Garde, E, Penalba, A, Ostos, E et al. Cognitive impact of cerebral small vessel disease changes in patients with hypertension. Hypertension. 2019;73:342–49.CrossRefGoogle ScholarPubMed
Figure 0

Figure 1: Effect of small vessel disease burden on prior (pre-test) probability and posterior (post-test) probability for cognitive screening tool. (A) In patients without small vessel disease, the likelihood of high and low probability of cognitive impairment is symmetrical; it is governed by the test characteristics alone. A three-tiered approach would be appropriate. (B) In patients with varying small vessel disease burden, the likelihood of high and low probability of cognitive impairment is asymmetrical. A negative test (high scores in Montreal Cognitive Assessment) is less likely associated with low probability of cognitive impairment due to good cognitive and brain reserve.