Hostname: page-component-78c5997874-lj6df Total loading time: 0 Render date: 2024-11-19T07:20:01.645Z Has data issue: false hasContentIssue false
  • English
  • Français

Non-Spatial Impairments Affect False-Positive Neglect Diagnosis Based on Cancellation Tasks

Published online by Cambridge University Press:  30 March 2020

Hanne Huygelier Open the ORCID record for Hanne Huygelier [Opens in a new window] ,
Margaret Jane Moore ,
Nele Demeyere Open the ORCID record for Nele Demeyere [Opens in a new window]  and
Céline R. Gillebert
Hanne Huygelier
Affiliation:
Department of Brain and Cognition, KU Leuven, Leuven, Belgium
Margaret Jane Moore
Affiliation:
Department of Experimental Psychology, University of Oxford, Oxford, UK
Nele Demeyere
Affiliation:
Department of Experimental Psychology, University of Oxford, Oxford, UK
Céline R. Gillebert*
Affiliation:
Department of Brain and Cognition, KU Leuven, Leuven, Belgium Department of Experimental Psychology, University of Oxford, Oxford, UK
*
*Correspondence and reprint requests to: Céline R. Gillebert, Department of Brain and Cognition, KU Leuven, Tiensestraat 102, Box 3711, Leuven3000, Belgium. E-mail: [email protected]
Get access Rights & Permissions [Opens in a new window]

Abstract

Objective:

To diagnose egocentric neglect after stroke, the spatial bias of performance on cancellation tasks is typically compared to a single cutoff. This standard procedure relies on the assumption that the measurement error of cancellation performance does not depend on non-spatial impairments affecting the total number of cancelled targets. Here we assessed the impact of this assumption on false-positive diagnoses.

Method:

We estimated false positives by simulating cancellation data using a binomial model. Performance was summarised by the difference in left and right cancelled targets (R-L) and the Centre of Cancellation (CoC). Diagnosis was based on a fixed cutoff versus cutoffs adjusted for the total number of cancelled targets and on single test performance versus unanimous or proportional agreement across multiple tests. Finally, we compared the simulation findings to empirical cancellation data acquired from 651 stroke patients.

Results:

Using a fixed cutoff, the rate of false positives depended on the total number of cancelled targets and ranged from 10% to 30% for R-L scores and from 10% to 90% for CoC scores. The rate of false positives increased even further when diagnosis was based on proportional agreement across multiple tests. Adjusted cutoffs and unanimous agreement across multiple tests were effective at controlling false positives. For empirical data, fixed versus adjusted cutoffs differ in estimation of neglect prevalence by 13%, and this difference was largest for patients with non-spatial impairments.

Conclusions:

Our findings demonstrate the importance of considering non-spatial impairments when diagnosing neglect based on cancellation performance.

Keywords

Perceptual disorderstask performance and analysispsychometricsstrokeclinical decision makingneuropsychology
Type
Regular Research
Information
Journal of the International Neuropsychological Society , Volume 26 , Issue 7 , August 2020 , pp. 668 - 678
Copyright
Copyright © INS. Published by Cambridge University Press, 2020

Access options

Get access to the full version of this content by using one of the access options below. (Log in options will check for institutional or personal access. Content may require purchase if you do not have access.)

References

REFERENCES

Albert, M.L. (1973). A simple test of visual neglect. Neurology, 23(6), 658–664. doi: 10.1212/WNL.23.6.658CrossRefGoogle ScholarPubMed
Azouvi, P., Bartolomeo, P., Beis, J.-M., Perennou, D., Pradat-Diehl, P., & Rousseaux, M. (2006). A battery of tests for the quantitative assessment of unilateral neglect. Restorative Neurology and Neuroscience, 24(4–6), 273–285.Google ScholarPubMed
Azouvi, P., Olivier, S., de Montety, G., Samuel, C., Louis-Dreyfus, A., & Tesio, L. (2003). Behavioral assessment of unilateral neglect: Study of the psychometric properties of the Catherine Bergego Scale. Archives of Physical Medicine and Rehabilitation, 84(1), 51–57. doi: 10.1053/apmr.2003.50062CrossRefGoogle ScholarPubMed
Bailey, M.J., Riddoch, M.J., & Crome, P. (2004). Test–retest stability of three tests for unilateral visual neglect in patients with stroke: Star cancellation, line bisection, and the baking tray task. Neuropsychological Rehabilitation, 14(4), 403–419. doi: 10.1080/09602010343000282CrossRefGoogle Scholar
Beaujean, A.A. (2018). Simulating data for clinical research: A tutorial. Journal of Psychoeducational Assessment, 36(1), 7–20. doi: 10.1177/0734282917690302CrossRefGoogle Scholar
Behrmann, M., Watt, S., Black, S.E., & Barton, J.J.S. (1997). Impaired visual search in patients with unilateral neglect: An oculographic analysis. Neuropsychologia, 35(11), 1445–1458. doi: 10.1016/S0028-3932(97)00058-4CrossRefGoogle ScholarPubMed
Beisbart, C. & Norton, J.D. (2012). Why Monte Carlo Simulations are inferences and not experiments. International Studies in the Philosophy of Science, 26(4), 403–422. doi: 10.1080/02698595.2012.748497CrossRefGoogle Scholar
Brink, A.F.T., Verwer, J.H., Biesbroek, J.M., Visser-Meily, J.M.A., & Nijboer, T.C.W. (2017). Differences between left- and right-sided neglect revisited: A large cohort study across multiple domains. Journal of Clinical and Experimental Neuropsychology, 39(7), 707–723. doi: 10.1080/13803395.2016.1262333CrossRefGoogle ScholarPubMed
Brown, G.G., Thomas, M.L., & Patt, V. (2017). Parametric model measurement: Reframing traditional measurement ideas in neuropsychological practice and research. The Clinical Neuropsychologist, 31(6–7), 1047–1072. doi: 10.1080/13854046.2017.1334829CrossRefGoogle ScholarPubMed
Cazzoli, D., Müri, R.M., Schumacher, R., von Arx, S., Chaves, S., Gutbrod, K., Bohlhalter, S., Bauer, D., Vanbellingen, T., Bertschi, M., Kipfer, S., Rosenthal, C.R., Kennard, C., Bassetti, C.L., & Nyffeler, T. (2012). Theta burst stimulation reduces disability during the activities of daily living in spatial neglect. Brain: A Journal of Neurology, 135(Pt 11), 3426–3439. doi: 10.1093/brain/aws182CrossRefGoogle ScholarPubMed
Chatterjee, A., Mennemeier, M., & Heilman, K.M. (1992). Search patterns and neglect: A case study. Neuropsychologia, 30(7), 657–672. doi: 10.1016/0028-3932(92)90070-3CrossRefGoogle ScholarPubMed
Crawford, J.R., & Garthwaite, P.H. (2002). Investigation of the single case in neuropsychology: Confidence limits on the abnormality of test scores and test score differences. Neuropsychologia, 40(8), 1196–1208. doi: 10.1016/S0028-3932(01)00224-XCrossRefGoogle ScholarPubMed
Dalmaijer, E.S., Li, K.M.S., Gorgoraptis, N., Leff, A.P., Cohen, D.L., Parton, A.D., Husain, M., & Malhotra, P.A. (2018). Randomised, double-blind, placebo-controlled crossover study of single-dose guanfacine in unilateral neglect following stroke. Journal of Neurology Neurosurgery & Psychiatry, 89, 593–598. doi: 10.1136/jnnp-2017-317338CrossRefGoogle ScholarPubMed
Dalmaijer, E.S., Stigchel, S.V. der, Nijboer, T.C.W., Cornelissen, T.H.W., & Husain, M. (2014). CancellationTools: All-in-one software for administration and analysis of cancellation tasks. Behavior Research Methods, 47(4), 1065–1075. doi: 10.3758/s13428-014-0522-7CrossRefGoogle Scholar
Demeyere, N., & Gillebert, C.R. (2019). Ego- and allocentric visuospatial neglect: Dissociations, prevalence, and laterality in acute stroke. Neuropsychology, 33(4), 490–498. doi: 10.1037/neu0000527CrossRefGoogle ScholarPubMed
Demeyere, N., Riddoch, M.J., Slavkova, E.D., Bickerton, W.-L., & Humphreys, G.W. (2015). The Oxford Cognitive Screen (OCS): Validation of a stroke-specific short cognitive screening tool. Psychological Assessment, 27(3), 883–894. doi: 10.1037/pas0000082CrossRefGoogle ScholarPubMed
Donnelly, N., Guest, R., Fairhurst, M., Potter, J., Deighton, A., & Patel, M. (1999). Developing algorithms to enhance the sensitivity of cancellation tests of visuospatial neglect. Behavior Research Methods, Instruments, & Computers: A Journal of the Psychonomic Society, Inc., 31(4), 668–673.CrossRefGoogle ScholarPubMed
Farcomeni, A. (2008). A review of modern multiple hypothesis testing, with particular attention to the false discovery proportion. Statistical Methods in Medical Research, 17(4), 347–388. doi: 10.1177/0962280206079046CrossRefGoogle ScholarPubMed
Farnè, A., Buxbaum, L.J., Ferraro, M., Frassinetti, F., Whyte, J., Veramonti, T., Angeli, V., Coslett, H.B., & Làdavas, E. (2004). Patterns of spontaneous recovery of neglect and associated disorders in acute right brain-damaged patients. Journal of Neurology, Neurosurgery & Psychiatry, 75(10), 1401–1410. doi: 10.1136/jnnp.2002.003095CrossRefGoogle ScholarPubMed
Feinberg, R.A. & Rubright, J.D. (2016). Conducting simulation studies in psychometrics. Educational Measurement: Issues and Practice, 35(2), 36–49. doi: 10.1111/emip.12111CrossRefGoogle Scholar
Ferber, S. & Karnath, H.-O. (2001). How to assess spatial neglect – Line bisection or cancellation tasks? Journal of Clinical and Experimental Neuropsychology, 23(5), 599–607. doi: 10.1076/jcen.23.5.599.1243CrossRefGoogle ScholarPubMed
Foldi, N.S., Jutagir, R., Davidoff, D., & Gould, T. (1992). Selective attention skills in Alzheimer’s disease: Performance on graded cancellation tests varying in density and complexity. Journal of Gerontology, 47(3), P146–P153. doi: 10.1093/geronj/47.3.P146CrossRefGoogle ScholarPubMed
Gauthier, L., Dehaut, F., & Joanette, Y. (1989). The bells test: A quantitative and qualitative test for visual neglect. International Journal of Clinical Neuropsychology, 11(2), 49–54.Google Scholar
Habibzadeh, F., Habibzadeh, P., & Yadollahie, M. (2016). On determining the most appropriate test cut-off value: The case of tests with continuous results. Biochemia Medica, 26(3), 297–307. doi: 10.11613/BM.2016.034CrossRefGoogle ScholarPubMed
Halligan, P.W., Cockburn, J., & Wilson, B.A. (1991). The behavioural assessment of visual neglect. Neuropsychological Rehabilitation, 1(1), 5–32. doi: 10.1080/09602019108401377CrossRefGoogle Scholar
Heilman, K.M., Bowers, D., Valenstein, E., & Watson, R.T. (1987). Hemispace and hemispatial neglect. In M. Jeannerod (Ed.), Neurophysiological and neuropsychological aspects of spatial neglect. Advances in Psychology, Vol. 45, (pp. 115–150). Amsterdam, The Netherlands: North-Holland.CrossRefGoogle Scholar
Husain, M., Mannan, S., Hodgson, T., Wojciulik, E., Driver, J., & Kennard, C. (2001). Impaired spatial working memory across saccades contributes to abnormal search in parietal neglect. Brain, 124(5), 941–952. doi: 10.1093/brain/124.5.941CrossRefGoogle ScholarPubMed
Husain, M. & Rorden, C. (2003). Non-spatially lateralized mechanisms in hemispatial neglect. Nature Reviews Neuroscience, 4(1), 26–36. doi: 10.1038/nrn1005CrossRefGoogle ScholarPubMed
Husain, M., Shapiro, K., Martin, J., & Kennard, C. (1997). Abnormal temporal dynamics of visual attention in spatial neglect patients. Nature, 385(6612), 154–156. doi: 10.1038/385154a0CrossRefGoogle ScholarPubMed
Huygelier, H. & Gillebert, C.R. (2018). Quantifying egocentric spatial neglect with cancellation tasks: A theoretical validation. Journal of Neuropsychology. doi: 10.1111/jnp.12177Google ScholarPubMed
Jalas, M.J., Lindell, A.B., Brunila, T., Tenovuo, O., & Hamalainen, H. (2002). Initial rightward orienting bias in clinical tasks: Normal subjects and right hemispheric stroke patients with and without neglect. Journal of Clinical and Experimental Neuropsychology, 24(4), 479–490. doi: 10.1076/jcen.24.4.479.1036CrossRefGoogle ScholarPubMed
Lord, F. (1952). A theory of test scores. Psychometric Monographs, Vol. 7 (pp. x, 84–x, 84). Richmond, VA: Psychometric Corporation.Google Scholar
Lord, F.M., Novick, M.R., & Birnbaum, A. (1968). Statistical Theories of Mental Test Scores. Oxford, England: Addison-Wesley.Google Scholar
Machner, B., Mah, Y.-H., Gorgoraptis, N., & Husain, M. (2012). How reliable is repeated testing for hemispatial neglect? Implications for clinical follow-up and treatment trials. J Neurol Neurosurg Psychiatry, 83(10), 1032–1034. doi: 10.1136/jnnp-2012-303296CrossRefGoogle ScholarPubMed
McDonald, R.P. (2011). Test theory: A unified treatment. New York: Routledge Taylor & Francis Group.Google Scholar
McIntosh, R.D., Ietswaart, M., & Milner, A.D. (2017). Weight and see: Line bisection in neglect reliably measures the allocation of attention, but not the perception of length. Neuropsychologia, 106, 146–158. doi: 10.1016/j.neuropsychologia.2017.09.014CrossRefGoogle Scholar
McIntosh, R.D., Schindler, I., Birchall, D., & Milner, A.D. (2005). Weights and measures: A new look at bisection behaviour in neglect. Cognitive Brain Research, 25(3), 833–850. doi: 10.1016/j.cogbrainres.2005.09.008CrossRefGoogle Scholar
Newcombe, R.G. (1998). Interval estimation for the difference between independent proportions: Comparison of eleven methods. Statistics in Medicine, 17(8), 873–890. doi: 10.1002/(SICI)1097-0258(19980430)17:8<873::AID-SIM779>3.0.CO;2-I3.0.CO;2-I>CrossRefGoogle ScholarPubMed
Nichols, T. & Hayasaka, S. (2003). Controlling the familywise error rate in functional neuroimaging: A comparative review. Statistical Methods in Medical Research, 12(5), 419–446. doi: 10.1191/0962280203sm341raCrossRefGoogle ScholarPubMed
Nijboer, T.C., Kollen, B.J., & Kwakkel, G. (2013). Time course of visuospatial neglect early after stroke: A longitudinal cohort study. Cortex, 49(8), 2021–2027.CrossRefGoogle ScholarPubMed
Novick, M.R. (1966). The axioms and principal results of classical test theory. Journal of Mathematical Psychology, 3(1), 1–18. doi: 10.1016/0022-2496(66)90002-2CrossRefGoogle Scholar
Plummer, P., Morris, M.E., & Dunai, J. (2003). Assessment of unilateral neglect. Physical Therapy, 83(8), 732–740.CrossRefGoogle ScholarPubMed
Rengachary, J., He, B.J., Shulman, G., & Corbetta, M. (2011). A behavioral analysis of spatial neglect and its recovery after stroke. Frontiers in Human Neuroscience, 5, 29. doi: 10.3389/fnhum.2011.00029CrossRefGoogle ScholarPubMed
Robertson, I.H. (2001). Do we need the “lateral” in unilateral neglect? Spatially nonselective attention deficits in unilateral neglect and their implications for rehabilitation. Neuroimage, 14(1), S85–S90. doi: 10.1006/nimg.2001.0838CrossRefGoogle ScholarPubMed
Robertson, I.H., Halligan, P.W., Bergego, C., Hömberg, V., Pizzamiglio, L., Weber, E., & Wilson, B.A. (1994). Right neglect following right hemisphere damage? Cortex, 30(2), 199–213. doi: 10.1016/S0010-9452(13)80193-1CrossRefGoogle ScholarPubMed
Robertson, I.H., Mattingley, J.B., Rorden, C., & Driver, J. (1998). Phasic alerting of neglect patients overcome their spatial deficit in visual awareness Nature, 395(6698), 169–172. doi: 10.1038/25993CrossRefGoogle ScholarPubMed
Robertson, I.H., Tegnér, R., Tham, K., Lo, A., & Nimmo-smith, I. (1995). Sustained attention training for unilateral neglect: Theoretical and rehabilitation implications. Journal of Clinical and Experimental Neuropsychology, 17(3), 416–430. doi: 10.1080/01688639508405133CrossRefGoogle ScholarPubMed
Rorden, C. & Karnath, H.-O. (2010). A simple measure of neglect severity. Neuropsychologia, 48(9), 2758–2763. doi: 10.1016/j.neuropsychologia.2010.04.018CrossRefGoogle ScholarPubMed
Slick, D.J. (2006). Psychometrics in neuropsychological assessment. In Strauss, E., Sherman, E.M., & Spreen, O. (Eds.), A Compendium of Neuropsychological Tests: Administration, norms and commentary (pp. 3–43). New York: Oxford University Press.Google Scholar
Smania, N., Martini, M.C., Gambina, G., Tomelleri, G., Palamara, A., Natale, E., & Marzi, C.A. (1998). The spatial distribution of visual attention in hemineglect and extinction patients. Brain, 121(9), 1759–1770. doi: 10.1093/brain/121.9.1759CrossRefGoogle ScholarPubMed
Sperber, C. & Karnath, H.-O. (2016). Diagnostic validity of line bisection in the acute phase of stroke. Neuropsychologia, 82(Feb), 200–204. doi: 10.1016/j.neuropsychologia.2016.01.026CrossRefGoogle ScholarPubMed
Toraldo, A., Romaniello, C., & Sommaruga, P. (2017). Measuring and diagnosing unilateral neglect: A standardized statistical procedure. The Clinical Neuropsychologist, 31(6–7), 1248–1267. doi: 10.1080/13854046.2017.1349181CrossRefGoogle ScholarPubMed
Urbanski, M., Schotten, M.T. de, Rodrigo, S., Oppenheim, C., Touzé, E., Méder, J.-F., Moreau, K., Loeper-Jeny, C., Dubois, B., & Bartolomeo, P. (2010). DTI-MR tractography of white matter damage in stroke patients with neglect. Experimental Brain Research, 208(4), 491–505. doi: 10.1007/s00221-010-2496-8CrossRefGoogle ScholarPubMed
Vaes, N., Lafosse, C., Nys, G., Schevernels, H., Dereymaeker, L., Oostra, K., Hemelsoet, D., & Vingerhoets, G. (2015). Capturing peripersonal spatial neglect: An electronic method to quantify visuospatial processes. Behavior Research Methods, 47(1), 27–44. doi: 10.3758/s13428-014-0448-0CrossRefGoogle ScholarPubMed
Verdon, V., Schwartz, S., Lovblad, K.-O., Hauert, C.-A., & Vuilleumier, P. (2010). Neuroanatomy of hemispatial neglect and its functional components: A study using voxel-based lesion-symptom mapping. Brain, 133(3), 880–894. doi: 10.1093/brain/awp305CrossRefGoogle ScholarPubMed
Weintraub, S. & Mesulam, M.M. (1985). Mental state assessment of young and elderly adults in behavioral neurology, In Mesulam, M.M. (Ed.), Principles of behavioral neurology, (pp. 71–123). Philadelphia: F.A. Davis.Google Scholar
Weintraub, S. & Mesulam, M.M. (1988). Visual hemispatial inattention: Stimulus parameters and exploratory strategies. Journal of Neurology, Neurosurgery, and Psychiatry, 51(12), 1481–1488. doi: 10.1136/jnnp.51.12.1481CrossRefGoogle ScholarPubMed
Supplementary material: File

Huygelier et al. supplementary material

Huygelier et al. supplementary material

Download Huygelier et al. supplementary material(File)
File 305.4 KB