Hostname: page-component-586b7cd67f-t7czq Total loading time: 0 Render date: 2024-11-20T09:11:38.248Z Has data issue: false hasContentIssue false
  • English
  • Français

Comparing Performance Across In-person and Videoconference-Based Administrations of Common Neuropsychological Measures in Community-Based Survivors of Stroke

Published online by Cambridge University Press:  09 December 2020

Jodie E. Chapman Open the ORCID record for Jodie E. Chapman [Opens in a new window] ,
Betina Gardner Open the ORCID record for Betina Gardner [Opens in a new window] ,
Jennie Ponsford Open the ORCID record for Jennie Ponsford [Opens in a new window] ,
Dominique A. Cadilhac Open the ORCID record for Dominique A. Cadilhac [Opens in a new window]  and
Renerus J. Stolwyk Open the ORCID record for Renerus J. Stolwyk [Opens in a new window]
Jodie E. Chapman
Affiliation:
School of Psychological Sciences and Turner Institute for Brain and Mental Health, Monash University, Melbourne, Victoria, Australia
Betina Gardner
Affiliation:
School of Psychological Sciences and Turner Institute for Brain and Mental Health, Monash University, Melbourne, Victoria, Australia Department of Psychiatry, Monash University, Melbourne, Victoria, Australia
Jennie Ponsford
Affiliation:
School of Psychological Sciences and Turner Institute for Brain and Mental Health, Monash University, Melbourne, Victoria, Australia Monash Epworth Rehabilitation Research Centre, Epworth HealthCare,Melbourne, Victoria, Australia
Dominique A. Cadilhac
Affiliation:
Stroke & Ageing Research, Department of Medicine, School of Clinical Sciences at Monash Health, Monash University, Clayton, Victoria, Australia Stroke Division, Florey Institute of Neuroscience and Mental Health, The University of Melbourne, Heidelberg, Victoria, Australia
Renerus J. Stolwyk*
Affiliation:
School of Psychological Sciences and Turner Institute for Brain and Mental Health, Monash University, Melbourne, Victoria, Australia Monash Epworth Rehabilitation Research Centre, Epworth HealthCare,Melbourne, Victoria, Australia
*
*Correspondence and reprint requests to: Renerus J. Stolwyk, School of Psychological Sciences and Turner Institute for Brain and Mental Health, 18 Innovation Walk, Monash University, Melbourne, Victoria3800, Australia. E-mail: [email protected]
Get access Rights & Permissions [Opens in a new window]

Abstract

Objective:

Neuropsychological assessment via videoconference could assist in bridging service access gaps due to geographical, mobility, or infection control barriers. We aimed to compare performances on neuropsychological measures across in-person and videoconference-based administrations in community-based survivors of stroke.

Method:

Participants were recruited through a stroke-specific database and community advertising. Stroke survivors were eligible if they had no upcoming neuropsychological assessment, concurrent neurological and/or major psychiatric diagnoses, and/or sensory, motor, or language impairment that would preclude standardised assessment. Thirteen neuropsychological measures were administered in-person and via videoconference in a randomised crossover design (2-week interval). Videoconference calls were established between two laptop computers, facilitated by Zoom. Repeated-measures t tests, intraclass correlation coefficients (ICCs), and Bland–Altman plots were used to compare performance across conditions.

Results:

Forty-eight participants (26 men; Mage = 64.6, SD = 10.1; Mtime since stroke = 5.2 years, SD = 4.0) completed both sessions on average 15.8 (SD = 9.7) days apart. For most measures, the participants did not perform systematically better in a particular condition, indicating agreement between administration methods. However, on the Hopkins Verbal Learning Test – Revised, participants performed poorer in the videoconference condition (Total Recall Mdifference = −2.11). ICC estimates ranged from .40 to .96 across measures.

Conclusions:

This study provides preliminary evidence that in-person and videoconference assessment result in comparable scores for most neuropsychological tests evaluated in mildly impaired community-based survivors of stroke. This preliminary evidence supports teleneuropsychological assessment to address service gaps in stroke rehabilitation; however, further research is needed in more diverse stroke samples.

Keywords

Cerebrovascular disordersCognitionComparative effectivenessNeuropsychologyTelehealthTeleneuropsychology
Type
Regular Research
Information
Journal of the International Neuropsychological Society , Volume 27 , Issue 7 , August 2021 , pp. 697 - 710
Copyright
Copyright © INS. Published by Cambridge University Press, 2020

Access options

Get access to the full version of this content by using one of the access options below. (Log in options will check for institutional or personal access. Content may require purchase if you do not have access.)

References

REFERENCES

Australian Institute of Health and Welfare. (2018). Australia’s Health 2018. (Australia’s Health Series No. 16. AUS 221). Canberra, ACT: AIHW.Google Scholar
Bartlett, J. & Wetzel, R. (2010). Video conferencing quality vs. bandwidth tradeoffs. Retrieved from http://searchunifiedcommunications.techtarget.com/tip/Video-conferencing-quality-vs-bandwidth-tradeoffs Google Scholar
Benedict, R.H.B., Schretlen, D., Groninger, L., & Brandt, J. (1998). Hopkins Verbal Learning Test – Revised: Normative data and analysis of inter-form and test-retest reliability. The Clinical Neuropsychologist, 12(1), 43–55. doi: 10.1076/clin.12.1.43.1726 CrossRefGoogle Scholar
Bjelland, I., Dahl, A.A., Haug, T.T., & Neckelmann, D. (2002). The validity of the Hospital Anxiety and Depression Scale: An updated literature review. Journal of Psychosomatic Research, 52(2), 69–77. doi: 10.1016/s0022-3999(01)00296-3 CrossRefGoogle Scholar
Bland, J.M. & Altman, D.G. (1986). Statistical methods for assessing agreement between two methods of clinical measurement. Lancet, 8(1), 307–310. doi: 10.1016/S0140-6736(86)90837-8 CrossRefGoogle Scholar
Boot, W.R., Charness, N., Czaja, S.J., Sharit, J., Rogers, W.A., Fisk, A.D., … Nair, S. (2015). Computer Proficiency Questionnaire: Assessing low and high computer proficient seniors. The Gerontologist, 55(3), 404–411. doi: 10.1093/geront/gnt117 CrossRefGoogle ScholarPubMed
Brandt, J. & Benedict, R.H.B. (2001). Hopkins Verbal Learning Test – Revised. Odessa, TX: Psychological Assessment Resources.Google Scholar
Brearly, T.W., Shura, R.D., Martindale, S.L., Lazowski, R.A., Luxton, D.D., Shenal, B.V., & Rowland, J.A. (2017). Neuropsychological test administration by videoconference: A systematic review and meta-analysis. Neuropsychological Review, 27(2), 174–186. doi: 10.1007/s11065-017-9349-1 CrossRefGoogle ScholarPubMed
Bujang, M.A. & Baharum, N. (2017). A simplified guide to determination of sample size requirements for estimating the value of intraclass correlation coefficient: A review. Archives of Orofacial Sciences, 12(1), 1–11. Retrieved from http://www.dental.usm.my/aos/docs/Vol_12/aos-article-0246.pdf Google Scholar
Burton, L. & Tyson, S.F. (2015). Screening for cognitive impairment after stroke: A systematic review of psychometric properties and clinical utility. Journal of Rehabilitation Medicine, 47(3), 193–203. doi: 10.2340/16501977-1930 CrossRefGoogle ScholarPubMed
Burton, R.L. & O’Connell, M.E. (2018). Telehealth rehabilitation for cognitive impairment: Randomized controlled feasibility trial. JMIR Research Protocols, 7(2), e43. doi: 10.2196/resprot.9420 CrossRefGoogle ScholarPubMed
Chapman, J.E., Cadilhac, D.A., Gardner, B., Ponsford, J., Bhalla, R., & Stolwyk, R.J. (2019). Comparing face-to-face and videoconference completion of the Montreal Cognitive Assessment (MoCA) in community-based survivors of stroke. Journal of Telemedicine and Telecare. Advance online publication. doi: 10.1177/1357633X19890788 Google Scholar
Chapman, J.E., Ponsford, J., Bagot, K.L., Cadilhac, D.A., Gardner, B., & Stolwyk, R.J. (2020). The use of videoconferencing in clinical neuropsychological practice: A mixed methods evaluation of neuropsychologists’ experiences and views. Australian Psychologist. Advance online publication. doi: 10.1111/ap.12471 CrossRefGoogle Scholar
Cohen, J. (1988). Statistical Power Analysis for the Behavioural Sciences (2nd ed.). Hillsdale, NJ: Lawrence Earlbaum Associates.Google Scholar
Cullum, C.M. & Grosch, M.C. (2013). Special considerations in conducting neuropsychology assessment over videoconferencing. In Myers, K. & Turvey, C.L. (Eds.), Telemental health clinical, technical, and administrative foundations for evidenced based practice (pp. 275–293). doi: 10.1016/B978-0-12-416048-4.00014-2n Google Scholar
Cullum, C.M., Hynan, L.S., Grosch, M.C., Parikh, M., & Weiner, M.F. (2014). Teleneuropsychology: Evidence of video teleconference-based neuropsychological assessment. Journal of the International Neuropsychological Society, 20(10), 1–6. doi: 10.1017/S1355617714000873 Google Scholar
Field, A. (2018). Discovering Statistics Using IBM SPSS Statistics (5th ed.). London, England: SAGE Publications Ltd.Google Scholar
Hachinski, V., Iadecola, C., Peterson, R.C., Breteler, M.M., Nyenhuis, D.L., Black, S.E., … Leblanc, G.G. (2006). National Institute of Neurological Disorders and Stroke-Canadian Stroke Network vascular cognitive impairment harmonization standards. Stroke, 37(9), 2220–2241. doi: 10.1161/01.STR.0000237236.88823.47 CrossRefGoogle ScholarPubMed
Heaton, R.K., Miller, S.W., Taylor, M.J., & Grant, M.J. (2004). Revised Comprehensive Norms for An Expanded Halstead-Reitan Battery: Demographically Adjusted Neuropsychological Norms for African American and Caucasian Adults. Lutz, FL: Psychological Assessment Resources.Google Scholar
Hildebrand, R., Chow, H., Williams, C., Nelson, M., & Wass, P. (2004). Feasability of neuropsychological testing of older adults via videoconference: Implications for assessing the capacity for independent living. Journal of Telemedicine and Telecare, 10(3), 130–134. doi: 10.1258/13576330432070751 CrossRefGoogle Scholar
Hodge, M.A., Sutherland, R., Jeng, K., Bale, G., Batta, P., Cambridge, A., … Silove, N. (2019). Agreement between telehealth and face-to-face assessment of intellectual ability in children with specific learning disorder. Journal of Telemedicine and Telecare, 25(7), 431–437. doi: 10.1177/1357633X18776095.CrossRefGoogle ScholarPubMed
Jacobsen, S.E., Sprenger, T., Andersson, S., & Krogstad, J.M. (2003). Neuropsychological assessment and telemedicine: A preliminary study examining the reliability of neuropsychological services performed via telecommunication. Journal of the International Neuropsychological Society, 9(3), 472–478. doi: 10.1017/S1355617703930128 CrossRefGoogle ScholarPubMed
Janzen, L.A. & Guger, S. (2016). Clinical neuropsychology practice and training in Canada. The Clinical Neuropsychologist, 30(8), 1193–1206. doi: 10.1080/13854046.2016.1175668 CrossRefGoogle ScholarPubMed
Kaplan, E.F., Goodglass, H., & Weintraub, S. (2001). The Boston Naming Test (2nd ed.). Philadelphia, PA: Lippincott Williams & Wilkins.Google Scholar
Kirkwood, K., Peck, D.F., & Bennie, L. (2000). The consistency of neuropsychological assessments performed via telecommunication and face to face. Journal of Telemedicine and Telecare, 6(3), 147–151. doi: 10.1258/13576330001935239 CrossRefGoogle ScholarPubMed
Koo, T.K. & Li, M.Y. (2016). A guideline for selecting and reporting intraclass correlation coefficients for reliability research. Journal of Chiropractic Medicine, 15(2), 155–163. doi: 10.1016/j.jcm.2016.02.012 CrossRefGoogle ScholarPubMed
Lawson, D.W., Stolwyk, R.J., Ponsford, J.L., McKenzie, D.P., Downing, M.G., & Wong, D. (2020). Telehealth delivery of memory rehabilitation following stroke. Journal of the International Neuropsychological Society, 26(1), 58–71. doi: 10.1017/S1355617719000651.CrossRefGoogle ScholarPubMed
Lesniak, M., Bak, T., Czepiel, W., Seniow, J., & Czlonkowska, A. (2008). Frequency and prognostic value of cognitive disorders in stroke patients. Dementia and Geriatric Cognitive Disorders, 26(4), 356–363. doi: 10.1159/000162262 CrossRefGoogle ScholarPubMed
Marra, D.E., Hamlet, K.M., Bauer, R.M., & Bowers, D. (2020). Validity of teleneuropsychology for older adults in response to COVID-19: A systematic and critical review. The Clinical Neuropsychologist. Advance online publication. doi: 10.1080/13854046.2020.1769192 CrossRefGoogle ScholarPubMed
Martin-Khan, M., Flicker, L., Wootton, R., Loh, P.K., Edwards, H., Varghese, P., … Gray, L.C. (2012). The diagnostic accuracy of telegeriatrics for the diagnosis of dementia via video conferencing. Journal of the American Medical Directors Association, 13(5), 19–24. doi: 10.1016/j.jamda.2012.03.004.CrossRefGoogle Scholar
Martin-Khan, M., Varghese, P., Wootton, R., & Gray, L. (2007). Successes and failures in assessing cognitive function in older adults using video consultation. Journal of Telemedicine and Telecare, 13(S3), 60–62. doi: 10.1258/135763307783247211 CrossRefGoogle Scholar
Meyers, J. & Meyers, K. (1995). Rey Complex Figure Test and Recognition Trial: Professional Manual. Lutz, FL: Psychological Assessment Resources.Google Scholar
Nasreddine, Z.S., Phillips, N.A., Bedirian, V., Charbonneau, S., Whitehead, V., Collin, I., … Chertkow, H. (2005). The Montreal Cognitive Assessment, MoCA: A brief screening tool for mild cognitive impairment. Journal of the American Geriatrics Society, 53(4), 695–699. doi: 10.1111/j.1532-5415.2005.53221.x CrossRefGoogle ScholarPubMed
Nunnally, J.C. & Bernstein, I.H. (1994). Psychometric Theory (3rd ed.). New York, NY: McGraw-Hill Inc.Google Scholar
Nys, G.M.S., van Zandvoort, M.J.E., van der Worp, H.B., de Haan, E.H.F., de Kort, P.L.M., Jansen, B.P.W., & Kappelle, L.J. (2006). Early cognitive impairment predicts long-term depressive symptoms and quality of life after stroke. Journal of the Neurological Sciences, 247(2), 149–156. doi: 10.1016/j.jns.2006.04.005 CrossRefGoogle ScholarPubMed
Parikh, M., Grosch, M.C., Graham, L.L., Hynan, L.S., Weiner, M.F., Shore, J.H., & Cullum, C.M. (2013). Consumer acceptability of brief videoconference-based neuropsychological assessment in older individuals with and without cognitive impairment. The Clinical Neuropsychologist, 27(5), 808–817. doi: 10.1080/13854046.2013.791723 CrossRefGoogle ScholarPubMed
Pendlebury, S.T., Mariz, J., Bull, L., Mehta, Z., & Rothwell, P.M. (2012). MoCA, ACE-R, and MMSE versus the National Institute of Neurological Disorders and Stroke-Canadian Stroke Network Vascular Cognitive Impairment Harmonization Standards neuropsychological battery after TIA and stroke. Stroke, 43(2), 464–469. doi: 10.1161/STROKEAHA.111.633586 CrossRefGoogle ScholarPubMed
Pendlebury, S.T., Mariz, J., Bull, L., Mehta, Z., & Rothwell, P.M. (2013). Impact of different operational definitions on mild cognitive impairment rate and MMSE and MoCA performance in transient ischaemic attack and stroke. Cerebrovascular Disorders 3(5–6), 355–362. doi: 10.1159/000355496 CrossRefGoogle Scholar
Ponsford, J. (2016). The practice of clinical neuropsychology in Australia. The Clinical Neuropsychologist, 30(8), 1179–1192. doi: 10.1080/13854046.2016.1195015 CrossRefGoogle ScholarPubMed
Psychology Board of Australia. (2018). Psychology Board of Australia registrant data. Retrieved from http://www.psychologyboard.gov.au/documents/default.aspx?record=WD18%2F25212&dbid=AP&chksum=z3QxEh3hWZCH5cOBGPQVAQ%3D%3D Google Scholar
Rebchuk, A.D., Deptuck, H.M., O’Neill, Z.R., Fawcett, D.S., Silverberg, N.D., & Field, T.S. (2019). Validation of a novel telehealth administration protocol for the NIH toolbox-cognitive battery. Telemedicine and e-Health, 25(3), 237–242. doi: 10.1089/tmj.2018.0023 CrossRefGoogle Scholar
Regard, M. (1981). Cognitive rigidity and flexibility: A neuropsychological study. Unpublished Ph.D. Dissertation: University of Victoria.Google Scholar
Reitan, R.M. & Wolfson, D. (1985). The Halstead-Reitan Neuropsychological Test Battery: Therapy and Clinical Interpretation. Tucson, AZ: Neuropsychological Press.Google Scholar
Saxena, S.K., Ng, T.P., Koh, G., Yong, D., & Fong, N.P. (2007). Is improvement in impaired cognition and depressive symptoms in post-stroke patients associated with recovery in activities of daily living? Acta Neurologica Scandinavica, 115(5), 339–346. doi: 10.1111/j.1600-0404.2006.00751.x CrossRefGoogle ScholarPubMed
Schopp, L.H., Johnstone, B.R., & Merveille, O.C. (2000). Multidimensional telecare stratergies for rural residents with brain injury. Journal of Telemedicine and Telecare, 6(S1), 146–149. doi: 10.1258/1357633001934474 CrossRefGoogle Scholar
Skilbeck, C.E., Wade, D.T., Hewer, R.L., & Wood, V.A. (1983). Recovery after stroke. Journal of Neurology, Neurosurgery, and Psychiatry, 46(1), 5–8. doi: 10.1136/jnnp.46.1.5 CrossRefGoogle ScholarPubMed
Smith, A. (1973). Symbol Digit Modalities Test. Los Angeles, CA: Western Psychological Services.Google Scholar
Stain, H.J., Payne, K., Thienel, R., Michie, P., Carr, V., & Kelly, B. (2011). The feasability of videoconferencing for neuropsychological assessments in rural youth experiencing early psychosis. Journal of Telemedicine and Telecare, 17(6), 328–331. doi: 10.1258/jtt.2011.101015 CrossRefGoogle Scholar
Strauss, E., Sherman, E.M.S., & Spreen, O. (2006). A Compendium of Neuropsychological Tests: Administration, Norms and Commentary (3rd ed.). New York, NY: Oxford University Press Inc.Google Scholar
Stroke Foundation. (2017). (Australian) Clinical Guidelines for Stroke Management 2017. Retrieved from https://strokefoundation.org.au/what-we-do/treatment-programs/clinical-guidelines Google Scholar
Stroke Foundation. (2018). National Stroke Audit Rehabilitation Services Report 2018. Retrieved from https://informme.org.au/stroke-data/Rehabilitation-audits Google Scholar
Stroke Foundation. (2019). National Stroke Audit Acute Services Report 2019. Retrieved from https://informme.org.au/stroke-data/Acute-audits Google Scholar
Sweet, J.J., Benson, L.M., Nelson, N.W., & Moberg, P.J. (2015). The American Academy of Clinical Neuropsychology, National Academy of Neuropsychology, and Society for Clinical Neuropsychology (APA Division 40) 2015 TCN Professional Practice and Salary Survey: Professional practices, beliefs, and incomes of U.S. neuropsychologists. The Clinical Neuropsychologist, 29(8), 1069–1162. doi: 10.1080/13854046.2016.1140228 CrossRefGoogle ScholarPubMed
Temple, V., Drummond, C., Valiquette, S., & Jozsvai, E. (2010). A comparison of intellectual assessments over video conferencing and in-person for individuals with ID: Preliminary data. Journal of Intellectual Disability Research, 54(6), 573–577. doi: 10.1111/j.1365-2788.2010.01282.x.CrossRefGoogle ScholarPubMed
Wadsworth, H.E., Dhima, K., Womack, K.B., Hart, J., Weiner, M.F., Hynan, L.S., & Cullum, C.M. (2018). Validity of teleneuropsychological assessment in older patients with cognitive disorders. Archives of Clinical Neuropsychology, 33(8), 1040–1045. doi: 10.1093/arclin.acx140 CrossRefGoogle ScholarPubMed
Wadsworth, H.E., Galusha-Glasscock, J.M., Womack, K.B., Quiceno, M., Weiner, M.F., Hynan, L.S., … Cullum, C.M. (2016). Remote neuropsychological assessment in rural American Indians with and without cognitive impairment. Archives of Clinical Neuropsychology, 31(5), 420–425. doi: 10.1093/arclin/acw030 CrossRefGoogle ScholarPubMed
Wagle, J., Farner, L., Flekkoy, K., Bruun Wyller, T., Sandvik, L., Fure, B., … Engedal, K. (2011). Early post-stroke cognition in stroke rehabilitation patients predicts functional outcome at 13 months. Dementia and Geriatric Cognitive Disorders, 31(5), 379–387. doi: 10.1159/000328970 CrossRefGoogle ScholarPubMed
Wechsler, D. (1997). Wechsler Adult Intelligence Scale – Third Edition, Australian and New Zealand Language Adapted Edition. Sydney, Australia: Pearson Clinical and Talent Assessment.Google Scholar
Wechsler, D. (2008). Wechsler Adult Intelligence Scale – Fourth Edition, Australian and New Zealand Language Adapted Edition. Sydney, Australia: Pearson Clinical and Talent Assessment.Google Scholar
Wechsler, D. (2009a). Advanced Clinical Solutions for the WAIS-IV and WMS-IV. San Antonio, TX: Pearson Clinical and Talent Assessment.Google Scholar
Wechsler, D. (2009b). Wechsler Memory Scale – Fourth Edition, Australian and New Zealand Language Adapted Edition. Sydney, Australia: Pearson Clinical and Talent Assessment.Google Scholar
Zigmond, A.S. & Snaith, R.P. (1983). The Hospital Anxiety and Depression Scale. Acta Psychiatrica Scandinavica, 67(6), 361–370. doi: 10.1111/j.1600-0447.1983.tb09716.x CrossRefGoogle ScholarPubMed
Zoom [Computer Software]. San Jose, CA: Zoom Video Communications Inc.Google Scholar
Supplementary material: File

Chapman et al. supplementary material

Chapman et al. supplementary material 1

Download Chapman et al. supplementary material(File)
File 136.4 KB
Supplementary material: File

Chapman et al. supplementary material

Chapman et al. supplementary material 2

Download Chapman et al. supplementary material(File)
File 136.4 KB