Hostname: page-component-cd9895bd7-gvvz8 Total loading time: 0 Render date: 2024-12-22T18:35:02.114Z Has data issue: false hasContentIssue false

Telepsychogeriatrics: a new horizon in the care of mental health problems in the elderly

Published online by Cambridge University Press:  12 June 2012

Ramón Ramos-Ríos
Affiliation:
Psychogeriatric Unit, Psychiatry Department, Complejo Hospitalario Universitario de Santiago de Compostela (CHUS), Santiago de Compostela, Spain
Raimundo Mateos*
Affiliation:
Psychogeriatric Unit, Psychiatry Department, Complejo Hospitalario Universitario de Santiago de Compostela (CHUS), Santiago de Compostela, Spain Department of Psychiatry, Universidad de Santiago de Compostela (USC), Santiago de Compostela, Spain
David Lojo
Affiliation:
Higher Systems and Information Technology Government Body, CHUS, Santiago de Compostela, Spain
David K. Conn
Affiliation:
Department of Psychiatry, University of Toronto, Toronto, Ontario, Canada Telehealth Services, Baycrest Centre for Geriatric Care, Toronto, Ontario, Canada
Tim Patterson
Affiliation:
Telehealth Services, Baycrest Centre for Geriatric Care, Toronto, Ontario, Canada
*
Correspondence should be addressed to: Prof. Raimundo Mateos, Department of Psychiatry, School of Medicine, ES 15782 Santiago de Compostela, Spain. Phone: +34 981 950 901; Fax: +34 981 951 901. Email: [email protected].
Get access

Abstract

Background: The use of telemedicine for the care of mental health problems has developed significantly over the last decade thanks to the emergence of a number of stable telepsychiatry programs in many countries. Parallel to this development, this care modality has also targeted specific populations with higher difficulty in gaining access to mental health services such as the elderly. Telepsychogeriatrics is expected to have an increasing role in providing care to geographically isolated rural communities, with a particular focus on long-term care facilities, in light of the high prevalence of psychiatric disorders in these centers and the lack of available specialized care.

Methods: A thorough search of the literature was conducted using Medline, Web of Science, and PsychINFO databases in order to gather available evidence on the applicability of telepsychiatry, specifically the use of videoconferencing for remote consultation, in the elderly population with mental disorders. A succinct description of the selected studies is given along with a general reflection on the state-of-the-art in the field of psychogeriatric clinical practice and research.

Results: Research on the use of telemedicine in this age group has taken into account their special characteristics, and has focused on demonstrating its applicability, the acceptance and satisfaction of elderly users and their healthcare providers, the possibility of carrying out cognitive and diagnostic assessments, and the efficiency of these programs.

Conclusions: Despite limited experience, telepsychogeriatrics appears to be a viable option, well accepted by patients, including those having dementia. More systematized studies are needed in this new field based on larger sample sizes, including comparison with traditional consultations and assessment of the clinical outcomes.

Type
Review Article
Copyright
Copyright © International Psychogeriatric Association 2012

Access options

Get access to the full version of this content by using one of the access options below. (Log in options will check for institutional or personal access. Content may require purchase if you do not have access.)

References

Alessi, N. (2001). Geriatric telepsychiatry: no matter the population, the questions remain the same - a commentary. Journal of Geriatric Psychiatry and Neurology, 14, 8890.CrossRefGoogle Scholar
American Telemedicine Association (2007). ATA Defining Telemedicine. Available at: http://www.atmeda.org/news/definition.html; last accessed 6 June 2008.Google Scholar
Anthony, K., Nagel, D. A. M. and Goss, S. (2010). The Use of Technology in Mental Health: Applications, Ethics and Practice. Springfield: Charles C. Thomas Publishing.Google Scholar
Ball, C. and McLaren, P. (1997). The tele-assessment of cognitive state: a review. Journal of Telemedicine and Telecare, 3, 126131.CrossRefGoogle ScholarPubMed
Ball, C. and Puffett, A. (1998). The assessment of cognitive function in the elderly using videoconferencing. Journal of Telemedicine and Telecare, 4, 3638.CrossRefGoogle ScholarPubMed
Ball, C. J., Scott, N., McLaren, P. M. and Watson, J. P. (1993). Preliminary evaluation of a low-cost videoconferencing (Lcvc) system for remote cognitive testing of adult psychiatric-patients. British Journal of Clinical Psychology, 32, 303307.CrossRefGoogle ScholarPubMed
Ball, C., Franco, A., Tyrrell, J. and Couturie, P. (1998). Videoconferencing and the hard of hearing. Journal of Telemedicine and Telecare, 4, 5759.CrossRefGoogle ScholarPubMed
Ball, C., Tyrrell, J. and Long, C. (1999). Scoring written material from the Mini-Mental State Examination: a comparison of face-to-face, fax and video-linked scoring. Journal of Telemedicine and Telecare, 5, 253256.CrossRefGoogle ScholarPubMed
Bilas, H. and Conn, D. K. (2002). Senior care and telehealth: the baycrest way. Long Term Care, 12, 2528.Google Scholar
Brebner, E. M. and Seymour, D. G. (2001). Telemedicine and the older patient. Age and Ageing, 30, 183184.CrossRefGoogle ScholarPubMed
Clarke, P. H. (1997). A referrer and patient evaluation of a telepsychiatry consultation-liaison service in South Australia. Journal of Telemedicine and Telecare, 3, 1214.CrossRefGoogle ScholarPubMed
Conn, D. K. and Bilas, H. (2000). Centre spreads geriatric expertise using teleheatlh, internet. Canadian Healthcare Technology, 5, 15.Google Scholar
Conn, D. K. and Bilas, H. (2001). Internet-based healthcare connects providers. Maximizing Human Potential (American Society on Aging), 9, 45.Google Scholar
Cruz, M., Cruz, R. F., Krupinski, E. A., Lopez, A. M., McNeeley, R. M. and Weinstein, R. S. (2004). Effect of camera resolution and bandwidth on facial affect recognition. Telemedicine Journal and E-Health, 10, 392402.CrossRefGoogle ScholarPubMed
Cruz, M., Krupinski, E. A., Lopez, A. M. and Weinstein, R. S. (2005). A review of the first five years of the University of Arizona telepsychiatry programme. Journal of Telemedicine and Telecare, 11, 234239.CrossRefGoogle ScholarPubMed
Cullum, C. M., Weiner, M. F., Gehrmann, H. R. and Hynan, L. S. (2006). Feasibility of telecognitive assessment in dementia. Assessment, 13, 385390. doi:10.1177/1073191106289065.CrossRefGoogle ScholarPubMed
De las Cuevas, C., Artiles, J., De La Fuente, J. and Serrano, P. (2003a). Telepsychiatry in the Canary Islands: user acceptance and satisfaction. Journal of Telemedicine and Telecare, 9, 221224.CrossRefGoogle ScholarPubMed
De las Cuevas, C., Artiles, J., de la Fuente, J. and Serrano, Y. P. (2003b). Telepsychiatry: utopia or welfare reality. Medicina clínica, 121, 149152.CrossRefGoogle ScholarPubMed
Fortney, J. C. et al. (2007). A randomized trial of telemedicine-based collaborative care for depression. Journal of General Internal Medicine, 22, 10861093.CrossRefGoogle ScholarPubMed
Frueh, B. C. et al. (2000). Procedural and methodological issues in telepsychiatry research and program development. Psychiatric Services, 51, 15221527.CrossRefGoogle ScholarPubMed
Garcia-Lizana, F. and Muñoz-Mayorga, I. (2010). What about telepsychiatry? A systematic review. Primary Care Companion to the Journal of Clinical Psychiatry, 12, PCC.09m00831. doi:10.4088/PCC.09m00831whi.Google ScholarPubMed
Greenwood, J., Chamberlain, C. and Parker, G. (2004). Evaluation of a rural telepsychiatry service. Australasian Psychiatry, 12, 268272.CrossRefGoogle ScholarPubMed
Grob, P., Weintraub, D., Sayles, D., Raskin, A. and Ruskin, P. (2001). Psychiatric assessment of a nursing home population using audiovisual telecommunication. Journal of Geriatric Psychiatry and Neurology, 14, 6365. doi:10.1177/089198870101400203.CrossRefGoogle ScholarPubMed
Hildebrand, R., Chow, H., Williams, C., Nelson, M. and Wass, P. (2004). Feasibility of neuropsychological testing of older adults via videoconference: implications for assessing the capacity for independent living. Journal of Telemedicine and Telecare, 10, 130134.CrossRefGoogle ScholarPubMed
Hilty, D. M., Marks, S. L., Urness, D., Yellowlees, P. M. and Nesbitt, T. S. (2004). Clinical and educational telepsychiatry applications: a review. Canadian Journal of Psychiatry, 49, 1223.CrossRefGoogle ScholarPubMed
Hilty, D. M., Yellowlees, P. M., Cobb, H. C., Bourgeois, J. A., Neufeld, J. D. and Nesbitt, T. S. (2006a). Models of telepsychiatric consultation-liaison service to rural primary care. Psychosomatics, 47, 152157.CrossRefGoogle ScholarPubMed
Hilty, D. M., Yellowlees, P. M. and Nesbitt, T. S. (2006b). Evolution of telepsychiatry to rural sites: changes over time in types of referral and in primary care providers’ knowledge, skills and satisfaction. General Hospital Psychiatry, 28, 367373. doi:10.1016/j.genhosppsych.2006.05.009.CrossRefGoogle ScholarPubMed
Hubble, J. P., Pahwa, R., Michalek, D. K., Thomas, C. and Koller, W. C. (1993). Interactive video conferencing: a means of providing interim care to Parkinson's disease patients. Movement Disorders, 8, 380382.CrossRefGoogle ScholarPubMed
Hui, E. and Woo, J. (2002). Telehealth for older patients: the Hong Kong experience. Journal of Telemedicine and Telecare, 8, S39S41.CrossRefGoogle Scholar
Hui, E. S., Woo, J., Hjelm, M., Zhang, Y. T. and Tsui, H. T. (2001). Telemedicine: a pilot study in nursing home residents. Gerontology, 47, 8287.CrossRefGoogle ScholarPubMed
Hyler, S. E. and Gangure, D. P. (2003). A review of the costs of telepsychiatry. Psychiatric Services, 54, 976980.CrossRefGoogle ScholarPubMed
Hyler, S. E., Gangure, D. P. and Batchelder, S. T. (2005). Can telepsychiatry replace in-person psychiatric assessments? A review and meta-analysis of comparison studies. CNS Spectrums, 10, 403413.CrossRefGoogle ScholarPubMed
Jacobsen, S. E., Sprenger, T., Andersson, S. and Krogstad, J. M. (2003). Neuropsychological assessment and telemedicine: a preliminary study examining the reliability of neuropsychology services performed via telecommunication. Journal of the International Neuropsychological Society, 9, 472478. doi:10.1017/S1355617703930128.CrossRefGoogle ScholarPubMed
Janca, A. (2000). Telepsychiatry: an update on technology and its applications. Current Opinion in Psychiatry, 13, 591597.CrossRefGoogle Scholar
Johnston, D. (2003). Telepsychiatry with a rural nursing facility. International Psychogeriatrics, 15, 14.Google Scholar
Johnston, D. and Jones, B. N. (2001) Telepsychiatry consultations to a rural nursing facility: a 2-year experience. Journal of Geriatric Psychiatry and Neurology, 14, 7275. doi:10.1177/089198870101400205.CrossRefGoogle Scholar
Jones, B. N. (1999). Telemedicine in geriatric psychiatry. Psychiatric Annals, 29, 416420.CrossRefGoogle Scholar
Jones, B. N. (2001). Telepsychiatry and geriatric care. Current Psychiatry Reports, 3, 2936.CrossRefGoogle ScholarPubMed
Jones, B. N. (2002). Suicide among the elderly: the promise of telecommunications. British Journal of Psychiatry, 181, 191192.CrossRefGoogle ScholarPubMed
Jones, B. N. (2003). Using communications to improve geriatric health care. International Psychogeriatrics, 15, 1415.Google Scholar
Jones, B. N. and Colenda, C. C. (1997). Telemedicine and geriatric psychiatry. Psychiatric Services, 48, 783785.Google ScholarPubMed
Jones, B. N. and Ruskin, P. E. (2001). Telemedicine and geriatric psychiatry: directions for future research and policy. Journal of Geriatric Psychiatry and Neurology, 14, 5962. doi:10.1177/089198870101400202.CrossRefGoogle ScholarPubMed
Jones, B. N., Exum, M. L. and McFarlane, M. (1996). Telemedicine ratings of geriatric depression. International Journal of Psychiatry in Medicine, 26, 392.Google Scholar
Jones, B. N., McCall, W. V. and Melton, B. (1997). Telemedicine ratings of geriatric depression. International Journal of Psychiatry in Medicine, 27, 332333.Google Scholar
Jones, B. N., Johnston, D., Reboussin, B. and McCall, W. V. (2001). Reliability of telepsychiatry assessments: subjective versus observational ratings. Journal of Geriatric Psychiatry and Neurology, 14, 6671.CrossRefGoogle ScholarPubMed
Jones, B. N., Cavanaugh, K. A. and Reboussin, B. A. (2002). Acceptance of telemedicine interviews by dementia patients. Neurobiology of Aging, 23, S46S47.Google Scholar
Kirk, A. et al. (2005). Mini-Mental State Examination scores are significantly lower when administered via telehealth (videoconferencing) than when administered in person to patients with early dementia. Journal of the Neurological Sciences, 238, S291S292.Google Scholar
Kobak, K. A. (2004). A comparison of face-to-face and videoconference administration of the Hamilton Depression Rating Scale. Journal of Telemedicine and Telecare, 10, 231235.CrossRefGoogle ScholarPubMed
Lee, J. H. et al. (2000). A telemedicine system as a care modality for dementia patients in Korea. Alzheimer Disease and Associated Disorders, 14, 94101.CrossRefGoogle ScholarPubMed
Leonard, S. (2004). The successes and challenges of developing a prison telepsychiatry service. Journal of Telemedicine and Telecare, 10, 6971.CrossRefGoogle ScholarPubMed
Liu, L. L. et al. (2006). Distance delivery of geriatric consultation to family physicians in rural Alberta: preliminary results. Proceedings of the Second IASTED International Conference on Telehealth, Banff, Alberta, Canada, 3–5 July 2006. 3437.Google Scholar
Loh, P. K., Ramesh, P., Maher, S., Saligari, J., Flicker, L. and Goldswain, P. (2004). Can patients with dementia be assessed at a distance? The use of Telehealth and standardised assessments. Internal Medicine Journal, 34, 239242.CrossRefGoogle Scholar
Loh, P. K., Maher, S., Goldswain, P., Flicker, L., Ramesh, P. and Saligari, J. (2005). Diagnostic accuracy of telehealth community dementia assessments. Journal of the American Geriatrics Society, 53, 20432044.CrossRefGoogle ScholarPubMed
Loh, P. K., Donaldson, M., Flicker, L., Maher, S. and Goldswain, P. (2007). Development of a telemedicine protocol for the diagnosis of Alzheimer's disease. Journal of Telemedicine and Telecare, 13, 9094.CrossRefGoogle ScholarPubMed
Lyketsos, C. G., Roques, C., Hovanec, L. and Jones, B. N. (2001). Telemedicine use and the reduction of psychiatric admissions from a long-term care facility. Journal of Geriatric Psychiatry and Neurology, 14, 7679. doi:10.1177/089198870101400206.CrossRefGoogle ScholarPubMed
Maheu, M. M., Pulier, M. L., Wilhelm, F. H., McMenamin, J. P. and Brown-Connolly, N. E. (2005). The Mental Health Professional and the New Technologies: A Handbook for Practice Today. Mahwah, NJ and London: Lawrence Erlbaum Associates.Google Scholar
Martin-Khan, M., Varghese, P., Wootton, R. and Gray, L. (2007). Successes and failures in assessing cognitive function in older adults using video consultation. Journal of Telemedicine and Telecare, 13, 6062.CrossRefGoogle Scholar
Martin-Khan, M., Varghese, P., Wootton, R. and Gray, L. (2008). Physical examination and diagnosis of dementia for video consultation. Journal of the American Geriatrics Society, 56, 947949. doi:10.1111/j.1532-5415.2008.01658.x.CrossRefGoogle ScholarPubMed
Matsuura, S. et al. (2000). Application of telepsychiatry: a preliminary study. Psychiatry and Clinical Neurosciences, 54, 5558.CrossRefGoogle ScholarPubMed
McGinty, K. L., Saeed, S. A., Simmons, S. C. and Yidirim, Y. (2006). Telepsychiatry and e-mental health services: potential for improving access to mental health care. Psychiatric Quarterly, 77, 335342. doi:10.1007/s11126-006-9019-6.CrossRefGoogle ScholarPubMed
Melaka, A., Edirippulige, S. and Appendices, T. (2009). Psych-technology: a systematic review of the telepsychiatry literature. Psychiatry On Line, 30, 111.Google Scholar
Menon, A. S. et al. (2001). Evaluation of a portable low cost videophone system in the assessment of depressive symptoms and cognitive function in elderly medically ill veterans. Journal of Nervous and Mental Disease, 189, 399401.CrossRefGoogle ScholarPubMed
Mitka, M. (2003). Telemedicine eyed for mental health services - approach could widen access for older patients. JAMA, 290, 18421843.Google ScholarPubMed
Monnier, J., Knapp, R. G. and Frueh, B. C. (2003). Recent advances in telepsychiatry: an updated review. Psychiatric Services, 54, 16041609.CrossRefGoogle ScholarPubMed
Montani, C. et al. (1996). “Telepsychometry”: a remote psychometry consultation in clinical gerontology: preliminary study. Telemedicine Journal, 2, 145150.CrossRefGoogle ScholarPubMed
Montani, C. et al. (1997). Psychological impact of a remote psychometric consultation with hospitalized elderly people. Journal of Telemedicine and Telecare, 3, 140145.CrossRefGoogle ScholarPubMed
Mucic, D. (2010). Transcultural telepsychiatry and its impact on patient satisfaction. Journal of Telemedicine and Telecare, 16, 237242.CrossRefGoogle ScholarPubMed
Norman, S. (2006). The use of telemedicine in psychiatry. Journal of Psychiatric and Mental Health Nursing, 13, 771777.CrossRefGoogle ScholarPubMed
O'Reilly, R., Bishop, J., Maddox, K., Hutchinson, L., Fisman, M. and Takhar, J. (2007). Is telepsychiatry equivalent to face-to-face psychiatry? Results from a randomized controlled equivalence trial. Psychiatric Services, 58, 836843. doi:10.1177/089198870101400206.CrossRefGoogle ScholarPubMed
Pulier, M. L. (2007). Technology, geriatric practice, and the future of Psychiatry. Journal of Psychiatric Practice, 13, 269272.CrossRefGoogle ScholarPubMed
Rabinowitz, et al. (2004). Minimum data set facilitates telepsychiatry consultations for nursing home residents. Ninth Annual Meeting and Exposition of the American Telemedicine Association. Tampa, Florida, 2–5 May 2004.Google Scholar
Rabinowitz, T., Murphy, K., Amour, J., Ricci, M., Caputo, M. and Newhouse, P. (2010). Benefits of a telepsychiatry consultation service for rural nursing home residents. Telemedicine and E-Health, 16, 3440.CrossRefGoogle ScholarPubMed
Saligari, J., Flicker, L., Loh, P. K., Maher, S., Ramesh, P. and Goldswain, P. (2002). The clinical achievements of a geriatric telehealth project in its first year. Journal of Telemedicine and Telecare, 8, 5355.CrossRefGoogle ScholarPubMed
Sävenstedt, S., Bucht, G., Norberg, L. and Sandman, P. O. (2002). Nurse-doctor interaction in teleconsultations between a hospital and a geriatric nursing home. Journal of Telemedicine and Telecare, 8, 1118.CrossRefGoogle Scholar
Sävenstedt, S., Zingmark, K. and Sandman, P. O. (2003). Video-phone communication with cognitively impaires elderly patients. Journal of Telemedicine and Telecare, 9 (Suppl. 2), S52S54.CrossRefGoogle Scholar
Sävenstedt, S., Zingmark, K., Hyden, L. C. and Brulin, C. (2005). Establishing joint attention in remote talks with the elderly about health: a study of nurses’ conversation with elderly persons in teleconsultations. Scandinavian Journal of Caring Sciences, 19, 317324.CrossRefGoogle Scholar
Schopp, L., Johnstone, B. and Merrell, D. (2000). Telehealth and neuropsychological assessment: new opportunities for psychologists. Professional Psychology-Research and Practice, 31, 179183. doi:10.1037/0735-7028.31.2.179.CrossRefGoogle Scholar
Schopp, L. H., Johnstone, B. and Reid-Arndt, S. (2005). Telehealth brain injury training for rural behavioural health generalists: supporting and enhancing rural service delivery networks. Professional Psychology: Research and Practice, 36, 158163. doi:10.1037/0735-7028.36.2.158.CrossRefGoogle Scholar
Shore, J. H. and Manson, S. M. (2005). A developmental model for rural telepsychiatry. Psychiatric Services, 56, 976980.CrossRefGoogle ScholarPubMed
Shore, J. H., Savin, D., Novins, D. and Manson, S. M. (2006). Cultural aspects of telepsychiatry. Journal of Telemedicine and Telecare, 12, 116121.CrossRefGoogle ScholarPubMed
Shore, J. H., Savin, D., Orton, H., Beals, J. and Manson, S. M. (2007). Diagnostic reliability of telepsychiatry in American Indian veterans. American Journal of Psychiatry, 164, 115118.CrossRefGoogle ScholarPubMed
Shores, M. M. et al. (2004). Identifying undiagnosed dementia in residential care veterans: comparing telemedicine to in-person clinical examination. International Journal of Geriatric Psychiatry, 19, 101108. doi:10.1002/gps.1029.CrossRefGoogle ScholarPubMed
Shulman, B., Conn, D. K. and Elford, R. (2006). Geriatric telepsychiatry and telemedicine: a literature review. Canadian Journal of Geriatrics, 9, 139146.Google Scholar
Simpson, J., Doze, S., Urness, D., Hailey, D. and Jacobs, P. (2001). Evaluation of a routine telepsychiatry service. Journal of Telemedicine and Telecare, 7, 9098.CrossRefGoogle ScholarPubMed
Snowdon, J. (2010). Mental health service delivery in long-term care homes. International Psychogeriatrics, 22, 10631071.CrossRefGoogle ScholarPubMed
Sumner, C. R. (2001). Telepsychiatry: challenges in rural aging. Journal of Rural Health, 17, 370373.CrossRefGoogle ScholarPubMed
Tang, W. K., Chiu, H., Woo, J., Hjelm, M. and Hui, E. (2001). Telepsychiatry in psychogeriatric service: a pilot study. International Journal of Geriatric Psychiatry, 16, 8893.3.0.CO;2-W>CrossRefGoogle ScholarPubMed
Trinkle, D. (2003). Geriatric psychiatry telemedicine consultation project to rural nursing homes in Virginia. International Psychogeriatrics, 15, 14.Google Scholar
Tyrrell, J., Couturier, P., Montani, C. and Franco, A. (2001). Teleconsultation in psychology: the use of videolinks for interviewing and assessing elderly patients. Age and Ageing, 30, 191195.CrossRefGoogle ScholarPubMed
Urness, D., Hailey, D., Delday, L., Callanan, T. and Orlik, H. (2004). The status of telepsychiatry services in Canada: a national survey. Journal of Telemedicine and Telecare, 10, 160164.CrossRefGoogle ScholarPubMed
Urness, D., Wass, M., Gordon, A., Tian, E. and Bulger, T. (2006). Client acceptability and quality of life - telepsychiatry compared to in-person consultation. Journal of Telemedicine and Telecare, 12, 251254.CrossRefGoogle ScholarPubMed
Vilalta-Franch, J., Garre-Olmo, J., Lopez-Pousa, S., Coll-De Tuero, G. and Monserrat-Vila, S. (2007). Telemedicine and dementia: a need for the 21st century. Revista de Neuroloía, 44, 556561.Google Scholar
Werner, A. and Anderson, L. E. (1998). Rural telepsychiatry is economically unsupportable: the Concorde crashes in a cornfield. Psychiatric Services, 49, 12871290.CrossRefGoogle Scholar
Wittson, C. L. and Benschoter, R. (1972). Two-way television: helping the medical center reach out. American Journal of Psychiatry, 129, 624627.CrossRefGoogle ScholarPubMed
Wootton, R., Yellowlees, P. and McLaren, P. (2003). Telepsychiatry and E-Mental Health. London: Royal Society of Medicine Press.Google Scholar
Yeung, A., Johnson, D. P., Trinh, N. H., Weng, W. C. C., Kvedar, J. and Fava, M. (2009). Feasibility and effectiveness of telepsychiatry services for Chinese immigrants in a nursing home. Telemedicine and E-Health, 15, 336341.CrossRefGoogle ScholarPubMed