Hostname: page-component-f554764f5-8cg97 Total loading time: 0 Render date: 2025-04-10T16:41:28.578Z Has data issue: false hasContentIssue false
  • English
  • Français

Ecological momentary facial emotion recognition in psychotic disorders

Published online by Cambridge University Press:  12 January 2021

Colin A. Depp ,
Snigdha Kamarsu Open the ORCID record for Snigdha Kamarsu [Opens in a new window] ,
Tess F. Filip ,
Emma M. Parrish ,
Philip D. Harvey ,
Eric L. Granholm ,
Samantha Chalker ,
Raeanne C. Moore  and
Amy Pinkham
Colin A. Depp*
Affiliation:
University of California San Diego Department of Psychiatry, San Diego, California, USA Veterans Affairs San Diego Healthcare System, San Diego, California, USA
Snigdha Kamarsu
Affiliation:
University of California San Diego Department of Psychiatry, San Diego, California, USA
Tess F. Filip
Affiliation:
University of California San Diego Department of Psychiatry, San Diego, California, USA
Emma M. Parrish
Affiliation:
University of California San Diego Department of Psychiatry, San Diego, California, USA San Diego State University/University of California San Diego Joint Doctoral Program in Clinical Psychology, San Diego, California, USA
Philip D. Harvey
Affiliation:
University of Miami Miller School of Medicine, Miami, FL, USA Research Service, Bruce W. Carter VA Medical Center, Miami, FL, USA
Eric L. Granholm
Affiliation:
University of California San Diego Department of Psychiatry, San Diego, California, USA Veterans Affairs San Diego Healthcare System, San Diego, California, USA
Samantha Chalker
Affiliation:
Veterans Affairs San Diego Healthcare System, San Diego, California, USA
Raeanne C. Moore
Affiliation:
University of California San Diego Department of Psychiatry, San Diego, California, USA
Amy Pinkham
Affiliation:
The University of Texas at Dallas, Dallas, TX, USA
*
Author for correspondence: Colin Depp, E-mail: [email protected]
Get access Rights & Permissions [Opens in a new window]

Abstract

Background

Cognitive tasks delivered during ecological momentary assessment (EMA) may elucidate the short-term dynamics and contextual influences on cognition and judgements of performance. This paper provides initial validation of a smartphone task of facial emotion recognition in serious mental illness.

Methods

A total of 86 participants with psychotic disorders (non-affective and affective psychosis), aged 19–65, were administered in-lab ‘gold standard’ affect recognition, neurocognition, and symptom assessments. They subsequently completed 10 days of the mobile facial emotion recognition task, assessing both accuracy and self-assessed performance, along with concurrent EMA of psychotic symptoms and mood. Validation focused on task adherence and predictors of adherence, gold standard convergent validity, and symptom and diagnostic group variation.

Results

The mean rate of adherence to the task was 79%; no demographic or clinical variables predicted adherence. Convergent validity was observed with in-lab measures of facial emotion recognition, and no practice effects were observed on the mobile facial emotion recognition task. EMA reports of more severe voices, sadness, and paranoia were associated with worse performance, whereas mood more strongly associated with self-assessed performance.

Conclusion

The mobile facial emotion recognition task was tolerated and demonstrated convergent validity with in-lab measures of the same construct. Social cognitive performance, and biased judgements previously shown to predict function, can be evaluated in real-time in naturalistic environments.

Keywords

Mobile technologypsychometric assessmentpsychosissocial cognitiontime series analysis
Type
Original Article
Information
Psychological Medicine , Volume 52 , Issue 13 , October 2022 , pp. 2531 - 2539
Check for updates
Copyright
Copyright © The Author(s), 2021. Published by Cambridge University Press

Access options

Get access to the full version of this content by using one of the access options below. (Log in options will check for institutional or personal access. Content may require purchase if you do not have access.)

Article purchase

Temporarily unavailable

References

Allard, M., Husky, M., Catheline, G., Pelletier, A., Dilharreguy, B., Amieva, H., … Swendsen, J. (2014). Mobile technologies in the early detection of cognitive decline. PLoS ONE, 9(12), e112197. doi:10.1371/journal.pone.0112197.CrossRefGoogle ScholarPubMed
Balzan, R. P., Woodward, T. S., Delfabbro, P., & Moritz, S. (2016). Overconfidence across the psychosis continuum: A calibration approach. Cognitive Neuropsychiatry, 21(6), 510–524. doi:10.1080/13546805.2016.1240072.CrossRefGoogle ScholarPubMed
Brandt, J., & Benedict, R. H. B. (2001). The Hopkins verbal learning test – revised. Odessa, FL: Psychological Assessment Resources.Google Scholar
Bryson, G., Bell, M., & Lysaker, P. (1997). Affect recognition in schizophrenia: A function of global impairment or a specific cognitive deficit. Psychiatry Research, 71(2), 105–113. doi:10.1016/s0165-1781(97)00050-4.CrossRefGoogle ScholarPubMed
Comparelli, A., Corigliano, V., De Carolis, A., Mancinelli, I., Trovini, G., Ottavi, G., … Girardi, P. (2013). Emotion recognition impairment is present early and is stable throughout the course of schizophrenia. Schizophrenia Research, 143(1), 65–69. doi:10.1016/j.schres.2012.11.005.CrossRefGoogle ScholarPubMed
Cornacchio, D., Pinkham, A. E., Penn, D. L., & Harvey, P. D. (2017). Self-assessment of social cognitive ability in individuals with schizophrenia: Appraising task difficulty and allocation of effort. Schizophrenia Research, 179, 85–90. doi:10.1016/j.schres.2016.09.033.CrossRefGoogle ScholarPubMed
Fett, A.-K. J., Maat, A., & Investigators, G. (2013). Social cognitive impairments and psychotic symptoms: What is the nature of their association? Schizophrenia Bulletin, 39(1), 77–85. doi:10.1093/schbul/sbr058.CrossRefGoogle ScholarPubMed
Fett, A.-K. J., Viechtbauer, W., Penn, D. L., van Os, J., & Krabbendam, L. (2011). The relationship between neurocognition and social cognition with functional outcomes in schizophrenia: A meta-analysis. Neuroscience & Biobehavioral Reviews, 35(3), 573–588. doi:10.1016/j.neubiorev.2010.07.001.CrossRefGoogle ScholarPubMed
First, M. B., Williams, J. B. W., Karg, R. S., & Spitzer, R. L. (2015). Structured clinical interview for DSM-5 – research version (SCID-5 for DSM-5, research version; SCID-5-RV). Arlington, VA: American Psychiatric Association.Google Scholar
Gold, J. M., Carpenter, C., Randolph, C., Goldberg, T. E., & Weinberger, D. R. (1997). Auditory working memory and Wisconsin card sorting test performance in schizophrenia. Archives of General Psychiatry, 54, 159–165. doi:10.1001/archpsyc.1997.01830140071013.CrossRefGoogle Scholar
Gould, F., McGuire, L. S., Durand, D., Sabbag, S., Larrauri, C., Patterson, T. L., … Harvey, P. D. (2015). Self-assessment in schizophrenia: Accuracy of evaluation of cognition and everyday functioning. Neuropsychology, 29(5), 675–682. doi:10.1037/neu0000175.CrossRefGoogle ScholarPubMed
Gould, F., Sabbag, S., Durand, D., Patterson, T. L., & Harvey, P. D. (2013). Self-assessment of functional ability in schizophrenia: Milestone achievement and its relationship to accuracy of self-evaluation. Psychiatry Research, 207(1–2), 19–24. doi:10.1016/j.psychres.2013.02.035.CrossRefGoogle ScholarPubMed
Green, M. F., Bearden, C. E., Cannon, T. D., Fiske, A. P., Hellemann, G. S., Horan, W. P., … Nuechterlein, K. H. (2012). Social cognition in schizophrenia, part 1: Performance across phase of illness. Schizophrenia Bulletin, 38(4), 854–864. doi:10.1093/schbul/sbq171.CrossRefGoogle ScholarPubMed
Green, M. F., Horan, W. P., & Lee, J. (2015). Social cognition in schizophrenia. Nature Reviews Neuroscience, 16(10), 620–631. doi:10.1038/nrn4005.CrossRefGoogle ScholarPubMed
Gur, R. C., Sara, R., Hagendoorn, M., Marom, O., Hughett, P., Macy, L., … Gur, R. E. (2002). A method for obtaining 3-dimensional facial expressions and its standardization for use in neurocognitive studies. Journal of Neuroscience Methods, 115(2), 137–143. doi:10.1016/s0165-0270(02)00006-7.CrossRefGoogle ScholarPubMed
Hajduk, M., Harvey, P. D., Penn, D. L., & Pinkham, A. E. (2018). Social cognitive impairments in individuals with schizophrenia vary in severity. Journal of Psychiatric Research, 104, 65–71. doi:10.1016/j.jpsychires.2018.06.017.CrossRefGoogle ScholarPubMed
Harvey, P. D., Deckler, E., Jones, M. T., Jarskog, L. F., Penn, D. L., & Pinkham, A. E. (2019). Autism symptoms, depression, and active social avoidance in schizophrenia: Association with self-reports and informant assessments of everyday functioning. Journal of Psychiatric Research, 115, 36–42. doi:10.1016/j.jpsychires.2019.05.010.CrossRefGoogle ScholarPubMed
Harvey, P. D., Paschall, G., & Depp, C. (2015). Factors influencing self-assessment of cognition and functioning in bipolar disorder: A preliminary study. Cognitive Neuropsychiatry, 20(4), 361–371. doi:10.1080/13546805.2015.1044510.CrossRefGoogle ScholarPubMed
Harvey, P. D., & Pinkham, A. E. (2015). Impaired self-assessment in schizophrenia: Why patients misjudge their cognition and functioning. Current Psychiatry, 14(4), 53–59.Google Scholar
Harvey, P. D., Strassnig, M. T., & Silberstein, J. (2019). Prediction of disability in schizophrenia: Symptoms, cognition, and self-assessment. Journal of Experimental Psychopathology, 10(3), 1–20. 2043808719865693..CrossRefGoogle Scholar
Hoe, M., Nakagami, E., Green, M., & Brekke, J. (2012). The causal relationships between neurocognition, social cognition and functional outcome over time in schizophrenia: A latent difference score approach. Psychological Medicine, 42(11), 2287–2299. doi:10.1017/S0033291712000578.CrossRefGoogle ScholarPubMed
Janssens, M., Lataster, T., Simons, C., Oorschot, M., Lardinois, M., Van Os, J., & Myin-Germeys, I. (2012). Emotion recognition in psychosis: No evidence for an association with real world social functioning. Schizophrenia Research, 142(1–3), 116–121. doi:10.1016/j.schres.2012.10.003.CrossRefGoogle ScholarPubMed
Jones, M. T., Deckler, E., Laurrari, C., Jarskog, L. F., Penn, D. L., Pinkham, A. E., & Harvey, P. D. (2020). Confidence, performance, and accuracy of self-assessment of social cognition: A comparison of schizophrenia patients and healthy controls. Schizophrenia Research Cognition, 19, 002. doi:10.1016/j.scog.2019.01.002.CrossRefGoogle ScholarPubMed
Jongstra, S., Wijsman, L. W., Cachucho, R., Hoevenaar-Blom, M. P., Mooijaart, S. P., & Richard, E. (2017). Cognitive testing in people at increased risk of dementia using a smartphone app: The iVitality proof-of-principle study. JMIR mHealth and uHealth, 5(5), e68. doi:10.2196/mhealth.6939.CrossRefGoogle ScholarPubMed
Kay, S. R., Fiszbein, A., & Opler, L. A. (1987). The positive and negative syndrome scale (PANSS) for schizophrenia. Schizophrenia Bulletin, 13(2), 261–276. doi:10.1093/schbul/13.2.261.CrossRefGoogle Scholar
Keefe, R. S., Goldberg, T. E., Harvey, P. D., Gold, J. M., Poe, M. P., & Coughenour, L. (2004). The brief assessment of cognition in schizophrenia: Reliability, sensitivity, and comparison with a standard neurocognitive battery. Schizophrenia Research, 68(2–3), 283–297. doi:10.1016/j.schres.2003.09.011.CrossRefGoogle ScholarPubMed
Kohler, C. G., Turner, T. H., Bilker, W. B., Brensinger, C. M., Siegel, S. J., Kanes, S. J., … Gur, R. C. (2003). Facial emotion recognition in schizophrenia: Intensity effects and error pattern. The American Journal of Psychiatry, 160(10), 1768–1774. doi:10.1176/appi.ajp.160.10.1768.CrossRefGoogle ScholarPubMed
Köther, U., Veckenstedt, R., Vitzthum, F., Roesch-Ely, D., Pfueller, U., Scheu, F., & Moritz, S. (2012). “Don't give me that look” – overconfidence in false mental state perception in schizophrenia. Psychiatry Research, 196(1), 1–8. doi:10.1016/j.psychres.2012.03.004.CrossRefGoogle Scholar
Kring, A. M., Gur, R. E., Blanchard, J. J., Horan, W. P., & Reise, S. P. (2013). The clinical assessment interview for negative symptoms (CAINS): Final development and validation. The American Journal of Psychiatry, 170(2), 165–172. doi:10.1176/appi.ajp.2012.12010109.CrossRefGoogle ScholarPubMed
Lahera, G., Ruiz-Murugarren, S., Iglesias, P., Ruiz-Bennasar, C., Herreria, E., Montes, J. M., & Fernandez-Liria, A. (2012). Social cognition and global functioning in bipolar disorder. The Journal of Nervous and Mental Disease, 200(2), 135–141. doi:10.1097/NMD.0b013e3182438eae.CrossRefGoogle ScholarPubMed
McCleery, A., Lee, J., Fiske, A. P., Ghermezi, L., Hayata, J. N., Hellemann, G. S., … Green, M. F. (2016). Longitudinal stability of social cognition in schizophrenia: A 5-year follow-up of social perception and emotion processing. Schizophrenia Research, 176(2–3), 467–472. doi:10.1016/j.schres.2016.07.008.CrossRefGoogle ScholarPubMed
Mehta, U. M., Thirthalli, J., Subbakrishna, D., Gangadhar, B. N., Eack, S. M., & Keshavan, M. S. (2013). Social and neuro-cognition as distinct cognitive factors in schizophrenia: A systematic review. Schizophrenia Research, 148(1–3), 3–11. doi:10.1016/j.schres.2013.05.009.CrossRefGoogle ScholarPubMed
Montgomery, S. A., & Åsberg, M. (1979). A new depression scale designed to be sensitive to change. The British Journal of Psychiatry, 134(4), 382–389. doi:10.1192/bjp.134.4.382.CrossRefGoogle ScholarPubMed
Moore, R. C., Campbell, L. M., Delgadillo, J. D., Paolillo, E. W., Sundermann, E. E., Holden, J., … Swendsen, J. (2020). Smartphone-based measurement of executive function in older adults with and without HIV. Archives of Clinical Neuropsychology, 35(4), 347–357. doi:10.1093/arclin/acz084.CrossRefGoogle ScholarPubMed
Moore, R. C., Swendsen, J., & Depp, C. A. (2017). Applications for self-administered mobile cognitive assessments in clinical research: A systematic review. International Journal of Methods in Psychiatric Research, 26(4), e1562. doi:10.1002/mpr.1562.CrossRefGoogle ScholarPubMed
Moritz, S., Balzan, R. P., Bohn, F., Veckenstedt, R., Kolbeck, K., Bierbrodt, J., & Dietrichkeit, M. (2016). Subjective versus objective cognition: Evidence for poor metacognitive monitoring in schizophrenia. Schizophrenia Research, 178(1–3), 74–79. doi:10.1016/j.schres.2016.08.021.CrossRefGoogle Scholar
Moritz, S., Goritz, A. S., Gallinat, J., Schafschetzy, M., Van Quaquebeke, N., Peters, M. J., & Andreou, C. (2015). Subjective competence breeds overconfidence in errors in psychosis. A hubris account of paranoia. Journal of Behavior Therapy and Experimental Psychiatry, 48, 118–124. doi:10.1016/j.jbtep.2015.02.011.CrossRefGoogle ScholarPubMed
Mote, J., & Fulford, D. (2020). Ecological momentary assessment of everyday social experiences of people with schizophrenia: A systematic review. Schizophrenia Research, 216, 56–68. doi:10.1016/j.schres.2019.10.021.CrossRefGoogle ScholarPubMed
Nuechterlein, K. H., Green, M. F., Kern, R. S., Baade, L. E., Barch, D. M., Cohen, J. D., … Marder, S. R. (2008). The MATRICS consensus cognitive battery, part 1: Test selection, reliability, and validity. The American Journal of Psychiatry, 165(2), 203–213. doi:10.1176/appi.ajp.2007.07010042.CrossRefGoogle ScholarPubMed
Pinkham, A. E., Harvey, P. D., & Penn, D. L. (2016). Paranoid individuals with schizophrenia show greater social cognitive bias and worse social functioning than non-paranoid individuals with schizophrenia. Schizophrenia Research: Cognition, 3, 33–38. doi:10.1016/j.scog.2015.11.002.Google ScholarPubMed
Pinkham, A. E., Harvey, P. D., & Penn, D. L. (2018). Social cognition psychometric evaluation: Results of the final validation study. Schizophrenia Bulletin, 44(4), 737–748. doi:10.1093/schbul/sbx117.CrossRefGoogle ScholarPubMed
Pinkham, A. E., Penn, D. L., Green, M. F., & Harvey, P. D. (2016). Social cognition psychometric evaluation: Results of the initial psychometric study. Schizophrenia Bulletin, 42(2), 494–504. doi:10.1093/schbul/sbv056.CrossRefGoogle ScholarPubMed
Posner, K., Brown, G. K., Stanley, B., Brent, D. A., Yershova, K. V., Oquendo, M. A., … Shen, S. (2011). The Columbia–Suicide Severity Rating Scale: Initial validity and internal consistency findings from three multisite studies with adolescents and adults. American Journal of Psychiatry, 168(12), 1266–1277. doi: 10.1176/appi.ajp.2011.10111704.CrossRefGoogle ScholarPubMed
Schweitzer, P., Husky, M., Allard, M., Amieva, H., Pérès, K., Foubert-Samier, A., … Swendsen, J. (2017). Feasibility and validity of mobile cognitive testing in the investigation of age-related cognitive decline. International Journal of Methods in Psychiatric Research, 26(3), e1521. doi:10.1002/mpr.1521.CrossRefGoogle ScholarPubMed
Sheehan, D. V., Lecrubier, Y., Sheehan, K. H., Amorim, P., Janavs, J., Weiller, E., … Dunbar, G. C. (1998). The Mini-International Neuropsychiatric Interview (M.I.N.I.): The development and validation of a structured diagnostic psychiatric interview for DSM-IV and ICD-10. The Journal of Clinical Psychiatry, 59(Suppl 20), 22–33, quiz 34–57. Retrieved from https://www.ncbi.nlm.nih.gov/pubmed/9881538.Google ScholarPubMed
Silberstein, J. M., & Harvey, P. D. (2019). Impaired introspective accuracy in schizophrenia: An independent predictor of functional outcomes. Cognitive Neuropsychiatry, 24(1), 28–39.CrossRefGoogle ScholarPubMed
Silberstein, J. M., Pinkham, A. E., Penn, D. L., & Harvey, P. D. (2018). Self-assessment of social cognitive ability in schizophrenia: Association with social cognitive test performance, informant assessments of social cognitive ability, and everyday outcomes. Schizophrenia Research, 199, 75–82. doi:10.1016/j.schres.2018.04.015.CrossRefGoogle ScholarPubMed
Spreen, O. (1991). Controlled oral word association (word fluency). In Spreen, O., & Strauss, E. (Eds.), A compendium of neuropsychological tests (pp. 447–463). Oxford: Oxford University Press.Google Scholar
Tombaugh, T. N. (2004). Trail Making Test A and B: Normative data stratified by age and education. Archives of Clinical Neuropsychology, 19(2), 203–214. doi:10.1016/S0887-6177(03)00039-8.CrossRefGoogle Scholar
Twisk, J. W. (2019). Applied mixed model analysis: A practical guide. Cambridge, England: Cambridge University Press.CrossRefGoogle Scholar
Ventura, J., Wood, R. C., & Hellemann, G. S. (2013). Symptom domains and neurocognitive functioning can help differentiate social cognitive processes in schizophrenia: A meta-analysis. Schizophrenia Bulletin, 39(1), 102–111. doi:10.1093/schbul/sbr067CrossRefGoogle ScholarPubMed
Wilkinson, G. S., & Robertson, G. J. (2006). Wide range achievement test 4 professional manual. Lutz, FL: Psychological Assessment Resources.Google Scholar
Young, R. C., Biggs, J. T., Ziegler, V. E., & Meyer, D. A. (1978). A rating scale for mania: Reliability, validity and sensitivity. British Journal of Psychiatry, 133(5), 429–435. doi:10.1192/bjp.133.5.429.CrossRefGoogle ScholarPubMed
Supplementary material: File

Depp et al. supplementary material

Table S1

Download Depp et al. supplementary material(File)
File 29.2 KB