Hostname: page-component-586b7cd67f-vdxz6 Total loading time: 0 Render date: 2024-11-29T12:49:25.115Z Has data issue: false hasContentIssue false
  • English
  • Français

Recognizing vocal expressions of emotion in patients with social skills deficits following traumatic brain injury

Published online by Cambridge University Press:  04 February 2010

A. DIMOSKA ,
S. MCDONALD ,
M.C. PELL ,
R.L. TATE  and
C.M. JAMES
A. DIMOSKA
Affiliation:
School of Psychology, University of New South Wales, Kensington 2052 NSW, Australia
S. MCDONALD*
Affiliation:
School of Psychology, University of New South Wales, Kensington 2052 NSW, Australia
M.C. PELL
Affiliation:
School of Communication Sciences & Disorders, McGill University, Montreal Quebec H3G 1A8, Canada
R.L. TATE
Affiliation:
Rehabilitation Studies Unit, Northern Central Clinical School, University of Sydney, Sydney 2006 NSW, Australia
C.M. JAMES
Affiliation:
School of Psychology, University of New South Wales, Kensington 2052 NSW, Australia
*
*Correspondence and reprint requests to: Skye McDonald, School of Psychology, University of NSW, Kensington NSW 2052, Australia. E-mail: [email protected]
Get access Rights & Permissions [Opens in a new window]

Abstract

Perception of emotion in voice is impaired following traumatic brain injury (TBI). This study examined whether an inability to concurrently process semantic information (the “what”) and emotional prosody (the “how”) of spoken speech contributes to impaired recognition of emotional prosody and whether impairment is ameliorated when little or no semantic information is provided. Eighteen individuals with moderate-to-severe TBI showing social skills deficits during inpatient rehabilitation were compared with 18 demographically matched controls. Participants completed two discrimination tasks using spoken sentences that varied in the amount of semantic information: that is, (1) well-formed English, (2) a nonsense language, and (3) low-pass filtered speech producing “muffled” voices. Reducing semantic processing demands did not improve perception of emotional prosody. The TBI group were significantly less accurate than controls. Impairment was greater within the TBI group when accessing semantic memory to label the emotion of sentences, compared with simply making “same/different” judgments. Findings suggest an impairment of processing emotional prosody itself rather than semantic processing demands which leads to an over-reliance on the “what” rather than the “how” in conversational remarks. Emotional recognition accuracy was significantly related to the ability to inhibit prepotent responses, consistent with neuroanatomical research suggesting similar ventrofrontal systems subserve both functions. (JINS, 2010, 16, 369–382.)

Keywords

Emotion perceptionProsodySemanticInhibitory controlFilteredNonsense
Type
Research Articles
Information
Journal of the International Neuropsychological Society , Volume 16 , Issue 2 , March 2010 , pp. 369 - 382
Copyright
Copyright © The International Neuropsychological Society 2010

Access options

Get access to the full version of this content by using one of the access options below. (Log in options will check for institutional or personal access. Content may require purchase if you do not have access.)

References

REFERENCES

Adolphs, R. (2002). Recognising emotion from facial expressions: Psychological and neurological mechanisms. Behavioural and Cognitive Neuroscience Reviews, 1, 21–61.Google Scholar
Adolphs, R., Damasio, H., Tranel, D., Cooper, G., & Damasio, A.R. (2000). A role for somatosensory cortices in the visual recognition of emotion as revealed by three-dimensional lesion mapping. Journal of Neuroscience, 20, 2683–2690.Google Scholar
Baum, S.R., & Pell, M.D. (1999). The neural bases of prosody: Insights from lesion studies and neuroimaging. Aphasiology, 13, 581–608.Google Scholar
Beaucousin, V., Lacheret, A., Turbelin, M.-R., Morel, M., Mazoyer, B., & Tzourio-Mazoyer, B. (2007). FMRI study of emotional speech comprehension. Cerebral Cortex, 17, 339–352.Google Scholar
Bechara, A., Tranel, D., Damasio, H., & Damasio, A. (1996). Failure to respond automatically to anticipated future outcomes following damage to prefrontal cortex. Cerebral Cortex, 6, 215–225.Google Scholar
Behrens, S.J. (1985). The perception of stress and lateralization of prosody. Brain and Language, 26, 332–348.CrossRefGoogle ScholarPubMed
Besle, J., Fort, A., Delpeuch, C., & Giard, M.-H. (2004). Bimodal speech: Early suppressive visual effects in the human auditory cortex. European Journal of Neuroscience, 20, 2225–2234.CrossRefGoogle ScholarPubMed
Besson, M., Magne, C., & Schön, D. (2002). Emotional prosody: Sex differences in sensitivity to speech melody. Trends in Cognitive Sciences, 6, 405–407.Google Scholar
Boersma, P., & Weenink, D. (2007). Praat manual. Version 5.0.20. Amsterdam, The Netherlands: University of Amsterdam, Phonetic Sciences Department.Google Scholar
Bornhofen, C., & McDonald, S. (2007). Treating deficits in emotion perception following traumatic brain injury Neuropsychological Rehabilitation, 18, 22–44.CrossRefGoogle Scholar
Bowers, D., Coslett, H.B., Bauer, R.M., Speedie, L.J., & Heilman, K. (1987). Comprehension of emotional prosody following unilateral hemispheric lesions: Processing defect versus distraction defect. Neuropsychologia, 25, 317–328.Google Scholar
Brooks, N., Campsie, L., Symington, C., Beattie, A., & McKinlay, W. (1986). The five year outcome of severe blunt head injury: A relative’s view. Journal of Neurology, Neurosurgery, & Psychiatry, 49, 764–770.Google Scholar
Buchanan, T.W., Lutz, K., Mirzazade, S., Specht, K., Shah, N.J., Zilles, K., et al. . (2000). Recognition of emotional prosody and verbal components of spoken language: An fMRI study. Cognitive Brain Research, 9, 227–238.Google Scholar
Burgess, P.W., & Shallice, T. (1996). Response suppression, initiation, and strategy use following frontal lobe lesions. Neuropsychologia, 34, 263–273.Google Scholar
Burgess, P.W., & Shallice, T. (1997). The Hayling and Brixton Tests manual. Bury St, Edmunds, UK: Thames Valley Test Company.Google Scholar
Cicerone, K.D., & Tanenbaum, L.N. (1997). Disturbance of social cognition after traumatic orbitofrontal brain injury. Archives of Clinical Neuropsychology, 12, 173–188.Google Scholar
Creusere, M., Alt, M., & Plante, E. (2004). Recognition of vocal and facial cues to affect in language-impaired and normally-developing preschoolers. Journal of Communication Disorders, 37, 5–20.Google Scholar
Croker, V., & McDonald, S. (2005). Recognition of emotion from facial expression following traumatic brain injury. Brain Injury, 19, 787–789.CrossRefGoogle ScholarPubMed
Damasio, A.R. (1994). Descartes’ error and the future of human life. Scientific American, 271, 144.CrossRefGoogle ScholarPubMed
de Gelder, B., & Vroomen, J. (2000). The perception of emotions by ear and by eye. Cognition and Emotion, 14, 289–311.Google Scholar
Draper, K., & Ponsford, J. (2008). Cognitive functioning ten years following traumatic brain injury and rehabilitation. Neuropsychology, 22, 618–625.Google Scholar
Dujardin, K., Blairy, S., Defebvre, L., Duhem, S., Noël, Y., Hess, U., et al. . (2004). Deficits in decoding emotional facial expressions in Parkinson’s disease. Neuropsychologia, 42, 239–250.Google Scholar
Dyer, K.F., Bell, R., McCann, J., & Rauch, R. (2006). Aggression after traumatic brain injury: Analysing socially desirable responses and the nature of aggressive traits. Brain Injury, 20, 1163–1173.Google Scholar
Ekman, P., & Friesen, W. (1976). Pictures of facial affect. Palo Alto, CA: Consulting Psychologists Press.Google Scholar
Faul, E., Erdfelder, E., Lang, A.-G., & Buchner, A. (2007). G*Power 3: A flexible statistical power analysis program for the social, behavioral, and biomedical sciences. Behaviour Research Methods, 39, 175–191.CrossRefGoogle ScholarPubMed
Freedman, M., Black, S., Ebert, P., & Binns, M. (1998). Orbitofrontal function, object alternation and perseveration. Cerebral Cortex, 8, 18–27.Google Scholar
Fujiwara, E., Schwartz, M.L., Gao, F., Black, S.E., & Levine, B. (2008). Ventral frontal cortex functions and quantified MRI in traumatic brain injury. Neuropsychologia, 46, 461–474.Google Scholar
Grandjean, D., Sander, D., Pourtois, G., Schwartz, R.L., Seghier, M.L., Scherer, K.R., et al. . (2005). The voices of wrath: Brain responses to angry prosody in meaningless speech. Nature Neuroscience, 8, 145–146.CrossRefGoogle ScholarPubMed
Green, R.E., Turner, G.R., & Thompson, W.F. (2004). Deficits in facial emotion perception in adults with recent traumatic brain injury. Neuropsychologia, 42, 133–141.Google Scholar
Grimshaw, G.M. (1998). Integration and inteference in the cerebral hemispehres: Relations with hemispheric specialization. Brain and Cognition, 36, 108–127.Google Scholar
Hanks, R.A., Temkin, N., Machamer, J., & Dikmen, S.S. (1999). Emotional and behavioral adjustment after traumatic brain injury. Archives of Physical Medicine and Rehabilitation, 80, 991–997.Google Scholar
Hariri, A.R., Bookheiner, S.Y., & Mazziotta, J.C. (2000). Modulating emotional responses: Effects of a neocortical network on the limbic system. Neuroreport, 11, 43–48.Google Scholar
Hartley, L.L., & Jensen, P.J. (1992). Three discourse profiles of closed-head-injury speakers: Theoretical and clinical implications. Brain Injury, 6, 271–282.Google Scholar
Heilman, K.M., Bowers, D., Speedie, L., & Coslett, H.B. (1984). Comprehension of affective and nonaffective prosody. Neurology, 34, 917–921.Google Scholar
Hess, U., Kappas, A., & Scherer, K. (1988). Multichannel communication of emotion: Synthetic signal production. In Scherer, K. (Ed.), Facets of emotion: Recent research (pp. 161–182). Hillsdale, NJ: Erlbaum.Google Scholar
Hornak, J., Rolls, E.T., & Wade, D. (1996). Face and voice expression identification inpatients with emotional and behavioural changes following ventral frontal lobe damage. Neuropsychologia, 34, 247–261.Google Scholar
Ietswaart, M., Milders, M., Crawford, J.R., Currie, D., & Scott, C.L. (2008). Longitudinal aspects of emotion recognition in patients with traumatic brain injury. Neuropsychologia, 46, 148–159.Google Scholar
Jackson, H.F., & Moffatt, N.J. (1987). Impaired emotional recognition following severe head injury. Cortex, 23, 293–300.Google Scholar
Jennett, B. (1996). Epidemiology of head injury [Review]. Journal of Neurology, Neurosurgery, & Psychiatry, 60, 362–369.Google Scholar
Jennett, B. (1976). Assessment of severity in head injury. Journal of Neurology, Neurosurgery, and Psychiatry 39, 647–655.Google Scholar
Jerger, S., Pirozzolo, F., Jerger, J., Elizondo, R., Desai, S., Wright, E., et al. . (1993). Developmental trends in the interaction between auditory and linguistic processing. Perception & Psychophysics, 54, 310–320.CrossRefGoogle ScholarPubMed
Johnstone, T., van Reekum, C.M., Oakes, T.R., & Davidson, R.J. (2006). The voice of emotion: An fMRI study of neural responses to angry and happy vocal expressions. Social Cognitive & Affective Neuroscience, 1, 242–249.Google Scholar
Kaganovich, N., Francis, A.L., & Melara, R.D. (2006). Electrophysiological evidence for early interaction between talker and linguistic information during speech perception. Brain Research, 1114, 161–172.Google Scholar
Knox, L., & Douglas, J. (2009). Long-term ability to interpret facial expression after traumatic brain injury and its relation to social integration. Brain and Cognition, 69, 442–449.Google Scholar
Koff, E., Zaitchik, D., Montepare, J., & Albert, M.S. (1999). Emotion processing in the visual and auditory domains by patients with Alzheimer’s disease. Journal of the International Neuropsychological Society, 5, 32–40.Google Scholar
Kotz, S.A., Meyer, M., Alter, K., Besson, M., von Cramon, D.Y., & Friederici, A.D. (2003). On the lateralization of emotional prosody: An event-related MR investigation. Brain and Language, 86, 366–376.Google Scholar
Lalande, S., Braun, C.M., Charlebois, N., & Whitaker, H.A. (1992). Effects of right and left hemisphere cerebrovascular lesions on discrimination of prosodic and semantic aspects of affect in sentences. Brain and Language, 42, 165–186.Google Scholar
Langenecker, S.A., Bieliauskas, L.A., Rapport, L.J., Zubieta, J.-K., Wilde, E.A., & Berent, S. (2005). Face emotion perception and executive functioning deficits in depression. Journal of Clinical and Experimental Neuropsychology, 27, 320–333.Google Scholar
Leinonen, L., Hiltunen, T., Linnankoski, I., & Laakso, M.-L. (1997). Expression of emotional–motivational connotations with a one-word utterance. The Journal of the Acoustic Society of America, 102, 1853–1863.Google Scholar
Levin, H.S., Williams, D.H., Eisenberg, H.M., High, W.M., & Guinto, F.C. (1992). Serial MRI and neurobehavioural findings after mild to moderate closed head injury. Journal of Neurology, Neurosurgery, & Psychiatry, 55, 255–262.Google Scholar
Lew, H., Chmiel, R., Jerger, J., Pomerantz, J., & Jerger, S. (1997). Electrophysiological indices of Stroop and Garner interference reveal linguistic influences on auditory and visual processing. Journal of the American Academy of Audiology, 8, 104–118.Google Scholar
Lezak, M.D. (1978). Living with the characterologically altered brain-injured patient. Journal of Clinical Psychology, 39, 592–598.Google ScholarPubMed
MacKenzie, J.D., Siddiqi, F., Babb, J.S., Bagley, L.J., Mannon, L.J., Sinson, G.P., et al. . (2002). Brain atrophy in mild or moderate traumatic brain injury: A longitudinal quantitative analysis. AJNR. American Journal of Neuroradiology, 23, 1509–1515.Google Scholar
Marquardt, T.P., Rios-Brown, M., Richburg, T., Seibert, L.K., & Cannito, M.P. (2001). Comprehension and expression of affective sentences in traumatic brain injury. Aphasiology, 15, 1091–1101.Google Scholar
Martin, I., & McDonald, S. (2004). Weak coherence or theory of mind: What causes non-literal language to be misunderstood by high functioning individuals with autism? Journal of Autism and Developmental Disorders, 34, 311–328.Google Scholar
McDonald, S., Bornhofen, C., Shum, D., Long, E., Saunders, C., & Neulinger, K. (2006). Reliability and validity of ‘The Awareness of Social Inference Test’ (TASIT): A clinical test of social perception. Disability and Rehabilitation, 28, 1529–1542.CrossRefGoogle ScholarPubMed
McDonald, S., & Flanagan, S. (2004). Social perception deficits after traumatic brain injury: Interaction between emotion recognition, mentalizing ability, and social communication. Neuropsychology, 18, 572–579.Google Scholar
McDonald, S., & Pearce, S. (1996). Clinical insights into pragmatic theory: Frontal lobe deficits and sarcasm. Brain and Language, 53, 81–104.Google Scholar
McDonald, S., & Saunders, J.C. (2005). Differential impairment in recognition of emotion across different media inpeople with severe traumatic brain injury. Journal of International Neuropsychological Society, 11, 392–399.Google Scholar
McHugh, L., & Wood, R.L. (2008). Using a temporal discounting paradigm to measure decision-making and impulsivity following traumatic brain injury: A pilot study. Brain Injury, 22, 715–721.Google Scholar
Meyer, M., Alter, K., Friederici, A.D., Lohmann, G., & Von Cramon, D.Y. (2002). fMRI reveals brain regions mediation slow prosodic modulations in spoken sentences. Human Brain Mapping, 17, 73–88.Google Scholar
Mild Traumatic Brain Injury Committee of the Head Injury Interdisciplinary Special Interest Group of the American Congress of Rehabilitation Medicine. (1993). Definition of mild traumatic brain injury. Journal of Head Trauma Rehabilitation, 8, 86–87.Google Scholar
Milders, M., Fuchs, S., & Crawford, J.R. (2003). Neuropsychological impairments and changes in emotional and social behaviour following severe traumatic brain injury. Journal of Clinical and Experimental Neuropsychology, 25, 157–172.Google Scholar
Mitchell, R.L., Elliott, R., Barry, M., Cruttenden, A., & Woodruff, P.W. (2003). The neural response to emotional prosody, as revealed by functional magnetic resonance imaging. Neuropsychologia, 41, 1410–1421.Google Scholar
Mitchell, R.L., & Ross, E.D. (2008). fMRI evidence for the effect of verbal complexity on lateralisation of the neural response associated with decoding prosodic emotion. Neuropsychologia, 46, 2880–2887.Google Scholar
Morgan, A., & Brandt, J. (1989). An auditory Stroop effect for pitch, loudness, and time. Brain Language, 36, 592–603.Google Scholar
Oschner, K.N., & Barrett, L.F. (2001). A multiprocess perspective on the neuroscience of emotion. In Mayne, T.J. & Bonanno, G.A. (Eds.), Emotions: Current issues and future directions (pp. 38–79). New York: Guilford Press.Google Scholar
Patton, J.H., Stanford, M.S., & Barratt, E.S. (1995). Factor structure of the Barratt Impulsiveness Scale. Journal of Clinical Psychology, 51, 768–774.Google Scholar
Pell, M.D. (2006). Cerebral mechanisms for understanding emotional prosody in speech. Brain and Language, 96, 221–234.Google Scholar
Pell, M.D., & Baum, S.R. (1997). The ability to perceive and comprehend intonation in linguistic and affective contexts by brain-damaged adults. Brain and Language, 57, 80–99.Google Scholar
Pell, M.D., & Leonard, C.L. (2003). Processing emotional tone from speech in Parkinson’s disease: A role for the basal ganglia. Cognitive, Affective, & Behavioural Neuroscience, 3, 275–288.Google Scholar
Pell, M.D., Paulmann, S., Dara, C., Alasseri, A., & Kotz, S.A. (2009). Factors in the recognition of vocally expressed emotions: A comparison of four languages. Journal of Phonetics, 37, 417–435.Google Scholar
Pettersen, L. (1991). Sensitivity to emotional cues and social-behaviour in children and adolscents after head-injury. Perceptual and Motor Skills, 73, 1139–1150.Google Scholar
Phillips, M.L., Drevets, W.C., Rauch, S.L., & Lane, R. (2003). Neurobiology of emotion perception I: The neural basis of normal emotion perception. Biological Psychiatry, 54, 504–514.Google Scholar
Prigatano, G.P., & Pribam, K.H. (1982). Perception and memory of facial affect following brain injury. Perceptual and Motor Skills, 54, 859–869.Google Scholar
Ross, E.D., & Monnot, M. (2008). Neurology of affective prosody and its functional-anatomic organization in the right hemisphere. Brain and Language, 104, 51–74.Google Scholar
Ross, E.D., Thompson, R.D., & Yenkowsky, J. (1997). Lateralization of affective prosody in brain and callosal integration of hemispheric language functions. Brain and Language, 56, 27–54.Google Scholar
Roth, P.L., Switzer, F.S., & Switzer, D.M. (1999). Missing data in multiple item scales: A Monte Carlo analysis of missing data techniques. Organizational Research Methods, 2, 211–232.Google Scholar
Scherer, K.R. (2003). Vocal communication of emotion: A review of research paradigms. Speech Communication, 40, 227–256.Google Scholar
Schlanger, B., Schlanger, P., & Gerstmann, L. (1976). The perception of emotionally toned sentences by right hemisphere damaged and aphasic subjects. Brain and Language, 3, 396–403.Google Scholar
Scott, S.K., Young, A.W., Calder, A.J., Hellawell, D.J., Aggleton, J.P., & Johnsons, M. (1997). Impaired auditory recognition of fear and anger following bilateral amygdala lesions. Nature, 385, 254–257.Google Scholar
Shamay-Tsoory, S.G., Tomer, R., Berger, B.D., Goldsher, D., & Aharon-Peretz, J. (2005). Impaired “affective theory of mind” is associated with right ventromedial prefrontal damage. Cognitive and Behavioral Neurology, 18(1), 55–67.Google Scholar
Spell, L.A., & Frank, E. (2000). Recognition of nonverbal communication of affect following traumatic brain injury. Journal of Nonverbal Behaviour, 24, 285–300.Google Scholar
Starkstein, S.E. (1997). Mechanism of disinhibition after brain lesions. Journal of Nervous & Mental Disease, 185, 108–114.Google Scholar
Steinhauer, K., Alter, K., & Friederici, A.D. (1999). Brain potentials indicate immediate use of prosodic cues in natural speech processing. Nature Neuroscience, 2, 191–196.Google Scholar
Tate, R.L., Lulham, J.M., Broe, G.A., Strettles, B., & Pfaff, A. (1989). Psychosocial outcome for the survivors of severe blunt head injury: the results from a consecutive series of 100 patients. Journal of Neurology, Neurosurgery & Psychiatry, 52, 1128–1134.Google Scholar
Thomsen, I.V. (1984). Late outcome of very severe blunt head trauma: A 10-15 year second follow-up. Journal of Neurology, Neurosurgery, & Psychiatry, 47, 260–268.Google Scholar
Tompkins, C.A., & Flowers, C.R. (1985). Perception of emotional intonation by brain-damaged adults: The influence of task processing levels. Journal of Speech and Hearing Research, 28, 527–538.Google Scholar
Uekermann, J., Daum, I., Schlebusch, P., & Trenckmann, U. (2005). Processing of affective stimuli in alcoholism. Cortex, 41, 189–194.Google Scholar
Vogt, B.A. (1986). Cingulate cortex. In Peters, A. & Jones, E.G. (Eds.), Cerebral cortex: Vol. 4. Association and auditory cortices (pp. 89–149). New York: Plenum.Google Scholar
Votruba, K.L., Rapport, L.J., Vangel, S.J. Jr., Hanks, R.A., Lequerica, A., Whitman, R.D., et al. . (2008). Impulsivity and traumatic brain injury: The relations among behavioral observation, performance measures, and rating scales. Journal of Head Trauma Rehabilitation, 23, 65–73.Google Scholar
Wambacq, I.J., & Jerger, J.F. (2004). Processing of affective prosody and lexical-semantics in spoken utterances as differentiated by event-related potentials. Cognitive Brain Research, 20, 427–437.Google Scholar
Zupan, B., Neumann, D., Babbage, D.R., & Willer, B. (2009). The importance of vocal affect to bimodal processing of emotion: Implications for individuals with traumatic brain injury. Journal of Communication Disorders, 42, 1–17.Google Scholar