Hostname: page-component-586b7cd67f-g8jcs Total loading time: 0 Render date: 2024-11-28T14:22:26.108Z Has data issue: false hasContentIssue false

Audiovisual speech recalibration in children*

Published online by Cambridge University Press:  06 October 2008

SABINE VAN LINDEN
Affiliation:
Department of Psychology, Tilburg University, the Netherlands
JEAN VROOMEN*
Affiliation:
Department of Psychology, Tilburg University, the Netherlands
*
[*]Address for correspondence: Jean Vroomen, Tilburg University, Dept of Psychology, Warandelaan 2, 5000 LE Tilburg, The Netherlands. Phone: +31-(0)13-4662394. Fax: +31-(0)13-4662067. Email: [email protected]

Abstract

In order to examine whether children adjust their phonetic speech categories, children of two age groups, five-year-olds and eight-year-olds, were exposed to a video of a face saying /aba/ or /ada/ accompanied by an auditory ambiguous speech sound halfway between /b/ and /d/. The effect of exposure to these audiovisual stimuli was measured on subsequently delivered auditory-only speech identification trials. Results were compared to a control condition in which the audiovisual exposure stimuli contained non-ambiguous and congruent sounds /aba/ or /ada/. The older children learned to categorize the initially ambiguous speech sound in accord with the previously seen lip-read information (i.e. recalibration), but this was not the case for the younger age group. Moreover, all children displayed a tendency to report the stimulus that they were exposed to during the exposure phase. Methodological improvements for adjusting such a response bias are discussed.

Type
Articles
Copyright
Copyright © 2008 Cambridge University Press

Access options

Get access to the full version of this content by using one of the access options below. (Log in options will check for institutional or personal access. Content may require purchase if you do not have access.)

References

REFERENCES

Bertelson, P., Vroomen, J. & de Gelder, B. (2003). Visual recalibration of auditory speech identification: a McGurk aftereffect. Psychological Science 14, 592–97.CrossRefGoogle ScholarPubMed
Bruce, V., Campbell, R. N., Doherty-Sneddon, G., Import, A., Langton, S., McAuley, S. & Wright, R. (2000). Testing face processing skills in children. British Journal of Developmental Psychology 18, 319–33.CrossRefGoogle Scholar
Burnham, D. & Dodd, B. (2004). Auditory-visual speech integration by prelinguistic infants: Perception of an emergent consonant in the McGurk effect. Developmental Psychobiology 45, 204220.CrossRefGoogle ScholarPubMed
Burnham, D. & Sekiyama, K. (2004). When auditory-visual speech perception develops: The locus of the Japanese McGurk effect. Australian Journal of Psychology 56, 108.Google Scholar
de Gelder, B. & Vroomen, J. (1998). Impaired speech perception in poor readers: Evidence from hearing and speech reading. Brain and Language 64, 269–81.CrossRefGoogle ScholarPubMed
Desjardins, R. N., Rogers, J. & Werker, J. F. (1997). An exploration of why preschoolers perform differently than do adults in audiovisual speech perception tasks. Journal of Experimental Child Psychology 66, 85110.CrossRefGoogle ScholarPubMed
Desjardins, R. N. & Werker, J. F. (2004). Is the integration of heard and seen speech mandatory for infants? Developmental Psychobiology 45, 187203.CrossRefGoogle ScholarPubMed
Eimas, P. D. & Corbit, J. D. (1973). Selective adaptation of linguistic feature detectors. Cognitive Psychology 4, 99109.CrossRefGoogle Scholar
Eisner, F. & McQueen, J. M. (2005). The specificity of perceptual learning in speech processing. Perception & Psychophysics 67, 224–38.CrossRefGoogle ScholarPubMed
Hazan, V. & Barrett, S. (2000). The development of phonemic categorization in children aged 6–12. Journal of Phonetics 28, 377–96.CrossRefGoogle Scholar
Hockley, N. S. & Polka, L. A. (1994). A developmental study of audiovisual speech perception using the McGurk paradigm. Journal of the Acoustical Society of America 96, 3309.CrossRefGoogle Scholar
Kraljic, T. & Samuel, A. G. (2005). Perceptual learning for speech: Is there a return to normal? Cognitive Psychology 51, 141–78.CrossRefGoogle Scholar
Kraljic, T. & Samuel, A. G. (2006). Generalization in perceptual learning for speech. Psychonomic Bulletin & Review 13, 262–68.CrossRefGoogle ScholarPubMed
Kraljic, T. & Samuel, A. G. (2007). Perceptual adjustments to multiple speakers. Journal of Memory and Language 56, 115.CrossRefGoogle Scholar
Kuhl, P. K. & Meltzoff, A. N. (1982). The bimodal perception of speech in infancy. Science 218, 1138–41.CrossRefGoogle ScholarPubMed
Massaro, D. W. (1984). Children's perception of visual and auditory speech. Child Development 55, 1777–88.CrossRefGoogle ScholarPubMed
Massaro, D. W. (1987). Speech perception by ear and eye: A paradigm for psychological inquiry. Hillsdale, NJ: Lawrence Erlbaum Associates, Inc.Google Scholar
McGurk, H. & MacDonald, J. (1976). Hearing lips and seeing voices. Nature 264, 746–48.CrossRefGoogle ScholarPubMed
Morrongiello, B. A., Robson, R. C., Best, V. C. T. & Clifton, R. K. (1984). Trading relations in the perception of speech by 5-year-old children. Journal of Experimental Child Psychology 37, 231–50.CrossRefGoogle Scholar
Nittrouer, S. & Studdert-Kennedy, M. (1987). The role of coarticulatory effects in the perception of fricatives by children and adults. Journal of Speech and Hearing Research 30, 319–29.CrossRefGoogle ScholarPubMed
Norris, D., McQueen, J. M. & Cutler, A. (2003). Perceptual learning in speech. Cognitive Psychology 47, 204238.CrossRefGoogle ScholarPubMed
Rosenblum, L. D., Schmuckler, M. A. & Johnson, J. A. (1997). The McGurk effect in infants. Perception & Psychophysics 59, 347–57.CrossRefGoogle ScholarPubMed
Samuel, A. G. (1986). Red herring detectors and speech perception: In defence of selective adaptation. Cognitive Psychology 18, 452–99.CrossRefGoogle ScholarPubMed
Sekiyama, K. & Burnham, D. (2004). Issues in the development of auditory-visual speech perception: Adults, infants, and children. Paper presented at the 8th International Conference on Spoken Language Processing, Jeiu Island, Korea.CrossRefGoogle Scholar
Sumby, W. H. & Pollack, I. (1954). Visual contribution to speech intelligibility in noise. Journal of the Acoustical Society of America 26, 212–15.CrossRefGoogle Scholar
Sussman, J. E. (1993). Auditory processing in children's speech perception: Results of selective adaptation and discrimination tasks. Journal of Speech and Hearing Research 36, 380–95.CrossRefGoogle ScholarPubMed
Sussman, J. E. & Carney, A. E. (1989). Effects of transition length on the perception of stop consonants by children and adults. Journal of Speech and Hearing Research 32, 151–60.CrossRefGoogle ScholarPubMed
van Linden, S., Stekelenburg, J. J., Tuomainen, J. & Vroomen, J. (2007). Lexical effects on auditory speech perception: An electrophysiological study. Neuroscience Letters 420, 4952.CrossRefGoogle ScholarPubMed
van Linden, S. & Vroomen, J. (2007). Recalibration of phonetic categories by lipread speech versus lexical information. Journal of Experimental Psychology: Human Perception and Performance 33, 1483–94.Google ScholarPubMed
Vroomen, J., van Linden, S., de Gelder, B. & Bertelson, P. (2007). Visual recalibration and selective adaptation in auditory-visual speech perception: Contrasting build-up courses. Neuropsychologia 45, 572–77.CrossRefGoogle ScholarPubMed
Vroomen, J., van Linden, S., Keetels, M., de Gelder, W. & Bertelson, P. (2004). Selective adaptation and recalibration of auditory speech by lipread information: Dissipation. Speech Communication 44, 5561.CrossRefGoogle Scholar
Wightman, F., Kistler, D. & Brungart, D. (2006). Informational masking of speech in children: Auditory-visual integration. Journal of the Acoustical Society of America 119, 3940–49.CrossRefGoogle ScholarPubMed