Hostname: page-component-745bb68f8f-f46jp Total loading time: 0 Render date: 2025-02-04T14:56:35.402Z Has data issue: false hasContentIssue false
  • English
  • Français

SOCIAL ATTITUDES AND SPEECH RATINGS

EFFECTS OF POSITIVE AND NEGATIVE BIAS ON MULTIAGE LISTENERS’ JUDGMENTS OF SECOND LANGUAGE SPEECH

Published online by Cambridge University Press:  13 November 2018

Kym Taylor Reid ,
Pavel Trofimovich Open the ORCID record for Pavel Trofimovich [Opens in a new window]  and
Mary Grantham O’Brien
Kym Taylor Reid*
Affiliation:
Concordia University
Pavel Trofimovich
Affiliation:
Concordia University
Mary Grantham O’Brien
Affiliation:
University of Calgary
*
*Correspondence concerning this article should be addressed to Kym Taylor Reid, Department of Education, Concordia University (FG 5.150), 1455 de Maisonneuve Blvd W., Montreal, Quebec, Canada H3G 1M8. E-mail: [email protected]
Get access Rights & Permissions [Opens in a new window]

Abstract

This study examined whether social bias manipulation can influence how naïve multiage listeners evaluate second language (L2) speech. Sixty native English-speaking listeners (Montreal residents) rated audio recordings of 40 Quebec French speakers of L2 English for five dimensions of oral performance (accentedness, comprehensibility, segmental accuracy, intonation, flow) using 1,000-point continuous scales. Immediately before rating, 20 listeners heard critical comments about Quebec French speakers’ English language skills, while 20 heard positive comments. Twenty listeners (baseline group) received no manipulation. Compared to baseline listeners, positively oriented listeners (younger and older) rated four of five dimensions more favorably. However, listeners’ behavior diverged under negative bias. Compared to age-matched baseline listeners, younger listeners upgraded speakers while older listeners downgraded speakers for all targeted measures. Findings cast doubt on the relative stability of L2 speech ratings and point to the importance of social context and generational differences in untrained rater assessments of L2 speaking performance.

Type
Research Article
Information
Studies in Second Language Acquisition , Volume 41 , Issue 2 , May 2019 , pp. 419 - 442
Open Practices
Open materials Open data
Copyright
Copyright © Cambridge University Press 2018 

Access options

Get access to the full version of this content by using one of the access options below. (Log in options will check for institutional or personal access. Content may require purchase if you do not have access.)

Footnotes

This study was supported by grants from the Social Sciences and Humanities Research Council of Canada to the second and third authors. We are deeply grateful to Zeshan Yao for his programming assistance and to the anonymous reviewers and the editor, Susan Gass, for the insightful comments and suggestions that helped us refine this article.

The experiment in this article earned Open Data and Open Materials badges for transparent practices. All data and materials are available at https://osf.io/7gvkt.

References

REFERENCES

Bates, D., Mächler, M., Bolker, B., & Walker, S. (2015). Fitting linear mixed-effects models using lme4. Journal of Statistical Software, 67, 1–48.CrossRefGoogle Scholar
Beaudreau, S. A., Storandt, M., & Strube, M. J. (2006). A comparison of narratives told by younger and older adults. Experimental Aging Research, 32, 105–117.CrossRefGoogle ScholarPubMed
Beinhoff, B. (2013). Perceiving identity through accent: Attitudes towards non-native speakers and their accents in English. Oxford, UK: Peter Lang.CrossRefGoogle Scholar
Beukeboom, C. J., & Semin, G. R. (2006). How mood turns on language. Journal of Experimental Social Psychology, 42, 553–566.CrossRefGoogle Scholar
Bodenhausen, G. V., & Moreno, K. N. (2000). How do I feel about them? The role of affective reactions in intergroup perception. In Bless, H. & Forgas, J. P. (Eds.), The message within: Subjective experience in social cognition and behavior (pp. 283–303). Philadelphia, PA: Psychology Press.Google Scholar
Bourhis, R. Y., & Giles, H. (1977). The language of intergroup distinctiveness. In Giles, H. (Ed.), Language, ethnicity, and intergroup relations (pp. 119–135). London, UK: Academic.Google Scholar
Bourhis, R. Y., Sioufi, R., & Sachdev, I. (2012). Ethnolinguistic interaction and multilingual communication. In Giles, H. (Ed.), The handbook of intergroup communication (pp. 100–115). New York, NY: Routledge.Google Scholar
Caplan, S. E., & Samter, W. (1999). The role of facework in younger and older adults’ evaluations of social support messages. Communication Quarterly, 47, 245–264.CrossRefGoogle Scholar
Cargile, A. C., & Giles, H. (1997). Understanding language attitudes: Exploring listener affect and identity. Language and Communication, 17, 195–217.CrossRefGoogle Scholar
Corbeil, J. C. (2007). L’embarras des langues: Origine, conception et évolution de la politique linguistique québécoise. Montréal, QC: Québec Amérique.Google Scholar
Dalton-Puffer, C., Kaltenboeck, G., & Smit, U. (1997). Learner attitudes and L2 pronunciation in Austria. World Englishes, 16, 115–128.CrossRefGoogle Scholar
Derwing, T. M., & Munro, M. J. (1997). Accent, intelligibility, and comprehensibility: Evidence from four L1s. Studies in Second Language Acquisition, 20, 1–16.CrossRefGoogle Scholar
Derwing, T. M., & Munro, M. J. (2015). Pronunciation fundamentals: Evidence-based perspectives for L2 teaching and research. Amsterdam, The Netherlands: John Benjamins.CrossRefGoogle Scholar
Derwing, T. M., Rossiter, M. J., & Munro, M. J. (2002). Teaching native speakers to listen to foreign-accented speech. Journal of Multilingual and Multicultural Development, 23, 245–259.CrossRefGoogle Scholar
Derwing, T. M., Rossiter, M. J., Munro, M. J., & Thomson, R. I. (2004). Second language fluency: Judgments on different tasks. Language Learning, 54, 655–679.CrossRefGoogle Scholar
Dragojevic, M., Gasiorek, J., & Giles, H. (2016). Communication accommodation theory. In Berger, C. R. & Roloff, M. E. (Eds.), The international encyclopedia of interpersonal communication (pp. 1–20). New York, NY: Wiley.Google Scholar
Dragojevic, M., & Giles, H. (2016). I don’t like you because you’re hard to understand: The role of processing fluency in the language attitudes process. Human Communication Research, 42, 396–420.CrossRefGoogle Scholar
Eskenazi, M. (2009). An overview of spoken language technology for education. Speech Communication, 51, 832–844.CrossRefGoogle Scholar
Field, A. P. (2009). Discovering statistics using SPSS. London, UK: Sage.Google Scholar
Ford, C. E. (1984). The influence of speech variety on teachers’ evaluation of students with comparable academic ability. TESOL Quarterly, 18, 25–40.CrossRefGoogle Scholar
Giles, H., & Rakić, T. (2014). Language attitudes: Social determinants and consequences of language variation. In Holtgraves, T. (Ed.), The Oxford handbook of language and social psychology (pp. 11–26). New York, NY: Oxford University Press.Google Scholar
Giles, H., & Watson, B. (Eds.). (2013). The social meanings of language, dialect, and accent: International perspectives on speech styles. New York, NY: Peter Lang.Google Scholar
Girard, F., Floccia, C., & Goslin, J. (2008). Perception and awareness of accents in young children. British Journal of Developmental Psychology, 26, 409–433.CrossRefGoogle Scholar
Gluszek, A., & Dovidio, J. F. (2010a). Speaking with a nonnative accent: Perceptions of bias, communication difficulties, and belonging in the United States. Journal of Language and Social Psychology, 29, 224–234.CrossRefGoogle Scholar
Gluszek, A., & Dovidio, J. F. (2010b). The way they speak: A social psychological perspective on the stigma of non-native accents in communication. Personality and Social Psychology Review, 14, 214–237.CrossRefGoogle Scholar
Gluszek, A., Newheiser, A.-K., & Dovidio, J. F. (2011). Social psychological manipulations and accent strength. Journal of Language and Social Psychology, 30, 28–45.CrossRefGoogle Scholar
Hansen, K., & Dovidio, J. F. (2016). Social dominance manipulation, nonnative accents, and hiring recommendations. Cultural Diversity and Ethnic Minority Psychology, 22, 544–551.CrossRefGoogle Scholar
Hansen, K., Rakić, T., & Steffens, M. C. (2014). When actions speak louder than words: Preventing discrimination of nonstandard speakers. Journal of Language and Social Psychology, 33, 68–77.CrossRefGoogle Scholar
Harding, L. (2012). Pronunciation assessment. The encyclopedia of applied linguistics. Oxford, UK: Wiley-Blackwell.Google Scholar
Hu, G., & Lindemann, S. (2009). Stereotypes of Cantonese English, apparent native/non-native status, and their effect on non-native English speakers’ perception. Journal of Multilingual and Multicultural Development, 30, 253–269.CrossRefGoogle Scholar
Isaacs, T. (2013). Assessing pronunciation. In Kunnan, A. J. (Ed.), The companion to language assessment (pp. 140–155). Hoboken, NJ: Wiley.CrossRefGoogle Scholar
Isaacs, T., & Trofimovich, P. (2012). Deconstructing comprehensibility: Identifying the linguistic influences on listeners’ L2 comprehensibility ratings. Studies in Second Language Acquisition, 34, 475–505.CrossRefGoogle Scholar
James, L. E., Burke, D. M., Austin, A., & Hulme, E. (1998). Production and perception of “verbosity” in younger and older adults. Psychology and Aging, 13, 355–367.CrossRefGoogle ScholarPubMed
Kang, O., & Rubin, D. (2009). Reverse linguistic stereotyping: Measuring the effect of listener expectations on speech evaluation. Journal of Language and Social Psychology, 28, 441–456.CrossRefGoogle Scholar
Kang, O., Rubin, D., & Lindemann, S. (2015). Mitigating U.S. undergraduates’ attitudes toward international teaching assistants. TESOL Quarterly, 49, 681–706.CrossRefGoogle Scholar
Kempe, V., Rookes, M., & Swarbrigg, L. (2013). Speaker emotion can affect ambiguity production. Language and Cognitive Processes, 28, 1579–1590.CrossRefGoogle Scholar
Kinzler, K. D., Dupoux, E., & Spelke, E. S. (2007). The native language of social cognition. Proceedings of the National Academy of Sciences of the United States of America, 104, 12577–12580.CrossRefGoogle ScholarPubMed
Kinzler, K. D., Shutts, K., DeJesus, J., & Spelke, E. S. (2009). Accent trumps race in guiding children’s social preferences. Social Cognition, 27, 623–634.CrossRefGoogle ScholarPubMed
Labov, W. (1972). On the mechanism of language change. In Gumperz, J. J. & Hymes, D. (Eds.), Directions in sociolinguistics (pp. 312–338). New York, NY: Holt, Rinehart, and Winston.Google Scholar
Lamarre, P., Paquette, J., Kahn, E., & Ambrosi, S. (2002). Multilingual Montreal: Listening in on the language practices of young Montrealers. Canadian Ethnic Studies, 34, 47–78.Google Scholar
Lindemann, S. (2002). Listening with an attitude: A model of native-speaker comprehension of non-native speakers in the United States. Language in Society, 31, 419–441.CrossRefGoogle Scholar
Lindemann, S., & Subtirelu, N. (2013). Reliably biased: The role of listener expectation in the perception of second language speech. Language Learning, 63, 567–594.CrossRefGoogle Scholar
Molden, D. C. (Ed.) (2014). Understanding priming effects in social psychology. New York, NY: Guilford Press.Google Scholar
Mulac, A. (1976). Effects of obscene language upon three dimensions of listener attitude. Communications Monographs, 43, 300–307.CrossRefGoogle Scholar
Munro, M. J. (1995). Nonsegmental factors in foreign accent: Ratings of filtered speech. Studies in Second Language Acquisition, 17, 17–34.CrossRefGoogle Scholar
Niedzielski, N. (1999). The effect of social information on the perception of sociolinguistic variables. Journal of Language and Social Psychology, 18, 62–85.CrossRefGoogle Scholar
Paladino, M.-P., Poddesu, L., Rauzi, M., Vaes, J., Cadinu, M., & Forer, D. (2009). Second language competence in the Italian-speaking population of Alto Adige/Südtirol: Evidence for linguistic stereotype threat. Journal of Language and Social Psychology, 28, 222–243.CrossRefGoogle Scholar
Pantos, A. J., & Perkins, A. W. (2013). Measuring implicit and explicit attitudes toward foreign accented speech. Journal of Language and Social Psychology, 32, 3–20.CrossRefGoogle Scholar
Pinheiro, J., Bates, D., DebRoy, S., Sarkar, D, & R Core Team (2018). nlme: Linear and nonlinear mixed effects models. R package version 3.1-137. Retrieved from https://CRAN.R-project.org/package=nlme.Google Scholar
Plonsky, L., & Oswald, F. L. (2014). How big is “big”? Interpreting effect size in L2 research. Language Learning, 64, 878–912.CrossRefGoogle Scholar
Rakić, T., Steffens, M. C., & Mummendey, A. (2011). Blinded by the accent! The minor role of looks in ethnic categorization. Journal of Personality and Social Psychology, 100, 16–29.CrossRefGoogle ScholarPubMed
Rowe, G., Hirsh, J. B., & Anderson, A. K. (2007). Positive affect increases the breadth of attentional selection. Proceedings of the National Academy of Sciences of the United States of America, 104, 383–388.CrossRefGoogle ScholarPubMed
Rubin, D. L. (1992). Nonlanguage factors affecting undergraduates’ judgments of nonnative English-speaking teaching assistants. Research in Higher Education, 33, 511–531.CrossRefGoogle Scholar
Ryan, E. B. (1983). Social psychological mechanisms underlying native speaker evaluations of non-native speech. Studies in Second Language Acquisition, 5, 148–159.CrossRefGoogle Scholar
Ryan, E. B., Carranza, M. A., & Moffie, R. W. (1977). Reactions toward varying degrees of accentedness in the speech of Spanish-English bilinguals. Language and Speech, 20, 267–273.CrossRefGoogle ScholarPubMed
Staples, S., Kang, O., & Wittner, E. (2014). Considering interlocutors in university discourse communities: Impacting U.S. undergraduates’ perceptions of ITAs through a structured contact program. English for Specific Purposes, 35, 54–65.CrossRefGoogle Scholar
Stroebe, W., & Insko, C. A. (2013). Stereotype, prejudice, and discrimination: Changing conceptions in theory and research. In Bar-Tal, D., Graumann, C. F., Kruglanski, A. W., & Stroebe, W. (Eds.), Stereotyping and prejudice: Changing conceptions (pp. 3–36). New York, NY: Springer.Google Scholar
Tajfel, H., & Turner, J. C. (1986). The social identity theory of intergroup behavior. In Worchel, S. & Austin, W. G. (Eds.), Psychology of intergroup relations (pp. 7–24). Chicago, IL: Nelson-Hall.Google Scholar
Turner, J. C., Hogg, M. A., Oakes, P. J., Reicher, S. D., & Wetherell, M. S. (1987). Rediscovering the social group: A self-categorization theory. Oxford, UK: Blackwell.Google Scholar
Vissers, C. T. W. M., Virgillito, D., Fitzgerald, D. A., Speckens, A. E. M., Tendolkar, I., Van Oostrom, I., & Chwilla, D. J. (2010). The influence of mood on the processing of syntactic anomalies: Evidence from P600. Neuropsychologia, 48, 3521–3531.CrossRefGoogle ScholarPubMed
Wigboldus, D. H., Spears, R., & Semin, G. R. (2005). When do we communicate stereotypes? Influence of the social context on the linguistic expectancy bias. Group Processes & Intergroup Relations, 8, 215–230.CrossRefGoogle Scholar
Winke, P., Gass, S., & Myford, C. (2013). Raters’ L2 background as a potential source of bias in rating oral performance. Language Testing, 30, 231–252.CrossRefGoogle Scholar
Yao, Z., Saito, K., Trofimovich, P., & Isaacs, T. (2013). Z-Lab [Computer software]. Retrieved from https://github.com/ZeshanYao/Z-Lab.Google Scholar
Yzerbyt, V. Y., Schadron, G., Leyens, J. P., & Rocher, S. (1994). Social judgeability: The impact of meta-informational cues on the use of stereotypes. Journal of Personality and Social Psychology, 66, 48–55.CrossRefGoogle Scholar
Supplementary material: File

Reid et al. supplementary material

Reid et al. supplementary material 1

Download Reid et al. supplementary material(File)
File 576 KB