Hostname: page-component-745bb68f8f-lrblm Total loading time: 0 Render date: 2025-02-11T20:04:19.774Z Has data issue: false hasContentIssue false
  • English
  • Français

CAN CAPTIONED VIDEO BENEFIT SECOND LANGUAGE PRONUNCIATION?

Published online by Cambridge University Press:  19 March 2020

Natalia Wisniewska Open the ORCID record for Natalia Wisniewska [Opens in a new window]  and
Joan C. Mora Open the ORCID record for Joan C. Mora [Opens in a new window]
Natalia Wisniewska*
Affiliation:
University of Barcelona, Barcelona
Joan C. Mora
Affiliation:
University of Barcelona, Barcelona
*
*Correspondence concerning this article should be addressed to Natalia Wisniewska, Departament de Llengues i Literatures Modernes i Estudis Anglesos, Facultat de Filolgia, Universitat de Barcelona. Gran Via de les Corts Casatalanes, 558.08007 Barcelona, Spain. E-mail: [email protected].
Get access Rights & Permissions [Opens in a new window]

Abstract

The present study investigated the potential benefits of extended exposure to captioned videos for second language pronunciation. We tested 90 L2 adult learners of English on speech processing skills (segmentation, speed of lexical access, and sentence processing) and phonological accuracy in perception (ABX discrimination) and production (accentedness ratings) before and after an 8-week treatment consisting of regular exposure to audiovisual materials. Participants were randomly assigned to four experimental conditions involving two viewing modes (captioned or uncaptioned) and two task focus conditions (focus on phonetic form or focus on meaning). Results showed benefits in speech segmentation and speech processing skills irrespective of viewing mode. No significant benefits were found for phonological accuracy in perception. In production, a focus on phonetic form improved pronunciation only in the absence of captions, whereas captioned viewing led to pronunciation gains as long as there was no focus on phonetic form. These findings suggest that pronunciation improvement can take place with the help of captions or, in the absence of captions, when learners’ attention is directed to pronunciation. Cognitive overload might explain why no benefits were obtained when attention was directed to pronunciation in a captioned viewing mode.

Type
Research Article
Information
Studies in Second Language Acquisition , Volume 42 , Special Issue 3: Language Learning from Multimodal Input , July 2020 , pp. 599 - 624
Check for updates
Copyright
© Cambridge University Press 2020

Access options

Get access to the full version of this content by using one of the access options below. (Log in options will check for institutional or personal access. Content may require purchase if you do not have access.)

Footnotes

We would like to thank the editors of this special volume and two anonymous reviewers for their useful suggestions and comments on earlier versions of this article. The study reported in this article was supported by grants FFI 2016-80564R from MINECO and FI-DGR 2017 from AGAUR.

References

REFERENCES

Best, C., & Tyler, M. (2007). Non-native and second language speech perception. In Bohn, O.-S. & Munro, M. J. (Eds.), Language experience in second language speech learning (pp. 15–34). John Benjamins.Google Scholar
Birulés-Muntané, J., & Soto-Faraco, S. (2016). Watching subtitled films can help learning foreign languages. PloS One, 11, e0158409.CrossRefGoogle ScholarPubMed
Bird, S. A., & Williams, J. N. (2002). The effect of bimodal input on implicit and explicit memory: An investigation into the benefits of within language subtitling. Applied Psycholinguistics, 23, 509–533.CrossRefGoogle Scholar
Bisson, M. J., Van Heuven, W. J., Conklin, K., & Tunney, R. J. (2014). Processing of native and foreign language subtitles in films: An eye tracking study. Applied Psycholinguistics, 35, 399–418.CrossRefGoogle Scholar
Borrás, I., & Lafayette, R. C. (1994). Effects of multimedia courseware subtitling on the speaking performance of college students of French. The Modern Language Journal, 78, 61–75.CrossRefGoogle Scholar
Broersma, M. (2012). Increased lexical activation and reduced competition in second-language listening. Language and Cognitive Processes, 27, 1205–1224.CrossRefGoogle Scholar
Charles, T. J., & Trenkic, D. (2015). Speech segmentation in a second language: The role of bimodal input. In Gambier, Y., Caimi, A., & Mariotti, C. (Eds.), Subtitles and language learning: Principles, strategies and practical experiences (pp. 173–198). Peter Lang.Google Scholar
Clarke-Davidson, C. M., Luce, P. A., & Sawusch, J. R. (2008). Does perceptual learning in speech reflect changes in phonetic category representation or decision bias? Perception & Psychophysics, 70, 604–618.CrossRefGoogle ScholarPubMed
d’Ydewalle, G., & Van de Poel, M. (1999). Incidental foreign-language acquisition by children watching subtitled television programs. Journal of Psycholinguistic Research, 28, 227–244.CrossRefGoogle Scholar
Danan, M. (2004). Captioning and subtitling, undervalued language learning strategies. Meta, 49, 67–77.CrossRefGoogle Scholar
Darcy, I., Ewert, D., & Lidster, R. (2012). Bringing pronunciation instruction back into the classroom: an ESL teachers’ pronunciation “toolbox.” In Levis, J. & LeVelle, K. (Eds.), Proceedings of the 3rd Pronunciation in Second Language Learning and Teaching Conference (pp. 93–108). Iowa State University.Google Scholar
Darcy, I., Mora, J. C., & Daidone, D. (2016). The role of inhibitory control in second language phonological processing. Language Learning, 66, 741–773.CrossRefGoogle Scholar
Flege, J. (2003). Methods for assessing the perception of vowels in a second language. In Fava, E. & Mioni, A. (Eds.), Issues in clinical linguistics (pp. 19–44). UniPress.Google Scholar
Forster, K. I., & Forster, J. C. (2003). DMDX: A Windows display program with millisecond accuracy. Behavior Research Methods, Instruments, & Computers, 35, 116–124.CrossRefGoogle ScholarPubMed
Gottfried, T. L. (1984). Effects of consonant context on the perception of French vowels. Journal of Phonetics, 12, 91–114.CrossRefGoogle Scholar
Gurzynski-Weiss, L., Long, A. Y., & Solon, M. (Eds.) (2017). TBLT and L2 pronunciation: Do the benefits of tasks extend beyond grammar and lexis? [Special issue]. Studies in Second Language Acquisition, 39.CrossRefGoogle Scholar
Kissling, E. M. (2013). Teaching pronunciation: Is explicit phonetics instruction beneficial for FL learners? The Modern Language Journal, 97, 720–744.CrossRefGoogle Scholar
Kruger, J. L., Hefer, E., & Matthew, G. (2014). Attention distribution and cognitive load in a subtitled academic lecture: L1 vs. L2. Journal of Eye Movement Research, 7. https://doi.org/10.16910/jemr.7.5.4.Google Scholar
Kruger, J.L., & Steyn, F. (2014). Subtitles and eye tracking: Reading and performance. Reading Research Quarterly, 49, 105–120.CrossRefGoogle Scholar
Kruger, J. L., Szarkowska, A., & Krejtz, I. (2015). Subtitles on the moving image: An overview of eye tracking studies. Refractory: A Journal of Entertainment Media, 25, 1–14.Google Scholar
Kruger, J. L., & Doherty, S. (2016). Measuring cognitive load in the presence of educational video: Towards a multimodal methodology. Australasian Journal of Educational Technology, 32, 19–31.CrossRefGoogle Scholar
Levis, J.M. (2005). Changing contexts and shifting paradigms in pronunciation teaching. TESOL Quarterly, 39, 369–377.CrossRefGoogle Scholar
Lightbown, P. M. (2008). Transfer appropriate processing as a model for classroom second language acquisition. In Han, Z.‐H. (Ed.), Understanding second language process (pp. 27–44). Multilingual Matters.Google Scholar
Markham, P. (2001). The influence of culture-specific background knowledge and captions on second language comprehension. Journal of Educational Technology Systems, 29, 331–343.CrossRefGoogle Scholar
Marsden, E., Mackey, A., & Plonsky, L. (2016). The IRIS Repository: Advancing research practice and methodology. In A., Mackey & Marsden, E. (Eds.), Advancing methodology and practice: The IRIS Repository of Instruments for Research into Second Languages (pp. 1–21). Routledge.Google Scholar
Mattys, S. L., & Wiget, L. (2011). Effects of cognitive load on speech recognition. Journal of Memory and Language, 65, 145–160.CrossRefGoogle Scholar
Mattys, S. L., Brooks, J., & Cooke, M. (2009). Recognizing speech under a processing load: Dissociating energetic from informational factors. Cognitive Psychology, 59, 203–243.CrossRefGoogle Scholar
Mayer, R. E. (2009). Multimedia learning (2nd ed.). Cambridge University Press.CrossRefGoogle Scholar
Mitterer, H., & Mattys, S. L. (2017). How does cognitive load influence speech perception? An encoding hypothesis. Attention, Perception, & Psychophysics, 79, 344–351.CrossRefGoogle ScholarPubMed
Mitterer, H., & McQueen, J. M. (2009). Foreign subtitles help but native-language subtitles harm foreign speech perception. PloS One, 4. https://doi.org/10.1371/journal.pone.0007785.CrossRefGoogle ScholarPubMed
Montero Perez, M., Van Den Noortgate, W., & Desmet, P. (2013). Captioned video for L2 listening and vocabulary learning: A meta-analysis. System, 41, 720–739.CrossRefGoogle Scholar
Mora, J. C., & Levkina, M. (2017). Task-based pronunciation teaching and research: Key issues and future directions. Studies in Second Language Acquisition, 39, 381–399.CrossRefGoogle Scholar
Muñoz, C. (2008). Symmetries and asymmetries of age effects in naturalistic and instructed L2 learning. Applied Linguistics, 29, 578–596.CrossRefGoogle Scholar
Muñoz, C. (2017). The role of age and proficiency in subtitle reading.An eye-tracking study. System, 67, 77–86.CrossRefGoogle Scholar
Munro, M. J., & Derwing, T. M. (1995). Processing time, accent, and comprehensibility in the perception of native and foreign-accented speech. Language and Speech, 38, 289–306.CrossRefGoogle ScholarPubMed
Nation, P. (2012). The BNC/COCA Word Family Lists. Unpublished manuscript. www.victoria.ac.nz/lals/about/staff/paul-nation.Google Scholar
Norris, D., McQueen, J. M., Cutler, A., Butterfield, S., & Kearns, R. (2001). Language-universal constraints on speech segmentation. Language and Cognitive Processes, 16, 637–660.CrossRefGoogle Scholar
Ortega, L., Iwashita, N., Norris, J. M., & Rabie, S. (2002, October). An investigation of elicited imitation tasks in crosslinguistic SLA research. Paper presented at the Second Language Research Forum, Toronto, Ontario, Canada.Google Scholar
Paivio, A. (1986). Mental representations, a dual coding approach. Oxford University Press.Google Scholar
Peters, E., & Webb, S. (2018). Incidental vocabulary acquisition through viewing L2 television and factors that affect learning. Studies in Second Language Acquisition, 40, 551–577.CrossRefGoogle Scholar
Peters, E., Heynen, E., & Puimege, E. (2016). Learning vocabulary through audiovisual input: The differential effect of L1 subtitles and captions. System, 63, 134–148.CrossRefGoogle Scholar
Piske, T. (2007). Implications of James E. Flege’s research for the foreign language classroom. In Bohn, O.-S. & Munro, M. J. (Eds.), Language experience in second language speech learning (pp. 301–314). John Benjamins.CrossRefGoogle Scholar
Ramus, F., Peperkamp, S., Christophe, A., Jacquemot, C., Kouider, S., & Dupoux, E. (2010). A psycholinguistic perspective on the acquisition of phonology. In Fougeron, C., Kühnert, B.d’Imperio, M., & Vallée, N. (Eds.), Laboratory phonology 10: Variation, phonetic detail and phonological representation (pp. 311–340). Mouton de Gruyter.Google Scholar
Rodgers, M. P. H. (2013). English language learning through viewing television: An investigation of comprehension, incidental vocabulary acquisition, lexical coverage, attitudes, and captions (Unpublished PhD thesis). Victoria University, Wellington.Google Scholar
Saito, K. (2013). Reexamining effects of form-focused instruction on L2 pronunciation development: The role of explicit phonetic information. Studies in Second Language Acquisition, 35, 1–29.CrossRefGoogle Scholar
Saito, K. (2015). Communicative focus on second language phonetic form: Teaching Japanese learners to perceive and produce English /ɹ/ without explicit instruction. Applied Psycholinguistics, 36, 377–409.CrossRefGoogle Scholar
Segalowitz, N., & Frenkiel-Fishman, S. (2005). Attention control and ability level in a complex cognitive skill: Attention shifting and second-language proficiency. Memory & Cognition, 33, 644–653.CrossRefGoogle Scholar
Thomson, R. I., & Derwing, T. M. (2014). The effectiveness of L2 pronunciation instruction: A narrative review. Applied Linguistics, 36, 326–344.CrossRefGoogle Scholar
Vanderplank, R. (1988). The value of teletext subtitles in language learning. ELT Journal, 42, 272–281.CrossRefGoogle Scholar
Vanderplank, R. (2010). Déjà vu?A decade of research on language laboratories, television and video in language learning. Language Teaching, 43, 1–37.CrossRefGoogle Scholar
Vanderplank, R. (2016). Captioned media in foreign language learning and teaching: Subtitles for the deaf and hard-of-hearing as tools for language learning. Palgrave Macmillan.CrossRefGoogle Scholar
Webb, S. (2015). Extensive viewing: Language learning through watching television. In Nunan, D., & Richards, J. C. (Eds.), Language learning beyond the classroom (pp. 159–168).Routledge.Google Scholar
Webb, S., & Rodgers, M. (2009). Vocabulary demands of television programs. Language Learning, 59, 335–366.CrossRefGoogle Scholar
Wisniewska, N., & Mora, J. C. (2018). Pronunciation learning trough captioned videos. In Proceedings of the 9th Annual Pronunciation in Second Language Learning and Teaching Conference (pp. 204–215). Iowa State University.Google Scholar
Yan, X., Maeda, Y., Lv, J., & Ginther, A. (2016). Elicited imitation as a measure of second language proficiency: A narrative review and meta-analysis. Language Testing, 33, 497–528.CrossRefGoogle Scholar