Hostname: page-component-78c5997874-j824f Total loading time: 0 Render date: 2024-11-19T17:53:11.835Z Has data issue: false hasContentIssue false
  • English
  • Français

MULTIMODAL INPUT IN SLA RESEARCH

Published online by Cambridge University Press:  17 August 2020

Maribel Montero Perez Open the ORCID record for Maribel Montero Perez [Opens in a new window]
Maribel Montero Perez*
Affiliation:
KU Leuven
*
*Correspondence concerning this article should be addressed to Maribel Montero Perez, KU Leuven, Department of Linguistics and ITEC, imec Research Group at KU Leuven, Etienne Sabbelaan 51, 8500 Kortrijk, Belgium. E-mail: [email protected]
Get access Rights & Permissions [Opens in a new window]

Abstract

An abstract is not available for this content so a preview has been provided. Please use the Get access link above for information on how to access this content.
Image of the first page of this content. For PDF version, please use the ‘Save PDF’ preceeding this image.'
Type
Critical Commentary
Information
Studies in Second Language Acquisition , Volume 42 , Special Issue 3: Language Learning from Multimodal Input , July 2020 , pp. 653 - 663
Check for updates
Copyright
© The Author(s), 2020. Published by Cambridge University Press

Access options

Get access to the full version of this content by using one of the access options below. (Log in options will check for institutional or personal access. Content may require purchase if you do not have access.)

Footnotes

I would like to thank the guest editors of this special issue, Carmen Muñoz and Elke Peters, for giving me the opportunity to write this commentary.

References

REFERENCES

Boers, F., Warren, P., Grimshaw, G., & Siyanova-Chanturia, A. (2017). On the benefits of multimodal annotations for vocabulary uptake from reading. Computer Assisted Language Learning, 30, 709–725. https://doi.org/10.1080/09588221.2017.1356335CrossRefGoogle Scholar
Bollansée, L., Puimège, E., & Peters, E. (in press). Watch out! Behind you is the enemy! An exploratory study into the relationship between extramural English and productive vocabulary knowledge. In Werner, V. & Tegge, F. (Eds.), Learning languages through pop culture. Routledge.Google Scholar
Brown, R., Waring, R., & Donkaewbua, S. (2008). Incidental vocabulary acquisition from reading, reading-while-listening, and listening to stories. Reading in a Foreign Language, 20, 136–163.Google Scholar
Chang, A. (2009). Gains to L2 listeners from reading while listening vs. listening only in comprehending short stories. System, 37, 652–663. http://doi.org/10.1016/j.system.2009.09.009CrossRefGoogle Scholar
Chapelle, C. A. (2003). English language learning and technology. John Benjamins Publishing Company.CrossRefGoogle Scholar
Charles, T. J., & Trenkic, D. (2015). Speech segmentation in a second language: The role of bi-modal input. In Gambier, Y.Caimi, A., & Mariotti, C. (Eds.), Subtitles and language learning: Principles, strategies, and practical experiences (pp. 173–198). Peter Lang.Google Scholar
Cintrón-Valentín, M., García-Amaya, L., & Ellis, N. C. (2019). Captioning and grammar learning in the L2 Spanish classroom. The Language Learning Journal, 47, 439–459. http://doi.org/10.1080/09571736.2019.1615978CrossRefGoogle Scholar
Conklin, K., Pellicer-Sanchez, A., & Carrol, G. (2018). Eye-tracking: A guide for applied linguistics research. Cambridge University Press.CrossRefGoogle Scholar
Diao, Y., Chandler, P., & Sweller, J. (2007). The effect of written text on comprehension of spoken English as a foreign language. The American Journal of Psychology, 120, 237–261.Google ScholarPubMed
Douglas Fir Group. (2016). A transdisciplinary framework for SLA in a multilingual world. The Modern Language Journal, 100, 19–47. https://doi.org/10.1111/modl.12301CrossRefGoogle Scholar
Feng, Y., & Webb, S. (2020). Learning vocabulary through reading, listening, and viewing: Which mode of input is most effective? Studies in Second Language Acquisition, 42, 499–523. https://doi.org/10.1017/S0272263119000494CrossRefGoogle Scholar
Gass, S., Winke, P., Isbell, D. R., & Ahn, J. (2019). How captions help people learn languages: A working-memory, eye-tracking study. Language Learning and Technology, 23, 84–104.Google Scholar
Godfroid, A. (2019). Eye tracking in second language acquisition and bilingualism: A research synthesis and methodological guide. Routledge.CrossRefGoogle Scholar
Kress, G., & Van Leeuwen, T. (2001). Multimodal discourse: The modes and media of contemporary communication. Arnold.Google Scholar
Kuppens, A. (2010). Incidental foreign language acquisition from media exposure. Learning, Media and Technology, 35, 65–85. https://doi.org/10.1080/17439880903561876CrossRefGoogle Scholar
Lee, M., & Révész, A. (2018). Promoting grammatical development through textually enhanced captions: An eye-tracking study. The Modern Language Journal, 102, 557–577. https://doi.org/10.1111/modl.12503CrossRefGoogle Scholar
Lee, M., & Révész, A. (2020). Promoting grammatical development through captions and textual enhancement in multimodal input-based tasks. Studies in Second Language Acquisition, 42, 625–651. https://doi.org/10.1017/S0272263120000108CrossRefGoogle Scholar
Lindgren, E., & Muñoz, C. (2013). The influence of exposure, parents, and linguistic distance on young European learners’ foreign language comprehension. International Journal of Multilingualism, 10, 105–129. http://doi.org/10.1080/14790718.2012.679275CrossRefGoogle Scholar
Mayer, R. E. (2001). Multimedia learning. Cambridge University Press.CrossRefGoogle Scholar
Mayer, R. E. (2005). The Cambridge handbook of multimedia learning. Cambridge University Press.CrossRefGoogle Scholar
Mitterer, H., & McQueen, J. M. (2009). Foreign subtitles help but native-language subtitles harm foreign speech perception. PLoS One, 4, e7785. https://doi.org/10.1371/journal.pone.0007785CrossRefGoogle ScholarPubMed
Montero Perez, M. (2019a). Pre-learning vocabulary before viewing captioned video: An eye-tracking study. The Language Learning Journal, 47, 460–478. https://doi.org/10.1080/09571736.2019.1638623CrossRefGoogle Scholar
Montero Perez, M. (2019b). Technology-enhanced listening: How does it look and what can we expect? In Arnold, N. & Ducate, L. (Eds.), Engaging language learners through CALL: From theory and research to informed practice (pp. 141–178). Equinox Publishing.Google Scholar
Montero Perez, M. (2020). Incidental vocabulary learning through viewing video: The role of vocabulary knowledge and working memory. Studies in Second Language Acquisition. Advance online publication. https://doi.org/10.1017/S0272263119000706CrossRefGoogle Scholar
Montero Perez, M., Peters, E., Clarebout, G., & Desmet, P. (2014). Effects of captioning on video comprehension and incidental vocabulary learning. Language Learning & Technology, 18, 118–141.Google Scholar
Montero Perez, M., Peters, E., & Desmet, P. (2015). Enhancing vocabulary learning through captioned video: An eye-tracking study. The Modern Language Journal, 99, 308–328.CrossRefGoogle Scholar
Montero Perez, M., Peters, E., & Desmet, P. (2018). Vocabulary learning through viewing video: The effect of two enhancement techniques. Computer Assisted Language Learning, 31, 1–26.CrossRefGoogle Scholar
Montero Perez, M., & Rodgers, M. P. H. (Eds.) (2019). Video and language learning [special issue]. The Language Learning Journal, 47, 403–518.CrossRefGoogle Scholar
Montero Perez, M., Van Den Noortgate, W., & Desmet, P. (2013). Captioned video for L2 listening and vocabulary learning: A meta-analysis. System, 41, 720–739.CrossRefGoogle Scholar
Muñoz, C. (2017). The role of age and proficiency in subtitle reading. An eye-tracking study. System, 67, 77–86.CrossRefGoogle Scholar
Paivio, A. (1986). Mental representations: A dual coding approach. Oxford University Press.Google Scholar
Pellicer-Sánchez, A., Tragant, E., Conklin, K., Rodgers, M., Serrano, R., & Llanes, Á. (2020). Young learners’ processing of multimodal input and its impact on reading comprehension: An eye-tracking study. Studies in Second Language Acquisition, 42, 577–598. https://doi.org/10.1017/S0272263120000091CrossRefGoogle Scholar
Peters, E. (2018). The effect of out-of-class exposure to English language media on learners’ vocabulary knowledge. ITL–International Journal of Applied Linguistics, 169, 142–168.CrossRefGoogle Scholar
Peters, E. (2019). The effect of imagery and on-screen text on foreign language vocabulary learning from audiovisual input. TESOL Quarterly, 53, 1008–1032. https://doi.org/10.1002/tesq.531CrossRefGoogle Scholar
Peters, E., Heynen, E., & Puimège, E. (2016). Learning vocabulary through audiovisual input: The differential effect of L1 subtitles and captions. System, 63, 134–148. https://doi.org/10.1016/j.system.2016.10.002CrossRefGoogle Scholar
Peters, E., & Muñoz, C. (2020). Introduction to the special issue: Language learning from multimodal input. Studies in Second Language Acquisition, 42, 489–497. https://doi.org/10.1017/S0272263120000212Google Scholar
Peters, E., & Webb, S. (2018). Incidental vocabulary acquisition through viewing L2 television and factors that affect learning. Studies in Second Language Acquisition, 40, 551–577. https://doi.org/10.1017/S0272263117000407CrossRefGoogle Scholar
Plass, J. L., & Jones, L. C. (2005). Second language acquisition with multimedia. In Mayer, R. E. (Ed.), The Cambridge handbook of multimedia learning (pp. 476–488). Cambridge University Press.Google Scholar
Puimège, E., & Peters, E. (2019). Learners’ English vocabulary knowledge prior to formal instruction: The role of learner-related and word-related variables. Language Learning, 69, 943–977. https://doi.org/10.1111/lang.12364CrossRefGoogle Scholar
Puimège, E., & Peters, E. (2020). Learning formulaic sequences through viewing L2 television and factors that affect learning. Studies in Second Language Acquisition, 42, 525–549. https://doi.org/10.1017/S027226311900055XCrossRefGoogle Scholar
Pujadas, G., & Muñoz, C. (2020). Examining adolescent EFL learners’ TV viewing comprehension through captions and subtitles. Studies in Second Language Acquisition, 42, 551–575. https://doi.org/10.1017/S0272263120000042CrossRefGoogle Scholar
Rodgers, M. P. H. (2013). English language learning through viewing television: An investigation of comprehension, incidental vocabulary acquisition, lexical coverage, attitudes and captions (Unpublished doctoral dissertation). Victoria University, Wellington, New Zealand.Google Scholar
Rodgers, M. P. H. (2018). The images in television programs and the potential for learning unknown words: The relationship between on-screen imagery and vocabulary. ITL—International Journal of Applied Linguistics, 169, 191–211.CrossRefGoogle Scholar
Rodgers, M. P. H., & Webb, S. (2017). The effects of captions on EFL learners’ comprehension of English-Language television programs. CALICO Journal, 34, 20–38. https://doi.org/10.1558/cj.29522CrossRefGoogle Scholar
Rost, M. (2014). Developing listening fluency in Asian EFL settings. In Muller, T.Adamson, J.Brown, P. Shigeo, & Herder, S. (Eds.), Exploring EFL fluency in Asia (pp. 281–296). Palgrave Macmillan.Google Scholar
Serrano, R., & Pellicer-Sánchez, A. (2019). Young L2 learners’ online processing of information in a graded reader during reading-only and reading-while-listening conditions: A study of eye-movements. Applied Linguistics Review. Advance online publication. https://doi.org/10.1515/applirev-2018-0102CrossRefGoogle Scholar
Suárez, M., & Gesa, F. (2019). Learning vocabulary with the support of sustained exposure to captioned video: Do proficiency and aptitude make a difference? The Language Learning Journal, 47, 497–517, https://doi.org/10.1080/09571736.2019.1617768CrossRefGoogle Scholar
Sydorenko, T. (2010). Modality of input and vocabulary acquisition. Language Learning & Technology, 14, 50–73.Google Scholar
Tragant, E., Muñoz, C., & Spada, N. (2016). Maximizing young learners’ input: An intervention program. Canadian Modern Language Review, 72, 234–257. https://doi.org/10.3138/cmlr.2942CrossRefGoogle Scholar
Tragant, E., & Pellicer-Sánchez, A. (2019). Young EFL learners’ processing of multimodal input: Examining learners’ eye-movements. System, 80, 212–223. https://doi.org/10.1016/j.system.2018.12.002CrossRefGoogle Scholar
Vanderplank, R. (2010). Déjà vu? A decade of research on language laboratories, television and video in language learning. Language Teaching, 43, 1–37. https://doi.org/10.1017/S0261444809990267CrossRefGoogle Scholar
Vanderplank, R. (2016). “Effects of” and “effects with” captions: How exactly does watching a TV programme with same-language subtitles make a difference to language learners? Language Teaching, 49, 235–250. https://doi.org/10.1017/S0261444813000207CrossRefGoogle Scholar
Warren, P., Boers, F., Grimshaw, G., & Siyanova-Chanturia, A. (2018). The effect of gloss type on learners’ intake of new words during reading. Studies in Second Language Acquisition, 40, 883–906. https://doi.org/10.1017/S0272263118000177CrossRefGoogle Scholar
Webb, S. (2010a). Using glossaries to increase the lexical coverage of television programs. Reading in a Foreign Language, 22, 201–221.Google Scholar
Webb, S. (2010b). Pre-learning low-frequency vocabulary in second language television programmes. Language Teaching Research, 14, 501–515. http://doi.org/10.1177/1362168810375371CrossRefGoogle Scholar
Webb, S. (2015). Extensive viewing. Language learning through watching television. In Nunan, D., & Richards, J. C. (Eds.), Language learning beyond the classroom (pp. 159–168). Routledge.Google Scholar
Webb, S., & Chang, A. (2015). How does prior word knowledge affect vocabulary learning progress in an extensive reading program? Studies in Second Language Acquisition, 37, 651–675.CrossRefGoogle Scholar
Webb, S., & Rodgers, M. P. H. (2009). Vocabulary demands of television programs. Language Learning, 59, 335–366.CrossRefGoogle Scholar
Winke, P., Gass, S., & Sydorenko, T. (2010). The effects of captioning videos used for foreign language listening activities. Language Learning & Technology, 14, 65–86.Google Scholar
Wisniewska, N., & Mora, J. C. (2020). Can captioned video benefit second language pronunciation? Studies in Second Language Acquisition, 42, 599–624. https://doi.org/10.1017/S0272263120000029CrossRefGoogle Scholar