Captioned video is widely used to enhance second language (L2) learners’ exposure to oral input beyond the classroom setting, and captioning has been found to provide an instantaneous, useful visual aid for parsing and understanding L2 oral discourse. Nevertheless, a meta-analysis has shown that captioning exerts a selective effect on L2 learners with different profiles. This study investigated whether L2 learners’ modality preferences (visual vs. auditory) and working memory capacity (high vs. low) would modulate the effect of full captions on L2 listening outcome. Results from 60 participants revealed that both cognitive variables affected their L2 listening to different extents. Notably, working memory capacity modulates the impact of L2 learners’ preferred modality on their listening outcome. Modality preference did not exert any significant impact on the listening outcome of L2 learners with lower working memory capacity. For L2 learners with high working memory capacity, their modality preference played a pivotal role in modulating their listening outcome; in this case, auditory learners had the best listening performance viewing the video without captions, whereas visual learners did best when watching the captioned video. These findings speak to the need for taking individual differences into consideration when employing captioned videos.

For many EFL learners, listening poses a grave challenge. The difficulty in segmenting a stream of speech and limited capacity in short-term memory are common weaknesses for language learners. Specifically, reduced forms, which frequently appear in authentic informal conversations, compound the challenges in listening comprehension. Numerous interventions have been implemented to assist EFL language learners, and of these, the application of captions has been found highly effective in promoting learning. Few studies have examined how different modes of captions may enhance listening comprehension. This study proposes three modes of captions: full, keyword-only, and annotated keyword captions and investigates their contribution to the learning of reduced forms and overall listening comprehension. Forty-four EFL university students participated in the study and were randomly assigned to one of the three groups. The results revealed that all three groups exhibited improvement on the pre-test while the annotated keyword caption group exhibited the best performance with the highest mean score. Comparing performances between groups, the annotated keyword caption group also emulated both the full caption and the keyword-only caption groups, particularly in the ability to recognize reduced forms. The study sheds light on the potential of annotated keyword captions in enhancing reduced forms learning and overall listening comprehension.

This study aims to explore the impact of different captions on second language (L2) learning in a computer-assisted multimedia context. A quasi-experimental design was adopted, and a total of thirty-two eighth graders selected from a junior high school joined the study. They were systematically assigned into four groups based on their proficiency in English; these groups were shown animations with English narration and one of the following types of caption: no captions (M1), Chinese captions (M2), English captions (M3), and Chinese plus English captions (M4). A multimedia English learning program was conducted; the learning content involved two scientific articles presented on a computer. To track the learning process, data on oral repetition were collected after each sentence or scene was played. A post-test evaluation and a semi-structured interview were conducted immediately after viewing. The results show that the effect of different captions in multimedia L2 learning with respect to vocabulary acquisition and reading comprehension depend on students’ L2 proficiency. With English and Chinese + English captions, learners with low proficiency performed better in learning English relative to those who did not have such captions. Students relied on graphics and animation as an important tool for understanding English sentences.