Hostname: page-component-78c5997874-4rdpn Total loading time: 0 Render date: 2024-11-05T04:28:23.405Z Has data issue: false hasContentIssue false

Digital multimodal composing in L2 classrooms: A research agenda

Published online by Cambridge University Press:  03 May 2024

Lianjiang (George) Jiang*
Affiliation:
University of Hong Kong, Hong Kong
Christoph Hafner
Affiliation:
City University of Hong Kong, Hong Kong
*
Corresponding author: Lianjiang (George) Jiang; Email: [email protected]
Rights & Permissions [Opens in a new window]

Abstract

Research on digital multimodal composing (DMC) in second language (L2) classrooms has proliferated considerably in recent years, to a large extent in response to the changing digital and multimodal communication landscape. This article offers a research agenda on DMC in L2 classrooms. We begin with a theoretically oriented overview of DMC scholarship. We then examine seven research themes for future research inquiry, from which we draw seven research tasks. The seven themes are: (1) the effectiveness of DMC for L2 writing development; (2) DMC task design; (3) L2 teacher education/training for implementing DMC; (4) feedback practice for DMC; (5) DMC assessment; (6) collaborative DMC as a translanguaging space; and (7) the deployment of DMC for critical digital literacies. Throughout the article, we refer to interdisciplinary scholarship and methods from multimodality, L2 writing, composition studies, new literacy studies, language teacher education, and computer-assisted language learning. The seven research tasks represent what we see as the essential next steps for understanding DMC, which is a young domain that has great potential to advance L2 language and literacy education in the digital age.

Type
Thinking Allowed
Creative Commons
Creative Common License - CCCreative Common License - BY
This is an Open Access article, distributed under the terms of the Creative Commons Attribution licence (http://creativecommons.org/licenses/by/4.0/), which permits unrestricted re-use, distribution and reproduction, provided the original article is properly cited.
Copyright
Copyright © The Author(s), 2024. Published by Cambridge University Press

1. Introduction

Digital multimodal composing (DMC) has emerged as a prominent teaching and learning practice in second language (L2) classrooms over the past two decades. The emergence of DMC is a response to the paradigmatic shift in language and literacy education in L2 classrooms, where writing has been reconceptualised as a process of multimodal design that is frequently mediated by digital technologies (Belcher, Reference Belcher2017; Lankshear & Knobel, Reference Lankshear and Knobel2006; New London Group, Reference New London Group1996). DMC as a pedagogical approach has been defined as “a textual practice that involves the use of digital tools to produce texts by combining multiple semiotic modes that include, but are not limited to, image, word, and soundtrack” (Jiang, Reference Jiang2017, p. 413). Examples of DMC include various forms of video documentaries, presentation slides, podcasting, infographics, webpages, or digital stories, among others (Hafner, Reference Hafner2014; Jiang et al., Reference Jiang, Li and Leung2024; Smith et al., Reference Smith, Amgott and Malova2022). Thus, DMC can be seen as an emerging umbrella term that covers the use of a wide range of new forms of representation in pedagogical contexts, including such practices as digital storytelling and digital writing. The body of DMC research has been steadily growing across L2 contexts since the pioneering use of digital multimodal storytelling for underprivileged L2 learners by Hull and Nelson (Reference Hull and Nelson2005) and Nelson (Reference Nelson2006).

DMC practices in L2 classrooms have received increasing scholarly attention, especially over the last decade or so. In 2013, a symposium in TESOL Quarterly highlighted the notion of digital composition in a second or foreign language as one way to reconceptualise reading and writing in the digital age (Hafner et al., Reference Hafner, Chik and Jones2013). Since then, a number of special issues in prominent journals in the field have addressed issues of digital multimodal forms of expression in English language teaching and learning. These include, among others: special issues of TESOL Quarterly on multimodality (Early et al., Reference Early, Kendrick and Potts2015) and digital literacies (Darvin & Hafner, Reference Darvin and Hafner2022); special issues of the Journal of Second Language Writing on L2 writing in the age of computer-mediated communication (Li & Storch, Reference Li and Storch2017) and multimodal composing (Yi et al., Reference Yi, Shin and Cimasko2020); and a thought-provoking debate on multimodal composing in the disciplinary dialogues section of the Journal of Second Language Writing (Xu & Matsuda, Reference Xu and Matsuda2017). These efforts will continue with a special issue of Computers and Composition on DMC in the era of artificial intelligence (Gilje et al., Reference Gilje, Djonov and Limforthcoming). Over the years, research on DMC has evolved into a dynamic domain of inquiry that straddles multiple areas, including L2 writing, composition studies, new literacy studies, language teacher education, and computer-assisted language learning.

Owing to continued developments in digital technologies and evolving literacy expectations in L2 classrooms, we foresee that the domain of DMC research will continue to flourish. To move the domain forward, the purpose of this article is to present a forward-looking research agenda by detailing seven research themes and related tasks that we consider to be the most pressing for L2 researchers and practitioners. The development of the seven research tasks in this article is informed not only by our engagement with DMC research and practice but also by previous reviews of DMC scholarship, including Li and Akoto's (Reference Li and Akoto2021) systematic review of existing research foci (i.e. L2 students' composing process, perceptions, and benefits), the systematic review of DMC studies in secondary classrooms by Smith et al. (Reference Smith, Pacheco and Khorosheva2020), the systematic review of DMC studies in post-secondary contexts by Zhang et al. (Reference Zhang, Akoto and Li2023), and Lim and Kessler's (Reference Lim, Kessler, Manchón and Polio2022) review of prior L2 studies on multimodal writing from a second language acquisition (SLA) perspective, as well as their recent research timeline article (Lim & Kessler, Reference Lim and Kessler2023). Different from previous reviews, we followed a two-step procedure in developing the seven research themes. First, we focused on what remains controversial in the field by synthesising the inconclusive and contradictory research findings in extant literature. As the effectiveness of DMC for L2 writing development emerges from this synthesis as an oft-disputed theme, we reinforce the pressing need for more research in this area. Second, we categorise the remaining research areas identified as in need of further exploration into six additional themes, thereby extending Lim and Kessler's (Reference Lim, Kessler, Manchón and Polio2022) work in three main ways. First, Lim and Kessler's (Reference Lim, Kessler, Manchón and Polio2022) review suggested four areas for future research (i.e. language development, multimodal writing process, multimodal text analysis, and student needs/practices) but was informed only by literature published prior to 2020. We include the most recent publications (up to 2023) and highlight the under-researched but much needed issues of pedagogic design, teacher education, feedback, assessment, collaboration, translanguaging, and critical digital literacies. Second, in addition to the cognitive perspective proposed by Lim and Kessler (Reference Lim, Kessler, Manchón and Polio2022), we add sociocultural and critical perspectives as theoretical foundations for further research on DMC. Third, we highlight the need for more research on DMC to examine the development of critical digital literacies to resist implicit forms of digital manipulation and power embedded in new digital platforms/structures and to reconstruct a more equitable and inclusive online space for literacy learning. In the next section, before presenting the research tasks in detail, we first outline the trajectories of the conceptual underpinnings of DMC scholarship.

2. Conceptual trajectories for researching DMC

To understand what theoretical perspectives may inform further research on DMC, an overview of the epistemological trajectories surrounding DMC is necessary. To date, DMC research has been informed by four major theoretical approaches, including the multimodal, sociocultural, cognitive, and critical approaches to language and literacy education.

From its inception, DMC has been introduced into L2 classrooms as an activity for language learning and teaching by applied linguists (e.g. Nelson, Reference Nelson2006; Shin & Cimasko, Reference Shin and Cimasko2008), who are often aligned with a social semiotic perspective on multimodality as an approach to communication, seeing language as just one among many semiotic resources that are required to make meaning (Kress, Reference Kress2010). DMC is seen as a process that culminates in the creation of a multimodal ensemble incorporating linguistic, visual, aural, gestural, and spatial modes, among others. To understand the literate process of multimodal meaning-making within and across modes, theoretical constructs such as poly-semiotics (the spontaneous combination of two or more semiotic systems), semiotic remediation (the various ways that semiotic performances/materials are re-represented and rewoven across modes/media), visual metadiscourse (the visual cues and markers that connect various visual elements to meet the visual needs of audiences), and remixing (the combination of cultural artefacts into new creative blends) have been adopted by various L2 scholars (Hafner, Reference Hafner2015; Knobel & Lankshear, Reference Knobel and Lankshear2007; Li et al., Reference Li, Gibbons and Pham2023; Prior & Hengst, Reference Prior, Hengst, Prior and Hengst2010; Toohey & Dagenais, Reference Toohey and Dagenais2015). A systemic functional approach to multimodal discourse analysis (SF-MDA), focusing on the grammars of semiotic resources to understand meanings arising from semiotic choices and combinations (Jewitt et al., Reference Jewitt, Bezemer and O'Halloran2016; Unsworth, Reference Unsworth2006), has also been adopted to guide the analysis of multimodal choices, intermodal relations, and meaning constructions during the process of DMC (Shin et al., Reference Shin, Cimasko and Yi2020).

DMC research has also been informed by sociocultural approaches to language and literacy education. Such approaches focus on examining the social, cultural, and historical contexts of DMC, which is often conceptualised as a site for socially embedded and situated literacy practices (Lantolf & Thorne, Reference Lantolf and Thorne2006; Street, Reference Street1984; Vygotsky, Reference Vygotsky1978). Along with the New Literacy Studies tradition, relevant literacy frameworks for DMC research include multimodal literacies (Jewitt & Kress, Reference Jewitt and Kress2003), new literacies (Gee, Reference Gee and Baker2010; Lankshear & Knobel, Reference Lankshear and Knobel2006), digital literacies (Jones & Hafner, Reference Jones and Hafner2021; Weninger, Reference Weninger2023), and multiliteracies (New London Group, Reference New London Group1996). These frameworks collectively refute the autonomous model of literacy as decontextualised reading and writing and highlight the sociocultural contexts and material worlds of digital multimodal composers. A sociocultural approach theorises DMC as goal-directed social practices that are infused with composers' presentation of self and identity development (Lim & Toh, Reference Lim and Toh2020). Such an approach contributes to DMC research by enabling researchers to examine the role of DMC in, for instance, creating spaces for identity expression, developing multiliteracies, and bridging the gap between in-school academic learning and students' vernacular literacy practices and lived experiences.

More recently, there has been a growing body of research on DMC undergirded by cognitive perspectives on SLA, including the noticing hypothesis (Schmidt, Reference Schmidt1990) and the cognitive process of writing theory. The noticing hypothesis posits that awareness of a gap between input and output is necessary for SLA to occur, and DMC researchers (e.g. Dzekoe, Reference Dzekoe2017) have used this hypothesis to show that DMC can help L2 student writers to notice linguistic problems in their writing. The cognitive process theory takes writing as “a set of distinctive thinking processes which writers orchestrate or organize” (Flower & Hayes, Reference Flower and Hayes1981, p. 366) and has been applied to exploring the cognitive process of DMC (Tan, Reference Tan2023). The DMC research underpinned by these cognitive perspectives mostly theorises DMC as a cognitive process involving a range of functional skills. The cognitive perspective allows DMC researchers to examine in detail the cognitive process and composing behaviours involved in DMC, as well as the relationship of these behaviours with L2 language and literacy development.

A small number of recent DMC studies have also been informed by critically oriented theories of literacy and identity, including critical media literacy theory (Kellner & Share, Reference Kellner and Share2005) and identity investment theories (Norton, Reference Norton2013). These critical perspectives focus on issues of power and ideology, analysing the politics of representation of gender, race, class, and sexuality with the purpose of exploring how power, media, and information are linked (Kellner & Share, Reference Kellner and Share2005). Such a perspective has informed studies examining L2 students' representation of their critical understanding of the power and politics of English through DMC (Huang, Reference Huang2012, Reference Huang2019). The sociological concept of investment (Darvin & Norton, Reference Darvin and Norton2015) has been used to explore how often-marginalised learner identities can be empowered through DMC in L2 classrooms (Jiang et al., Reference Jiang, Yang and Yu2020; Kendrick et al., Reference Kendrick, Early, Michalovich and Mangat2022). With the critical perspective, researchers (e.g. Cummins et al., Reference Cummins, Hu, Markus and Kristiina Montero2015) have started to use DMC to engage minoritised L2 learners with identity text production for transformative literacy learning experiences.

The abovementioned theoretical advances and conceptual trajectories in DMC research indicate that the field is becoming ripe for more empirical and theoretically informed research in L2 classrooms. In the following sections, we illustrate how future research on seven key themes in DMC scholarship can be addressed with reference to seven research tasks, one per theme.

3. Research themes and research tasks

This section presents seven research themes, each of which gives rise to a research task that could contribute to the body of research on DMC in L2 classrooms. For each theme, we first provide an overview of relevant research, thus setting out the need for future research, before suggesting specific strategies that researchers can employ to accomplish each task.

3.1 Research theme: Effectiveness of DMC for L2 writing development

Over the years, substantial evidence has been reported in support of the value of DMC for many dimensions of L2 learning, including the development of multiliteracies and learner motivation, agency, autonomy, and identities (Hafner & Miller, Reference Hafner and Miller2011; Jiang & Luk, Reference Jiang and Luk2016; Kendrick et al., Reference Kendrick, Early, Michalovich and Mangat2022; Lim et al., Reference Lim, Chia and Nguyen2022a). Despite this evidence, the integration of DMC into L2 pedagogy is not without controversy. One prominent concern relates to the effectiveness of DMC in fostering L2 writing development and the pertinent debate about the instructional use of DMC. On the one hand, some scholars have argued that the use of DMC in L2 classrooms provides an effective way to address multimodal forms of expression that have gained prominence in the digital age (Belcher, Reference Belcher2017; Hafner, Reference Hafner2014; Yi, Reference Yi2017). On the other hand, some L2 writing researchers and practitioners have expressed concerns, with one opining that “the dazzling multimodal discourse has lured students' attention away from the language in a text, shifting their conscious monitoring (in Krashenian sense (Reference Krashen1981)) to other modes of representation” (Qu, Reference Qu2017, p. 93). Such a critique echoes the conceptualisation of DMC as a distraction (Manchón, Reference Manchón2017) from “traditional” writing and questions the use of DMC as an asset-based pedagogy in L2 classrooms. To address these concerns, there is a need for further research on the effectiveness of DMC for L2 writing development. Such research would provide empirical evidence on the use of DMC to foster writing development, which is a key goal in L2 classrooms (Lim & Kessler, Reference Lim, Kessler, Manchón and Polio2022).

However, compared with the affective and sociocultural benefits (e.g. motivation, identities) of DMC, research on the linguistic benefits of DMC remains limited (Kim et al., Reference Kim, Belcher and Peyton2023). Studies of DMC seemed to have often drawn on qualitative methodologies to focus on students' reported perspectives and observed experiences (e.g. Hafner & Miller, Reference Hafner and Miller2011; Pham & Li, Reference Pham and Li2022), which did not intend to explore whether and how students develop their linguistic writing skills through DMC. Meanwhile, the results obtained from the limited research on the impact of DMC on L2 writing outcomes remain inconclusive. On the one hand, some studies have reported a positive impact of DMC on the writing performance of L2 students. For example, Vandommele et al. (Reference Vandommele, Van den Branden, Van Gorp and De Maeyer2017) investigated the effects of a DMC intervention in in-school and out-of-school leisure settings on the development of writing skills among L2 Dutch beginner learners. They noted that compared with the non-intervention group, the in-school group showed growth in complexity, text length, content, and communicative effectiveness and the out-of-school group revealed greater gains in syntactic complexity, lexical diversity, and text length. A similar positive impact of DMC on the writing performances of L2 student writers has also been reported in the U.S. and Chinese contexts (Dzekoe, Reference Dzekoe2017; Tan, Reference Tan2023; Xu, Reference Xu2021). On the other hand, studies in the Korean context have reported no significant differences in accurate clause rate, content and language alignment, or amount of reflection in writing outcomes between DMC and traditional writing (Cho & Kim, Reference Cho and Kim2021; Kim & Belcher, Reference Kim and Belcher2020). Mixed perceptions regarding the benefits of DMC for improving writing skills were also reported in Kim and Belcher's (Reference Kim and Belcher2020) study involving 18 university students. However, in a recent quasi-experimental study of 41 Korean university English as a Foreign Language (EFL) students, in which the researchers compared the writing development of students doing traditional writing tasks with another group doing DMC, Kim et al. (Reference Kim, Belcher and Peyton2023) reported greater gains in content and language for the DMC-integrated writing group. The contradictory findings may result from the use of different writing genres and writing quality measurements in the different studies. In addition, the inconclusive results are further compounded by limited sample sizes and small effect sizes. Given that L2 writing teachers are more likely to incorporate DMC into their language teaching classrooms if there is clear evidence of its benefits for traditional, language-focused writing development, more research on the linguistic benefits of DMC is warranted. This leads us to the first research task, as follows.

Research task 1

Explore the linguistic benefits of DMC by examining the effectiveness of DMC in promoting L2 writing development.

To undertake this research task, cognitive theories of SLA can be used to conceptualise how and why DMC may contribute to L2 writing development. For instance, the noticing hypothesis can be used to illuminate how the integration of visuals into DMC can help L2 student writers to notice the linguistic and rhetorical issues in their writing (Dzekoe, Reference Dzekoe2017). The theory of learning transfer (DePalma & Ringer, Reference DePalma and Ringer2011) offers a comprehensive framework for DMC researchers to analyse the linguistic features of writing performance with DMC and examine how L2 student writers transfer learning and knowledge across print-based writing and various forms of DMC (Kang, Reference Kang2022). Cognitive process theory (Flower & Hayes, Reference Flower and Hayes1981) also provides a framework to compare the cognitive processes underlying DMC and traditional monomodal writing (Tan, Reference Tan2023). Researchers can draw upon such theoretical frameworks to explicate the cognitive mechanisms underlying DMC and the impact of DMC on L2 writing development.

In terms of research methods, a quasi-experimental design with pre- and post-tests would be helpful to investigate the impact of DMC on L2 writing performance and development. Kim et al.'s (Reference Kim, Belcher and Peyton2023) quasi-experimental study comparing the effects of traditional monomodal writing activities and DMC activities in English for Academic Purposes (EAP) classrooms offers a good example of how the linguistic benefits of DMC can be documented in a systematic way. In this study, students were assigned to one of two conditions: the first using traditional, monomodal writing instruction and the second using DMC-integrated writing instruction. The researchers first compared linguistic performance in outputs of traditional writing and DMC assignments, using measures of text length, complexity, and accuracy. They used timed TOEFL-style pre-tests and post-tests to evaluate language development in the two groups based on content, organisation, and language scores using an analytic rubric. As this line of research is at present limited by the relatively small sample sizes drawn from a single L2 context, replication studies with larger samples across a range of contexts are warranted. Quasi-experimental studies focusing on a wider range of L2 writing development measures are also needed to counteract the limited effect sizes in existing studies.

3.2 Research theme: DMC task design

Tasks are foundational and continuously evolving in L2 classrooms (Swales & Feak, Reference Swales and Feak2023). Despite the increasing implementation of DMC in L2 classrooms, research on DMC task design is in its infancy (Li & Zhang, Reference Li and Zhang2023). Here, “task design” refers to both process and product: the processes that learners are asked to navigate as well as the products that they are asked to design. To date, very little is known about what elements need to be included in a DMC task for it to be successful or whether different kinds of L2 learners (e.g. different age groups, different L2 proficiency levels) respond to elements of DMC task design (e.g. collaborative versus individual work) in different ways. There is also a need for further research on what forms of pedagogical scaffolds have been adopted in practice and how the use of these scaffolds can contribute to efficacious DMC task designs and outcomes in L2 classrooms. DMC involves very complex and fluid processes, the effects of which are mediated by a range of elements, including task scaffolds (e.g. pre-task storyboarding, grouping), learner training, composition tools, and L2 learners’ multimodal preferences. Therefore, to customise DMC task designs for different learning needs, it is necessary to identify the possible permutations of DMC tasks and test these permutations with different types of learners. The extent to which generative artificial intelligence (e.g. ChatGPT) becomes a part of or is incorporated into DMC tasks has also become an interesting question for DMC researchers and practitioners. One important long-term goal of this line of inquiry is to develop theoretical heuristics and models that can explain differences in DMC task designs and scaffolding frameworks across contexts as well as any foundational commonalities. This leads us to the second research task, as follows.

Research task 2

Explore the dimensions of DMC task design and how different dimensions affect learning outcomes.

To identify valid, evidence-based task design options for DMC, it will be useful to first conceptualise DMC task and its design. With reference to previous work on DMC tasks (Hafner, Reference Hafner2013; Kim et al., Reference Kim, Kang, Nam and Skalicky2022), the concept of a DMC task can be defined as a task in which L2 learners construct meanings by incorporating various modes of communication. The task outcome can include a variety of genres, from digital video scientific documentaries to infographics. DMC tasks, often conceptualised in the literature as projects, tend to be complex, comprising a range of sub-tasks at various levels that often require a lengthy period of time to complete. Accordingly, DMC task design can be taken as the design, scaffolding, and implementation of DMC activities throughout the pre-task, during-task, and post-task stages.

Throughout the three major task stages, important dimensions to consider in DMC task design can be conceptualised with reference to the work of Grapin (Reference Grapin2019), Jiang et al. (Reference Jiang, Yu and Lee2022a), Liang and Lim (Reference Liang and Lim2021), Lim and Polio (Reference Lim and Polio2020), and Pacheco et al. (Reference Pacheco, Smith, Deig and Amgott2021), among others. Based on these works, we suggest that DMC task design entails a number of dimensions, including genres (e.g. video documentary or photo story), processes (e.g. collaborative or individual work), purposes (e.g. creative, disciplinary, critical), scaffolds (e.g. pre-task storyboarding), choice of linguistic modes (e.g. written or spoken), other semiotic modes (e.g. visual, soundtrack), composing tools (e.g. WeVideo, ChatGPT), and composing topics (e.g. curricular topics or student-initiated topics). Among these dimensions, scaffolds may be the most essential and complex. According to Pacheco et al.'s (Reference Pacheco, Smith, Deig and Amgott2021) systematic review, scaffolds for DMC tasks fall into seven major categories: collaboration, direct instruction, exemplar texts, translanguaging, discussion, encouragement, and questioning. These categories and dimensions offer a starting point and a workable checklist for future explorations into DMC task design in different L2 classrooms.

In terms of research methods, a sequential mixed-methods design can be usefully adopted. First, large-scale surveys can be conducted to understand existing practices of DMC task design, as observed in authentic L2 classrooms. The survey items can be designed with reference to the conceptual framework of DMC task dimensions described above. For instance, L2 teachers can be surveyed on whether and how they have integrated generative artificial intelligence technologies such as ChatGPT into DMC task design, and if so, at what stages, for what purposes, and with what impact on new forms of digital genres in L2 classrooms (Hafner et al., Reference Hafner, Harrison, Ho and Kwan2023). Second, longitudinal single-case studies or studies with multiple-case designs can be conducted with purposively selected innovative teachers to search for trends and commonalities in DMC task design across a variety of L2 classrooms. Data can be collected through in-depth interviews with teachers, lesson observations, think-aloud protocols as teachers plan and design DMC tasks, and post-lesson reflections. Based on within- and cross-case analyses, empirically grounded frameworks for DMC task design in L2 classrooms can be synthesised and developed for larger-scale intervention purposes. Third, evaluation studies testing the impact and learning outcomes of various dimensions of DMC task design can be conducted through quasi-experimental designs with pre- and post-tests. The perceptions of participating teachers and students regarding the efficacy of various permutations of DMC task designs can also be examined as additional data to supplement the evaluation of how different dimensions influence learning outcomes.

3.3 Research theme: L2 teacher education

To implement DMC in L2 classrooms, teachers need to feel competent and empowered, leading some researchers to suggest that the success of DMC pedagogy rests on effective teacher preparation (Jiang & Ren, Reference Jiang and Ren2021; Li, Reference Li2020). However, L2 teachers have often reported a perception of being under-prepared in this respect (Mills & Exley, Reference Mills and Exley2014; Tan & McWilliam, Reference Tan and McWilliam2009; Yi & Angay-Crowder, Reference Yi and Angay-Crowder2016). In contrast with the many studies that have been conducted on the use of DMC for student learning, relatively few studies have attended to the issue of DMC from the teachers' perspective. Indeed, teacher expertise in general remains almost uncharted terrain in research on L2 writing (Hirvela & Belcher, Reference Hirvela and Belcher2022; Swales & Feak, Reference Swales and Feak2023). Studies on teacher preparation for DMC have examined how pre-service teachers can benefit from DMC assignments that are integrated into their teacher training programmes (Li, Reference Li2020), but they have not considered in-service teachers and how engaging with DMC might help such teachers to learn, change, and develop the competences needed to implement DMC in L2 classrooms. With respect to the implementation of DMC in the L2 classroom, teachers need to develop an appreciation of the need and rationale for DMC instruction, sound multimodal communicative competence and semiotic awareness, and sound DMC pedagogical content knowledge. As such, to better prepare L2 teachers to use DMC effectively as an instructional strategy, it is necessary to understand how they develop the relevant expertise, in a number of dimensions. These dimensions include teachers' perceptions of DMC, of their own multimodal communicative competence compared with their actual competence as observed in classroom practice, and of their ability to implement DMC compared with their actual ability as observed in classroom practice. This leads us to research task 3, as follows.

Research task 3

Explore the dimensions of L2 teachers' expertise in developing multimodal L2 competence and relevant pedagogical content knowledge by engaging with DMC.

A challenge in undertaking research task 3 is to conceptualise what expertise in using DMC entails for L2 teachers. To grasp the target expertise/competences required for L2 teachers to learn to use DMC, one should first consider expertise “as something in motion”, rather than as “a fixed or finished product” (Hirvela & Belcher, Reference Hirvela and Belcher2022, p. 5). Following this process-oriented conceptualisation, DMC researchers can apply the adaptive expertise model (Hatano & Inagaki, Reference Hatano, Inagaki, Azuma and Hakuta1986; Lee & Yuan, Reference Lee and Yuan2021), which distinguishes routine expertise from adaptive expertise, to explore whether and how L2 teachers “engage in an ongoing exploration and expansion of what they know and thus make adjustments in how they teach” (Hirvela & Belcher, Reference Hirvela and Belcher2022, p. 4) through DMC. More importantly, to theorise what comprises expertise in using DMC, researchers can draw on theories of multimodality (Kress, Reference Kress2010) and multimodal literacies (Jewitt & Kress, Reference Jewitt and Kress2003), which can explain how particular semiotic resources are used to achieve rhetorical effects (Hafner, Reference Hafner2015; Yi et al., Reference Yi, Shin and Cimasko2020). As such, knowledge of the semiotic principles of design, multimodal pedagogy, semiotic awareness, mindsets, attitudes, and emotions (Tour, Reference Tour2015) can be helpful in unpacking specific dimensions of L2 teachers' expertise in fostering multimodal L2 competences through DMC.

Among the many options for undertaking research task 3, we recommend action research by L2 teacher educators, who can integrate DMC into their teacher education programmes and then examine how various dimensions of L2 teachers' expertise in fostering multimodal L2 competences can be expanded and developed. In the initial stage, large-scale surveys can be conducted to explore L2 teachers' perceptions of the value of DMC, understanding of multimodal L2 competence, and perceived ability to foster such competence. The survey results can better inform the design of teacher education programmes through DMC for L2 teachers. Various cycles of action research with planning, acting, observing, and reflecting stages (Burns, Reference Burns1999) can then be implemented to explore different dimensions of L2 teachers' development of expertise in using DMC. To uncover the nuanced process of how L2 teachers respond to, adapt, and develop expertise regarding DMC use, case studies can also be constructed to focus on one or multiple teachers. Data can be collected through classroom observations, multiple in-depth interviews, reflections on teaching, and teaching materials prepared by teachers. The findings can be used to illuminate how DMC can be better utilised to promote teacher learning and engender the desired multimodal L2 competence and DMC pedagogical content knowledge. Studies that have been conducted on teacher engagement with DMC (Jiang et al., Reference Jiang, Yu and Zhao2021; Lim et al., Reference Lim, Toh and Nguyen2022b) and on teacher strategies to cope with the challenges of using DMC (Jiang et al., Reference Jiang, Yu and Zhao2022b; Lim & Unsworth, Reference Lim and Unsworth2023) offer a good starting point for further research along this line. Li's (Reference Li2020) research on incorporating two DMC projects (i.e., a mid-term multimodal reflection assignment and a multimodal instructional material design task) in two online graduate courses to develop preservice language teachers' knowledge and skills of digital multimodal pedagogy presents a successful example of preparing pre-/in-service teachers to cross the gap between traditional literacy and multiliteracies. It thus offers a good model for future DMC researchers. Altogether the long-term goal is to provide valuable context-based insights into the essential expertise and competences in relation to DMC use to establish important learning outcomes of L2 teacher education programmes.

3.4 Research theme: Feedback practice on DMC

Feedback is an essential element of using DMC in L2 pedagogies but scant attention has been paid to the feedback practices associated with DMC. This contrasts markedly with the voluminous body of research on L2 writing feedback. Despite the increasing use of DMC in L2 classrooms and the fact that DMC expands the traditional written focus to include other modes of expression (e.g. visual, aural) in text construction, studies suggest that many L2 practitioners still focus primarily on language and replicate the feedback practices found in traditional, “monomodal” L2 writing assignments (Elola & Oskoz, Reference Elola and Oskoz2022; Jiang et al., Reference Jiang, Yu and Zhao2022b). In other words, there appears to be a predominant focus in feedback provision on the linguistic aspect of DMC, with non-linguistic modes sidelined or ignored. According to Oskoz and Elola (Reference Oskoz and Elola2020), the reasons for this solely linguistic focus for feedback on DMC include a lack of guidelines for L2 teachers to provide DMC feedback, a lack of curricular objectives that take DMC as learning outcomes, and a lack of familiarity with DMC.

Given that digital multimodal texts “are here to stay and will increasingly populate diverse academic contexts” (Elola & Oskoz, Reference Elola and Oskoz2022, p. 591), the role of L2 teachers as feedback providers should be “radically changing while, at the same time, becoming more critical” (Caws & Heift, Reference Caws, Heift, Farr and Murray2016, p. 133). Elola and Oskoz (Reference Elola and Oskoz2022) argued that to adapt feedback for DMC, a traditional focus on language should be maintained and expanded into a more “multifaceted, comprehensive, and modern feedback method” (p. 577). In search of such a method, Elola and Oskoz (Reference Elola and Oskoz2022) conceptualised a list of components and guiding questions to be considered for offering feedback on DMC by L2 instructors. Along this line of inquiry and to build a solid empirical basis for recommended DMC feedback practices, we suggest that there is a need for in-depth inquiries into the practices and perceptions of L2 teachers, particularly those with innovative experiences of incorporating different forms of DMC tasks in their teaching. Important questions that can be asked include the following: To what extent do teachers engage with multimodal communicative competence in their feedback on DMC? If they provide sensitive and effective feedback on students' use of multiple modes, what kinds of conceptual tools do they make use of? These questions lead us to research task 4, as follows.

Research task 4

Explore L2 teachers' feedback practices with respect to DMC by examining whether and how they engage with multimodal communicative competence in addition to providing linguistic feedback.

To examine whether and how L2 teachers have expanded their feedback practices on DMC beyond the traditional focus on global (i.e. content, structure, organisation) and local issues (e.g. grammar, lexis) of language use, researchers may first find it useful to conceptualise multimodal communicative competence by drawing on theories of multimodality grounded in social semiotics (Kress, Reference Kress2010; Oskoz & Elola, Reference Oskoz and Elola2020), systemic functional multimodal discourse analysis (Jewitt et al., Reference Jewitt, Bezemer and O'Halloran2016), and multiliteracies (New London Group, Reference New London Group1996). Social semiotic theories can help define multimodal communicative competence as the ability to arrange “available meaning-making resources into a multimodal whole, making authorial decisions appropriately for specific audiences and purposes” (Shin et al., Reference Shin, Cimasko and Yi2020, p. 2). In addition, scholars of multimodality have drawn attention to the way that different modes (linguistic, visual, gestural, etc.) provide different affordances for meaning-making and interact with each other in a range of ways. Multimodal communicative competence entails an awareness of such affordances and interactions and of how these vary within and across modes and media through processes of transformation (the actions that reorder meanings within one mode) and transduction (the reorganisation of meanings across modes). By targeting such a multimodal communicative competence, L2 teachers can give more specific feedback on students' communication within and across modes, attending not only to linguistic issues but also to the way that L2 learners shift meanings across modes when necessary.

Existing rubrics and frameworks to evaluate DMC can serve as starting points to explore L2 teachers' DMC feedback practices. For instance, Hafner and Ho's (Reference Hafner and Ho2020) process-oriented model can be used to examine whether and how L2 teachers offer feedback across the planning, editing, reflecting, and sharing stages of DMC. The rubric, devised by Jiang et al. (Reference Jiang, Yu and Lee2022a) for a genre-based model, offers additional conceptual tools to understand how feedback on global (e.g. audience, purpose, rhetorical structure) and local (e.g. quality of base unit, layout) issues of DMC can be combined. Elola and Oskoz's (Reference Elola and Oskoz2022) comprehensive digital story rubric is also helpful in conceptualising how feedback may have been offered with respect to traditional linguistic issues, audience expectations, choice of semiotic resources, and authorship, among other dimensions. As well as what teachers are providing feedback on, it is also important to consider when and how they are doing so to gain an understanding of the entire feedback process.

To achieve a comprehensive understanding of DMC feedback in practice, we foresee the value of large-scale cross-sectional studies of L2 teachers' feedback practices across a wider range of classroom contexts. To ascertain the focus of feedback, such studies can examine teachers' feedback (e.g. on planning documents, drafts, and final DMC products) with reference to the criteria described above. For determining teachers' rationale, students' expectations of teachers, and the impact of feedback on student practices, surveys and interviews will be needed. The principles of grounded theory (Creswell, Reference Creswell2007) can be applied to yield a comprehensive understanding of L2 teachers' concerns and practices regarding DMC feedback in context. To dig deeper and observe processes over a period of time, case studies of L2 teachers with unique feedback practices can be conducted, making use of classroom observations and interviews. Furthermore, a phenomenological approach can be adopted to explore L2 teachers' experiences and struggles, if any, in expanding the feedback focus from linguistic to multimodal communicative competence in DMC. Undertaking research task 4 can lead to the design of a more coherent model/framework for DMC feedback.

3.5 Research theme: DMC assessment

Another important issue that remains under-researched is the question of how to assess DMC. Compared with the widely accepted L2 writing assessment rubrics that are made available by major language testing organisations, such as TOEFL and IELTS, there have been only a few tentative models and guidelines for assessing DMC (e.g. Elola & Oskoz, Reference Elola and Oskoz2022; Hafner & Ho, Reference Hafner and Ho2020; Jiang et al., Reference Jiang, Yu and Lee2022a). Some of the existing DMC assessment models, such as the genre-based model (Jiang et al., Reference Jiang, Yu and Lee2022a), also tend to be limited to the products of one genre of DMC (i.e. video essays), with just a few categories (i.e. purpose, base unit, layout, navigation, rhetoric) included in the rubrics. It remains unclear whether these rubrics would work for other genres of DMC and whether additional categories would be needed. Given that DMC covers a variety of genres and purposes that differ significantly from those of traditional L2 writing tasks, there is a need for a suite of DMC assessment options that can be flexibly adjusted for different circumstances and contexts (Zhang et al., Reference Zhang, Akoto and Li2023). Furthermore, given that a DMC task normally involves multiple stages, it is clearly not sufficient to focus assessment on products alone. Research suggests that a process-oriented model of assessment would be beneficial, and this raises issues of when and what to assess (Hafner & Ho, Reference Hafner and Ho2020). It also remains unclear what assessment methods would promote self-assessment and peer assessment among student composers. Finally, the literature has tended to portray L2 teachers as mostly lacking preparedness and resistant to assessing DMC, with rather limited documentation of the assessment practices of those innovative teachers who are integrating various forms of DMC into their classrooms. Focusing on the experience of these teachers could provide a fruitful avenue for developing and evaluating innovative DMC assessment methods. To address these research gaps, we suggest research task 5, as follows.

Research task 5

Develop and evaluate innovative methods to assess DMC processes and products and underlying multimodal communicative competence.

To undertake research task 5, two levels of conceptualisation may be needed. First, DMC assessment researchers need to conceptualise the what in assessing DMC processes and products. As noted above, theories of multimodality (Jewitt et al., Reference Jewitt, Bezemer and O'Halloran2016; Kress, Reference Kress2010) and multiliteracies (New London Group, Reference New London Group1996) can serve to theorise multimodal communicative competence and the related notion of semiotic awareness (Towndrow et al., Reference Towndrow, Nelson and Yusuf2013). This assessment orientation would promote a strong version of DMC that considers both linguistic and non-linguistic modes of expression to be equally important to learning and communication in L2 classrooms (Lim & Polio, Reference Lim and Polio2020). Given the wide range of curricular objectives in L2 classrooms, a weak version of DMC can also be embraced in DMC assessment, with non-linguistic modes serving supporting roles for L2 development (Grapin, Reference Grapin2019). DMC assessment can be taken as a continuum with the strong and weak versions at each pole to allow for the flexibility to account for possible differences in L2 teachers' curricular objectives when integrating DMC. In addition, the construct of visual metadiscourse (such as information value, framing, connective elements, graphic elements, and fonts) (D'Angelo, Reference D'Angelo2016; Li et al., Reference Li, Gibbons and Pham2023) can be drawn upon to evaluate students’ multimodal communicative competence in drawing upon various metadiscourse resources to engage and inform the audiences of their multimodal compositions.

The second level of conceptualisation concerns the how of DMC assessment. To account for a range of potential purposes or principles of DMC assessment, researchers may find it useful to refer to the three major perspectives on classroom assessment practices: assessment of learning (AoL), assessment for learning (AfL), and assessment as learning (AaL) (Earl, Reference Earl2003). The purpose of AoL is to measure learning outcomes for summative and administrative reasons. AfL carries a strong formative orientation, and its priority is to promote student learning (Williams, Reference Williams2009). AaL extends the role of formative assessment for learning but highlights students as the critical connector between learning and assessment, encouraging students to exert self-regulation over their learning processes and stressing the importance of students becoming their own evaluators. As such, peer assessment and self-assessment of DMC among students can be taken as important aspects of AaL. These three approaches can be drawn upon to determine the purposes and principles of DMC assessment across contexts and to evaluate DMC assessment methods. Important questions that can be asked include the following: In what ways can AoL and AfL be used as strategies to assess DMC? What methods are needed to integrate AaL into DMC assessment?

In searching for innovative methods of DMC assessment, researchers can consider three specific strategies: the top-down approach, the bottom-up communal approach, and the situated approach. The top-down approach involves developing innovative assessment methods with reference to theories of multimodality. As one example, systemic functional multimodal discourse analysis (SF-MDA) (Jewitt et al., Reference Jewitt, Bezemer and O'Halloran2016) could be helpful in assessing how various modes are deployed to achieve ideational, textual, and interpersonal functions in DMC products. The bottom-up communal approach involves students in co-creating assessment methods and rubrics to evaluate DMC (Adsanatham, Reference Adsanatham2012). Advocates for this approach hold that assessing DMC is not only a concern for instructors but also a crucial skill for students to develop as successful writers and composers. Finally, a situated approach would focus on the practices of innovative L2 teachers in situated contexts and explore how they assess the processes and products of DMC. Such an approach to research design has been proven in earlier studies (e.g. Hafner & Ho, Reference Hafner and Ho2020; Jiang et al., Reference Jiang, Yu and Lee2022a) to help in offering contextualised evidence for the development of practice-based and teacher-friendly assessment models for DMC.

Armed with the above conceptualisations, DMC researchers can make use of collaborative action research and work with teachers to integrate the three major classroom assessment perspectives (i.e. AoL, AfL, AaL) into L2 instruction. The top-down approach can be combined with the bottom-up communal approach when developing innovative methods to integrate, for instance, AoL, AfL, or AaL, into the assessment of DMC processes and products. To develop a suite of assessment options that can work for L2 teachers across a range of contexts, large-scale surveys of L2 teachers' assessment practices can be conducted with the purpose of identifying best practices, problems, and needs regarding DMC assessment. As a follow-up, L2 teachers who are willing to develop and evaluate innovative methods of assessment for DMC can be identified and case studies in context can be conducted. Relevant data include observations of assessment processes, semi-structured interviews, and stimulated recall sessions in which teachers share how they have assessed particular DMC products (see, e.g., Hafner & Ho, Reference Hafner and Ho2020). Based on within- and cross-case analyses, best practices and practice-based principles and methods of assessing DMC processes and products can be synthesised for further large-scale intervention purposes.

3.6 Research theme: Collaborative DMC as a translanguaging space

With the notion of writing reconceptualised as multimodal composing, traditional collaborative writing research (Storch, Reference Storch2011) needs to be expanded to include collaborative DMC, elsewhere referred to as multimodal collaborative writing (Li & Zhang, Reference Li and Zhang2023). There has been growing attention to collaborative DMC in recent years, but the focus has been mostly on how students have distributed tasks during DMC, the benefits of DMC for L2 learning motivation, collaborative partnerships, and differences between collaborative and individual DMC (Hafner & Miller, Reference Hafner and Miller2019; Smith, Reference Smith2019). In other words, prior studies have mainly explored the benefits and patterns of collaborative DMC from the cognitive/SLA and sociocultural perspectives, paying scant attention to critical aspects of DMC. Alongside the continuation of such research, investigations are also needed into such critical issues as who collaborates with whom, what and how they learn from each other, and what impact collaboration has on learning opportunities and participation structures in L2 classrooms, particularly for those who are often labelled as deficient in traditional writing. Translanguaging, considered “an all-encompassing term for diverse multilingual and multimodal practices” (Li, Reference Li2018, p. 9), offers an important lens because prior studies (Ho, Reference Ho2022; Mendoza et al., Reference Mendoza, Hamman-Ortiz, Tian, Rajendram, Tai, Ho and Sah2023) show that translanguaging can create a space for students of diverse backgrounds to adapt to, value, respect, and learn from each other's plural, multilingual, and multimodal repertoires. However, constructing a translanguaging space in L2 classrooms can be challenging. To tackle this challenge, we recommend conducting more research into collaborative DMC as a translanguaging space, which is a social space where multilingual and multimodal repertories interact, collaborate, and co-create new meanings (Li, Reference Li2018). In making this suggestion, we do not deny the need for more research on collaborative DMC and on DMC as a translanguaging space as separate topics but highlight the importance of bridging the two as one prominent expansion of traditional research on collaborative writing in the current digital and multimodal environment.

Given that a translanguaging space is not “a space where different identities, values, and practices simply co-exist, but combine together to generate new identities, values, and practices” (Li, Reference Li2011, p. 1223), it is important to explore how collaborative DMC can contribute to new identity generation and development and what that might mean for L2 learners, particularly those who are marginalised owing to their socioeconomic status. This question is important because, in view of the increasing linguistic and cultural diversity among students, students' access to DMC can be uneven and their participation in collaborative DMC cannot be taken for granted. Previous research (e.g. Smith, Reference Smith2019) has shown that inequalities in digital competences and multimodal life experiences can constrain digitally and linguistically disadvantaged students to the extent that they contribute little more than an assistive role during collaborative DMC. Although studies (e.g. Cummins et al., Reference Cummins, Hu, Markus and Kristiina Montero2015) have revealed the potential of composing identity texts to validate the home literacies of young immigrants and empowering their classroom participation, little attention has been paid to how they collaborate with mainstream students during the process of multimodal composing and the pertinent implications for education justice (Cope & Kalantzis, Reference Cope, Kalantzis, Zapata, Kalantzis and Cope2023). In the translanguaging space constructed by collaborative DMC, it is therefore important to ask who collaborates with whom and why, who benefits the most, and how varied collaboration practices shape different learning opportunities (Smith et al., Reference Smith, Amgott and Malova2022). To empower disadvantaged and marginalised students to go beyond assistive roles and to understand how students use multimodal resources as they collaborate/interact with each other, more research on collaborative DMC as a translanguaging space is warranted. This leads us to research task 6, as follows.

Research task 6

Evaluate collaborative DMC as a translanguaging space by examining how students of different backgrounds learn from each other within such a space.

To carry out this research task, DMC researchers can conceptualise collaborative DMC through the lens of translanguaging and co-learning as developed by Li (Reference Li and May2014, Reference Li2018). Li (Reference Li and May2014) discussed the importance in multilingual L2 classrooms of co-learning, defined as “a process in which several agents simultaneously try to adapt to one another's behaviours so as to produce desirable global outcomes that would be shared by the contributing agents” (p. 169). Li (Reference Li2018) further highlighted that for co-learning to occur, it is important for teachers and students to “go between and beyond socially constructed language and educational systems, structures, and practices to engage diverse multiple meaning-making systems and subjectivities” (p. 24). Researchers can also consider theories of translanguaging and trans-semiotising (He & Lin, Reference He and Lin2023; Lin, Reference Lin2019) to analyse how multimodal resources contribute to the creation of texts and contexts for the co-learning of language and literacy in L2 classrooms.

Design-based research can be conducted to develop designs of collaborative DMC that effectively create a translanguaging space in which all students' linguistic and cultural repertoires are valued as meaningful resources for co-learning. University–school partnerships can also be set up for collaborative action research between DMC researchers and school instructors regarding the adoption and implementation of collaborative DMC as a translanguaging pedagogy for more equitable co-learning among diverse learners. Prasad and Lory's (Reference Prasad and Lory2020) research with elementary schools in the U.S. on collaborative multilingual bookmaking offers an excellent reference for future researchers seeking to enact translanguaging pedagogy through DMC across a wider range of contexts in support of diverse learners' equitable participation in collaborative DMC. To evaluate collaborative processes in DMC, researchers can draw on a case study approach to provide an in-depth analysis of students' collaboration and co-learning and the changes, if any, that occur during the DMC process. Existing approaches to collaborative writing offer useful frameworks that can be modified to examine the interactions of pairs and groups of students. For example, the conventional language-related episodes (LREs) framework (Swain & Lapkin, Reference Swain and Lapkin1995, Reference Swain and Lapkin1998) can be expanded to DMC-related episodes (Kim et al., Reference Kim, Kang, Nam and Skalicky2022) to understand how learners work together to negotiate multimodal meanings, all the while constructing a translanguaging space for collaboration among diverse learners. By identifying such DMC-related episodes, researchers can examine how students utilise diverse languages, modes, and other resources when collaborating with others. Where student participants include socio-economically disadvantaged groups, such as those with immigrant/refugee backgrounds, it would be particularly illuminating if their choices of composing tools, languages, modes, resources, and partners were recorded and if their collaboration patterns were traced across various DMC projects over time. Such information would help to illuminate the power of collaborative DMC as a translanguaging space to empower diverse groups of L2 learners.

3.7 Research theme: Deployment of DMC for critical digital literacies

For the final research theme, we turn to the teaching and learning of critical digital literacies (Darvin, Reference Darvin2017; Mirra & Garcia, Reference Mirra and Garcia2020; Weninger, Reference Weninger2023), which is another prominent yet under-represented area of socio-political research in digitally mediated language education that has evolved dynamically over the past decade. Critical digital literacies go beyond skills of digital technology use to include practices that enable learners to examine how power operates across various contexts of technology use and challenge those power mechanisms through agentive actions and online participation (Darvin & Hafner, Reference Darvin and Hafner2022). In the post–COVID-19 pandemic era, increased use of technology has become a new normal in language and literacy education. At the same time, there are ongoing crises of disinformation, online misconduct, and new invisible forms of social exclusion and marginalisation (Cope & Kalantzis, Reference Cope, Kalantzis, Zapata, Kalantzis and Cope2023; Dooly & Darvin, Reference Dooly and Darvin2022). Such crises lay bare problems in students' critical digital literacies with not only discerning the veracity of what they read and write online but also creating counter-narratives of marginalised communities who are often misrepresented in social media (Lee, Reference Lee2023; Mirra & Garcia, Reference Mirra and Garcia2020). To tackle these problems, scholars have highlighted critical digital literacies as an essential goal in L2 classrooms. Across the globe, critical digital literacies are high on the education and policy agenda and are often regarded as “an essential attribute of a discerning citizenry and a competitive workforce” (Weninger, Reference Weninger2023, p. 1).

Research has shown that DMC provides valuable opportunities for students to engage with social justice–oriented digital activism and civic participation, which are core to critical digital literacies development (e.g. Amgott, Reference Amgott2018; Jiang, Reference Jiang2021, Reference Jiang2023; Mirra & Garcia, Reference Mirra and Garcia2020). For instance, in his study of the composing of photo journals and video narratives by multilingual youths during a digital innovation project, Jiang (Reference Jiang2023) revealed three new forms of digital civic literacy practices in their DMC activities. These critically oriented literacy actions were disclosing the unequal access of members of ethnic minorities to recess space during the pandemic, devising creative solutions to increase the public acceptance of pandemic control–related apps, and popularising specialist knowledge for healthy quarantine. Despite the illuminating findings, this line of inquiry remains limited and needs to be further validated across a wider range of L2 classrooms. Although a growing number of DMC projects have been implemented in L2 contexts, prior studies have mostly treated DMC as a form of creative, or disciplinary, expression that allows students to exert agency for individual identity expression and display (Lim & Polio, Reference Lim and Polio2020); very few have engaged students in the critical exploration of social issues and critical digital literacies. To address this research gap, we propose research task 7, as follows.

Research task 7

Explore the influence of DMC on the learning and development of critical digital literacies through classroom-based interventions.

To undertake research task 7, DMC researchers can first conceptualise the notion of critical digital literacies as sets of power-laden social practices rather than merely decontextualised competences/skills (Darvin & Hafner, Reference Darvin and Hafner2022; Jones & Hafner, Reference Jones and Hafner2021; Weninger, Reference Weninger2023). Drawing on a social practice orientation, both digital literacy and critical literacy can be integrated into DMC to facilitate students' agentive actions for change and improvement through authoring digital multimodal texts that engage with issues of power and so serve to develop critical digital literacies (Pangrazio, Reference Pangrazio2016). Accordingly, the multifaceted construct of critical digital literacies can be operationalised as, for instance, “skills and practices that lead to the creation of digital texts through which students explore personal identity, interrogate the world, and enact civic participation for the betterment of communities and social equity” (Jiang & Gu, Reference Jiang and Gu2022, p. 1030). With this operationalised understanding, the role of DMC in promoting the learning and development of critical digital literacies can be specified through equity-oriented actions of creating/authoring digital multimodal texts. Furthermore, considering increased online surveillance and the power of online influencers, it is imperative to investigate how DMC can help empower learners to resist and, if possible, transform manipulative and exploitative practices in online discourses and spaces (Darvin, Reference Darvin2023).

Classroom-based interventions on using DMC for critical digital literacies can include longitudinal collaborations between researchers and L2 instructors for the planning and implementation of DMC projects, following the collaborative action research paradigm (Burns, Reference Burns1999). Useful data can be drawn from semi-structured interviews, teacher and student journals, classroom observations and recordings, and documents pertaining to literacy practices and actions around student-authored multimodal compositions. Telling cases (Yin, Reference Yin2009) can be constructed to analyse whether and how multilingual students develop critical digital literacies over time. Multimodal discourse analyses can be conducted upon student-authored multimodal compositions and the relevant literacy activities. Such analyses can contribute to an understanding of the working mechanisms of DMC in promoting critical digital literacies development and help reveal the inhibiting and facilitative factors for such development. The compelling cases of L2 students' enactment of civic participation and digital activism through DMC presented by Jiang (Reference Jiang2021, Reference Jiang2023) offer an initial example. Darvin and Zhang's (Reference Darvin and Zhang2023) discussion of how the production of a YouTube video explaining lexical gaps between Cantonese and English helped Cantonese first language (L1) learners assert their identities as legitimate multilingual speakers and resist colonial ways of knowing offers another point of reference for further research endeavours along this line of inquiry.

A scaled-up possibility for research task 7 may involve multi-site interventions and longitudinal tracing of critical digital literacies development across a series of DMC projects. Multi-site research can complement the understandings gleaned from single-site studies. A team of researchers and schoolteachers from a range of classroom contexts could be involved for a wider impact on the critical use of digital tools and multimodality for social justice–oriented literacy actions. A possible focus could be implementing the same set of DMC projects and materials in different schools. Such research could have far-reaching educational implications and can explain how the same DMC project is interpreted, appropriated, and adapted depending on the local situation (e.g. school policies, teacher identity, learner backgrounds). Multi-site studies can also reveal how student and teacher agency in using DMC for critical digital literacies is distributed and evolves across time and space. Collectively, these research works can help sustain and amplify DMC as an important site of the transformative use of literacy for social goals.

4. Conclusion

As a relatively young domain in L2 language and literacy research, DMC has attracted considerable interest over the past two decades. Given that digital and multimodal literacy practices remain an important element of the contemporary communicative landscape, DMC is likely to continue to attract attention from researchers and practitioners. In this article, we show how DMC can be conceptualised from multimodal, cognitive, sociocultural, and critical perspectives. After highlighting various, and sometimes disputed, perspectives on DMC use that have recently emerged in the field, we propose seven research tasks in relation to writing development, task design, teacher education, feedback, assessment, translanguaging, and critical digital literacies. The seven research tasks highlighted in this article are by no means exhaustive of all the possible directions for further DMC research in the field of L2 language and literacy education. However, these research tasks provide an outline of what we see as the critical and essential next steps for developing DMC research into a robust and theoretically grounded domain of inquiry in applied linguistics and L2 education. We hope the research agenda presented here will inspire others to embark on DMC projects, thus moving this promising area forward and helping to frame the terrain and trajectory of DMC research in increasingly diverse L2 classrooms.

Acknowledgement

This work was supported by Hong Kong Research Grants Council, ECS Scheme [RGC project code: 27613222].

Lianjiang (George) Jiang is Assistant Professor in the Faculty of Education, University of Hong Kong. He has published widely on digital multimodal composing, computer-supported second language writing, and second language teacher education.

Christoph A. Hafner is Professor (from July 2024) in the Department of English, City University of Hong Kong and President of the Asia-Pacific LSP & Professional Communication Association. He has published widely on English for specific purposes, digital literacies, and language learning and technology. His books include Understanding digital literacies: A practical introduction (2nd edition) (Routledge, 2021, co-authored with Rodney Jones); and English in the disciplines: A multidimensional model for ESP course design (Routledge, 2019, co-authored with Lindsay Miller).

References

Adsanatham, C. (2012). Integrating assessment and instruction: Using student-generated grading criteria to evaluate multimodal digital projects. Computers and Composition, 29(2), 152174. doi:10.1016/j.compcom.2012.04.002CrossRefGoogle Scholar
Amgott, N. (2018). Critical literacy in #DigitalActivism: Collaborative choice and action. The International Journal of Information and Learning Technology, 35(5), 329341. doi:10.1108/IJILT-05-2018-0060CrossRefGoogle Scholar
Belcher, D. D. (2017). On becoming facilitators of multimodal composing and digital design. Journal of Second Language Writing, 38, 8085. doi:10.1016/j.jswl.2017.10.004CrossRefGoogle Scholar
Burns, A. (1999). Collaborative action research for English language teachers. Cambridge University Press.Google Scholar
Caws, C., & Heift, T. (2016). Evaluation in CALL: Tools, interactions, outcomes. In Farr, F., & Murray, L. (Eds.), The Routledge handbook of language learning and technology (pp. 127140). Routledge.Google Scholar
Cho, H., & Kim, Y. (2021) Comparing the characteristics of EFL students’ multimodal composing and traditional monomodal writing: The case of a reading-to-write task. Language Teaching Research. Advance online publication. doi:10.1177/13621688211046740CrossRefGoogle Scholar
Cope, B., & Kalantzis, M. (2023). Towards education justice: The multiliteracies project revisited. In Zapata, G. C., Kalantzis, M., & Cope, B. (Eds.), Multiliteracies in international educational contexts: Towards education justice. Multiliteracies and second language education (pp. 942). Routledge.Google Scholar
Creswell, J. W. (2007). Qualitative inquiry & research design: Choosing among five approaches (2nd ed.). Sage Publications.Google Scholar
Cummins, J., Hu, S., Markus, P., & Kristiina Montero, M. (2015). Identity texts and academic achievement: Connecting the dots in multilingual school contexts. TESOL Quarterly, 49(3), 555581. doi:10.1002/tesq.241CrossRefGoogle Scholar
D'Angelo, L. (2016). Academic posters: A textual and visual metadiscourse analysis. Peter Lang.10.3726/978-3-0351-0934-4CrossRefGoogle Scholar
Darvin, R. (2017). Social class and the inequality of English speakers in a globalized world. Journal of English as a Lingua Franca, 6(2), 287311. doi:10.1515/jelf-2017-0014CrossRefGoogle Scholar
Darvin, R. (2023). Sociotechnical structures, materialist semiotics, and online language learning. Language Learning & Technology, 27(2), 2845. doi:10125/73502Google Scholar
Darvin, R., & Hafner, C. A. (2022). Digital literacies in TESOL: Mapping out the terrain. TESOL Quarterly, 56(3), 865882. doi:10.1002/tesq.3161CrossRefGoogle Scholar
Darvin, R., & Norton, B. (2015). Identity and a model of investment in applied linguistics. Annual Review of Applied Linguistics, 35, 3656. doi:10.1017/S0267190514000191CrossRefGoogle Scholar
Darvin, R., & Zhang, Y. (2023). Words that don't translate: Investing in decolonizing practices through translanguaging. Language Awareness, 32(4), 645661. doi:10.1080/09658416.2023.2238595CrossRefGoogle Scholar
DePalma, M.-J., & Ringer, J. M. (2011). Toward a theory of adaptive transfer: Expanding disciplinary discussions of “transfer” in second-language writing and composition studies. Journal of Second Language Writing, 20(2), 134147. doi:10.1016/j.jslw.2011.02.003CrossRefGoogle Scholar
Dooly, M., & Darvin, R. (2022). Intercultural communicative competence in the digital age: Critical digital literacy and inquiry-based pedagogy. Language and Intercultural Communication, 22(3), 354366. doi:10.1080/14708477.2022.2063304CrossRefGoogle Scholar
Dzekoe, R. (2017). Computer-based multimodal composing activities, self-revision, and L2 acquisition through writing. Language Learning & Technology, 21(2), 7395. doi:10125/44612Google Scholar
Earl, L. (2003). Assessment as learning: Using classroom assessment to maximize student learning. Corwin Press.Google Scholar
Early, M., Kendrick, M., & Potts, D. (2015). Multimodality: Out from the margins of English language teaching. TESOL Quarterly, 49(3), 447460. doi:10.1002/tesq.246CrossRefGoogle Scholar
Elola, I., & Oskoz, A. (2022). Reexamining feedback on L2 digital writing. Studies in Second Language Learning and Teaching, 12(4), 575595. doi:10.14746/ssllt.2022.12.4.3CrossRefGoogle Scholar
Flower, L., & Hayes, J. R. (1981). A cognitive process theory of writing. College Composition and Communication, 32(4), 365387. doi:10.2307/356600CrossRefGoogle Scholar
Gee, J. (2010). A situated-sociocultural approach to literacy and technology. In Baker, E. A. (Ed.), The new literacies: Multiple perspectives on research and practice (pp. 165193). The Guilford Press.Google Scholar
Gilje, Ø, Djonov, E., & Lim, V. (Forthcoming). Digital multimodal composing in the era of artificial intelligence. Computers and Composition, Special issue.Google Scholar
Grapin, S. (2019). Multimodality in the new content standards era: Implications for English learners. TESOL Quarterly, 53(1), 3055. doi:10.1002/tesq.443CrossRefGoogle Scholar
Hafner, C. (2014). Embedding digital literacies in English language teaching: Students’ digital video projects as multimodal ensembles. TESOL Quarterly, 48(4), 655685. doi:10.1002/tesq.138CrossRefGoogle Scholar
Hafner, C., & Miller, L. (2011). Fostering learner autonomy in English for science: A collaborative digital video project in a technological learning environment. Language Learning & Technology, 15(3), 6886. doi:10125/44263Google Scholar
Hafner, C., & Miller, L. (2019). English in the disciplines: A multidimensional model for ESP course design. Routledge.Google Scholar
Hafner, C. A. (2013). Digital composition in a second or foreign language. TESOL Quarterly, 47(4), 830834. doi:10.1002/tesq.135.CrossRefGoogle Scholar
Hafner, C. A. (2015). Remix culture and English language teaching: The expression of learner voice in digital multimodal compositions. TESOL Quarterly, 49(3), 486509. doi:10.1002/tesq.238CrossRefGoogle Scholar
Hafner, C. A., Chik, A., & Jones, R. H. (2013). Engaging with digital literacies in TESOL. TESOL Quarterly, 47(3), 812815. doi:10.1002/tesq.136CrossRefGoogle Scholar
Hafner, C. A., Harrison, S., Ho, J., & Kwan, B. (2023). Digital mediation in ESP genres. English for Specific Purposes, 71(3), 115122. doi:10.1016/j.esp.2023.03.002CrossRefGoogle Scholar
Hafner, C. A., & Ho, W. Y. J. (2020). Assessing digital multimodal composing in second language writing: Towards a process-based model. Journal of Second Language Writing, 47(2), 100710. doi:10.1016/j.jslw.2020.100710CrossRefGoogle Scholar
Hatano, G., & Inagaki, K. (1986). Two courses of expertise. In Azuma, H. & Hakuta, K. (Eds.), Child development in Japan (pp. 262272). W.H.Freeman.Google Scholar
He, P., & Lin, A. (2023). Dynamic flows of translanguaging/trans-semiotizing in CLIL eco-social systems. Language Awareness. doi:10.1080/09658416.2023.2234824CrossRefGoogle Scholar
Hirvela, A., & Belcher, D. (2022). Expertise in L2 writing instruction: The road less travelled. Journal of Second Language Writing, 58(8), 100936. doi:10.1016/j.jslw.2022.100936CrossRefGoogle Scholar
Ho, W. Y. J. (2022). The construction of translanguaging space through digital multimodal composing: A case study of students’ creation of instructional videos. Journal of English for Academic Purposes, 58, 101134. doi:10.1016/j.jeap.2022.101134CrossRefGoogle Scholar
Huang, S.-y. (2012). The integration of ‘critical’ and ‘literacy’ education in the EFL curriculum: Expanding the possibilities of critical writing practices. Language, Culture and Curriculum, 25(3), 283298. doi:10.1080/07908318.2012.723715CrossRefGoogle Scholar
Huang, S.-y. (2019). EFL learners’ critical multimodal reflections on the politics of English. TESOL Journal, 10(3), e00435. doi:10.1002/tesj.435CrossRefGoogle Scholar
Hull, A., & Nelson, M. E. (2005). Locating the semiotic power of multimodality. Written Communication, 22(2), 224261. doi:10.1177/0741088304274170CrossRefGoogle Scholar
Jewitt, C., Bezemer, J., & O'Halloran, K. (2016). Introducing multimodality. Routledge.10.4324/9781315638027CrossRefGoogle Scholar
Jewitt, C., & Kress, G. (2003). Multimodal literacy. Peter Lang.Google Scholar
Jiang, L. (2021). Facilitating EFL students’ civic participation through digital multimodal composing. Language, Culture and Curriculum, 35(1), 102117. doi:10.1080/07908318.2021.1942032CrossRefGoogle Scholar
Jiang, L. (2023). Multilingual youths’ digital activism through multimodal composing in the post-pandemic era. Journal of Multilingual and Multicultural Development. Advance online publication. doi:10.1080/01434632.2023.2181353Google Scholar
Jiang, L., & Gu, M. M. (2022). Toward a professional development model for critical digital literacies in TESOL. TESOL Quarterly, 56(3), 10291040. doi:10.1002/tesq.3138CrossRefGoogle Scholar
Jiang, L., Li, Z., & Leung, J. S.C. (2024). Digital multimodal composing as translanguaging assessment in CLIL classrooms. Learning and Instruction, 92, 101900. doi:10.1016/j.learninstruc.2024.101900CrossRefGoogle Scholar
Jiang, L., & Luk, J. (2016). Multimodal composing as a learning activity in English classrooms: Inquiring into the sources of its motivational capacity. System, 59, 111. doi:10.1016/j.system.2016.04.001CrossRefGoogle Scholar
Jiang, L., & Ren, W. (2021). Digital multimodal composing in L2 learning: Ideologies and impact. Journal of Language, Identity & Education, 20(3), 167182. doi:10.1080/15348458.2020.1753192CrossRefGoogle Scholar
Jiang, L., Yang, M., & Yu, S. (2020). Chinese ethnic minority students’ investment in English learning empowered by digital multimodal composing. TESOL Quarterly, 54(4), 954979. doi:10.1002/tesq.566CrossRefGoogle Scholar
Jiang, L., Yu, S., & Lee, I. (2022a). Developing a genre-based model for assessing digital multimodal composing in second language writing: Integrating theory with practice. Journal of Second Language Writing, 57, 100869. doi:10.1016/j.jslw.2022.100869CrossRefGoogle Scholar
Jiang, L., Yu, S., & Zhao, Y. (2021). Teacher engagement with digital multimodal composing in a Chinese tertiary EFL curriculum. Language Teaching Research, 25(4), 613632. doi:10.1177/1362168819864975CrossRefGoogle Scholar
Jiang, L., Yu, S., & Zhao, Y. (2022b). Incorporating digital multimodal composing through collaborative action research: Challenges and coping strategies. Technology, Pedagogy and Education, 31(1), 4561. doi:10.1080/1475939X.2021.1978534CrossRefGoogle Scholar
Jiang, L. J. (2017). The affordances of digital multimodal composing for EFL learning. ELT Journal, 71(4), 413422. doi:10.1093/elt/ccw098CrossRefGoogle Scholar
Jones, R., & Hafner, C. A. (2021). Understanding digital literacies: A practical introduction. Routledge.10.4324/9781003177647CrossRefGoogle Scholar
Kang, J. (2022). Transfer of knowledge across genres and media: Investigating L2 learners’ multiple composing practices. Journal of English for Academic Purposes, 56, 101096. doi:10.1016/j.jeap.2022.101096CrossRefGoogle Scholar
Kellner, D., & Share, J. (2005). Toward critical media literacy: Core concepts, debates, organizations, and policy. Discourse: Studies in the Cultural Politics of Education, 26(3), 369386. doi:10.1080/01596300500200169Google Scholar
Kendrick, M., Early, M., Michalovich, A., & Mangat, M. (2022). Digital storytelling with youth from refugee backgrounds: Possibilities for language and digital literacy learning. TESOL Quarterly, 56(3), 961984. doi:10.1002/tesq.3146CrossRefGoogle Scholar
Kim, Y., & Belcher, D. (2020). Multimodal composing and traditional essays: Linguistic performance and learner perceptions. RELC Journal, 51(1), 86100. doi:10.1177/0033688220906943CrossRefGoogle Scholar
Kim, Y., Belcher, D., & Peyton, C. (2023). Comparing monomodal traditional writing and digital multimodal composing in EAP classrooms: Linguistic performance and writing development. Journal of English for Academic Purposes, 64, 101247. doi:10.1016/j.jeap.2023.101247CrossRefGoogle Scholar
Kim, Y., Kang, S., Nam, Y., & Skalicky, S. (2022). Peer interaction, writing proficiency, and the quality of collaborative digital multimodal composing task: Comparing guided and unguided planning. System, 106, 102722. doi:10.1016/j.system.2022.102722.CrossRefGoogle Scholar
Knobel, M., & Lankshear, C. (2007). Remix: The art and craft of endless hybridization. Journal of Adolescent & Adult Literacy, 52(1), 2233. doi:10.1598/JAAL.52.1.3CrossRefGoogle Scholar
Krashen, S. D. (1981). Second language acquisition and second language learning. Pergamon.Google Scholar
Kress, G. (2010). Multimodality: A social semiotic approach to contemporary communication. Routledge.Google Scholar
Lankshear, C., & Knobel, M. (2006). New literacies: Everyday practices and classroom learning (2nd ed.). Open University Press.Google Scholar
Lantolf, J. P., & Thorne, S. L. (2006). Sociocultural theory and the genesis of second language development. Oxford University Press.Google Scholar
Lee, E. (2023). Writing toward a decolonial option: A bilingual student's multimodal composing as a site of translingual activism and justice. Written Communication, 40(1), 5989. doi:10.1177/07410883221134640CrossRefGoogle Scholar
Lee, I., & Yuan, R. (2021). Understanding L2 writing teacher expertise. Journal of Second Language Writing, 52, 100755. doi:10.1016/j.jslw.2020.100755CrossRefGoogle Scholar
Li, M. (2020). Multimodal pedagogy in TESOL teacher education: Students’ perspectives. System, 94, 102337. doi:10.1016/j.system.2020.102337CrossRefGoogle Scholar
Li, M., & Akoto, M. (2021). Review of recent research on L2 digital multimodal composing. International Journal of Computer-Assisted Language Learning and Teaching (IJCALLT), 11(3), 116. doi:10.4018/IJCALLT.2021070101CrossRefGoogle Scholar
Li, M., Gibbons, J., & Pham, Q. (2023). Re-exploring writer-reader interaction: Analyzing metadiscourse in EAP students’ infographics. Journal of English for Academic Purposes, 66, 101303. doi:10.1016/j.jeap.2023.101303CrossRefGoogle Scholar
Li, M., & Storch, N. (2017). Second language writing in the age of CMC: Affordances, multimodality, and collaboration. Journal of Second Language Writing, 36, 15. doi:10.1016/j.jslw.2017.05.012CrossRefGoogle Scholar
Li, M., & Zhang, M. (2023). Collaborative writing in L2 classrooms: A research agenda. Language Teaching, 56(1), 94112. doi:10.1017/S0261444821000318CrossRefGoogle Scholar
Li, W. (2011). Multilinguality, multimodality, and multicompetence: Code- and modeswitching by minority ethnic children in complementary schools. Modern Language Journal, 95(3), 370384. doi:10.1111/j.1540-4781.2011.01209.xGoogle Scholar
Li, W. (2014). Who's teaching whom? Co-learning in multilingual classrooms. In May, S. (Ed.), The multilingual turn: Implications for SLA, TESOL, and bilingual education (pp. 167190). Routledge.Google Scholar
Li, W. (2018). Translanguaging as a practical theory of language. Applied Linguistics, 39(1), 930. doi:10.1093/applin/amx039Google Scholar
Liang, W. J., & Lim, F. V. (2021) A pedagogical framework for digital multimodal composing in the English language classroom. Innovation in Language Learning and Teaching, 15(4), 306320. doi:10.1080/17501229.2020.1800709CrossRefGoogle Scholar
Lim, F. V., Chia, A., & Nguyen, T. T. H. (2022a). “From the beginning, I think it was a stretch” – Teachers’ perceptions and practices in teaching multiliteracies. English Teaching: Practice & Critique, 21(4), 379396. doi:10.1108/ETPC-04-2021-0025Google Scholar
Lim, F. V., & Toh, W. (2020). Children's digital multimodal composing: Implications for learning and teaching. Learning, Media and Technology, 45(4), 422432. doi:10.1080/17439884.2020.1823410CrossRefGoogle Scholar
Lim, F. V., Toh, W., & Nguyen, T. T. H. (2022b). Multimodality in the English language classroom: A systematic review of literature. Linguistics and Education, 69, 101048. doi:10.1016/j.linged.2022.101048CrossRefGoogle Scholar
Lim, F. V., & Unsworth, L. (2023). Multimodal composing in the English classroom: Recontextualising the curriculum to learning. English in Education, 57(2), 102119. doi:10.1080/04250494.2023.2187696CrossRefGoogle Scholar
Lim, J., & Kessler, M. (2022). Directions for future research on SLA, L2 writing, and multimodality. In Manchón, R., & Polio, C. (Eds.), The Routledge handbook of second language acquisition and writing (pp. 300314). Routledge.Google Scholar
Lim, J., & Kessler, M. (2023). Multimodal composing and second language acquisition. Language Teaching. Advance online publication. doi:10.1017/S0261444823000125Google Scholar
Lim, J., & Polio, C. (2020). Multimodal assignments in higher education: Implications for multimodal writing tasks for L2 writers. Journal of Second Language Writing, 47, 100713. doi:10.1016/j.jslw.2020.100713CrossRefGoogle Scholar
Lin, A. (2019). Theories of trans/languaging and trans-semiotizing: Implications for content-based education classrooms. International Journal of Bilingual Education and Bilingualism, 22(1), 516. doi:10.1080/13670050.2018.1515175CrossRefGoogle Scholar
Manchón, R. M. (2017). The potential impact of multimodal composition on language learning. Journal of Second Language Writing, 38, 9495. doi:10.1016/j.jslw.2017.10.008CrossRefGoogle Scholar
Mendoza, A., Hamman-Ortiz, L., Tian, Z., Rajendram, S., Tai, K. W. H., Ho, W. Y. J., & Sah, P. K. (2023). Sustaining critical approaches to translanguaging in education: A contextual framework. TESOL Quarterly. Advance online publication. doi:10.1002/tesq.3240CrossRefGoogle Scholar
Mills, K. A., & Exley, B. (2014). Time, space and text in the elementary school digital writing classroom. Written Communication, 31(4), 434469. doi:10.1177/0741088314542757CrossRefGoogle Scholar
Mirra, N., & Garcia, A. (2020). “I hesitate but I do have hope”: Youth speculative civic literacies for troubled times. Harvard Educational Review, 90(2), 295321. doi:10.17763/1943-5045-90.2.295CrossRefGoogle Scholar
Nelson, M. E. (2006). Mode, meaning, and synaesthesia in multimedia L2 writing. Language Learning & Technology, 10(2), 5676. doi:10125/44061Google Scholar
New London Group, . (1996). A pedagogy of multiliteracies: Designing social futures. Harvard Educational Review, 66(1), 6092. doi:10.17763/haer.66.1.17370n67v22j160uCrossRefGoogle Scholar
Norton, B. (2013). Identity and language learning: Extending the conversation (2nd ed.). Multilingual Matters.10.21832/9781783090563CrossRefGoogle Scholar
Oskoz, A., & Elola, I. (2020). Digital literacies for writing in the 21st century FL classroom. Equinox.Google Scholar
Pacheco, M. B., Smith, B. E., Deig, A., & Amgott, N. A. (2021). Scaffolding multimodal composition with emergent bilingual students. Journal of Literacy Research, 53(2), 149173. doi:10.1177/1086296X211010888CrossRefGoogle Scholar
Pangrazio, L. (2016). Reconceptualising critical digital literacy. Discourse: Studies in the Cultural Politics of Education, 37(2), 163174. doi: 10.1080/01596306.2014.942836Google Scholar
Pham, Q. N., & Li, M. (2022). Digital multimodal composing using visme: EFL students’ perspectives. The Asia-Pacific Education Researcher, 32, 695706. doi:10.1007/s40299-022-00687-wCrossRefGoogle Scholar
Prasad, G., & Lory, M.-P. (2020). Linguistic and cultural collaboration in schools: Reconciling majority and minoritized language users. TESOL Quarterly, 54(4), 797822. doi:10.1002/tesq.560CrossRefGoogle Scholar
Prior, P. A., & Hengst, J. A. (2010). Introduction: Exploring semiotic remediation. In Prior, P. A. & Hengst, J. A. (Eds.), Exploring semiotic remediation as discourse practice (pp. 123). Palgrave Macmillan. doi:10.1057/9780230250628_1CrossRefGoogle Scholar
Qu, W. (2017). For L2 writers, it is always the problem of the language. Journal of Second Language Writing, 38, 9293. doi:10.1016/j.jslw.2017.10.007CrossRefGoogle Scholar
Schmidt, R. (1990). The role of consciousness in second language learning. Applied Linguistics, 11(2), 1746. doi:10.1093/applin/11.2.129CrossRefGoogle Scholar
Shin, D., & Cimasko, T. (2008). Multimodal composition in a college ESL class: New tools, traditional norms. Computers and Composition, 25(4), 376395. doi:10.1016/j.compcom.2008.07.001CrossRefGoogle Scholar
Shin, D., Cimasko, T., & Yi, Y. (2020). Development of metalanguage for multimodal composing: A case study of an L2 writer’s design of multimedia texts. Journal of Second Language Writing, 47, 100714. doi:10.1016/j.jslw.2020.100714CrossRefGoogle Scholar
Smith, B. E. (2019). Collaborative multimodal composing: Tracing the unique partnerships of three pairs of adolescents composing across three digital projects. Literacy, 53(1), 1421. doi:10.1111/lit.12153CrossRefGoogle Scholar
Smith, B. E., Amgott, N., & Malova, I. (2022). “It made me think in a different way”: Bilingual students’ perspectives on multimodal composing in the English language arts classroom. TESOL Quarterly, 56(2), 525551. doi:10.1002/tesq.3064CrossRefGoogle Scholar
Smith, B. E., Pacheco, M. B., & Khorosheva, M. (2020). Emergent bilingual students and digital multimodal composition: A systematic review of research in secondary classrooms. Reading Research Quarterly, 56(1), 3352. doi:10.1002/rrq.298CrossRefGoogle Scholar
Storch, N. (2011). Collaborative writing in L2 contexts: Processes, outcomes, and future directions. Annual Review of Applied Linguistics, 31, 275288. doi:10.1017/S0267190511000079CrossRefGoogle Scholar
Street, B. (1984). Literacy in theory and practice. Cambridge University Press.Google Scholar
Swain, M., & Lapkin, S. (1995). Problems in output and the cognitive processes they generate: A step towards second language learning. Applied Linguistics, 16(3), 371391. doi:10.1093/applin/16.3.371CrossRefGoogle Scholar
Swain, M., & Lapkin, S. (1998). Interaction and second language learning: Two adolescent French immersion students working together. Modern Language Journal, 82(3), 320337. doi:10.1111/j.1540-4781.1998.tb01209.xCrossRefGoogle Scholar
Swales, J. M., & Feak, C. B. (2023). Task evolution in English for academic purposes writing materials: The case of “information transfer” to “critical commentary”. Journal of Second Language Writing, 61, 101017. doi:10.1016/j.jslw.2023.101017CrossRefGoogle Scholar
Tan, J. P. L., & McWilliam, E. (2009). From literacy to multiliteracies: Diverse learners and pedagogical practice. Pedagogies: An International Journal, 4(3), 213225. doi:10.1080/15544800903076119CrossRefGoogle Scholar
Tan, X. (2023). Stories behind the scenes: L2 students’ cognitive processes of multimodal composing and traditional writing. Journal of Second Language Writing, 59, 100958. doi:10.1016/j.jslw.2022.100958CrossRefGoogle Scholar
Toohey, K., & Dagenais, D. (2015). Videomaking as sociomaterial assemblage. Language and Education, 29(4), 302316. doi:10.1080/09500782.2015.1006643CrossRefGoogle Scholar
Tour, E. (2015). Digital mindsets: Teachers’ technology use in personal life and teaching. Language Learning & Technology, 19(3), 124139. doi:10125/44437Google Scholar
Towndrow, P. A., Nelson, M. E., & Yusuf, W. F. B. M. (2013). Squaring literacy assessment with multimodal design: An analytic case for semiotic awareness. Journal of Literacy Research, 45(4), 327355. doi:10.1177/1086296X13504155CrossRefGoogle Scholar
Unsworth, L. (2006). Towards a metalanguage for multiliteracies education: Describing the meaning-making resources of language-image interaction. English Teaching-Practice and Critique, 5(1), 5576.Google Scholar
Vandommele, G., Van den Branden, K., Van Gorp, K., & De Maeyer, S. (2017). In-school and out-of-school multimodal writing as an L2 writing resource for beginner learners of Dutch. Journal of Second Language Writing, 36, 2336. https://doi.org/10.1016/j.jslw.2017.05.010CrossRefGoogle Scholar
Vygotsky, L. S. (1978). Mind in society: The development of higher psychological processes. Harvard University Press.Google Scholar
Weninger, C. (2023). Digital literacy as ideological practice. ELT Journal, 77(2), 197206. doi:10.1093/elt/ccad001CrossRefGoogle Scholar
Williams, D. (2009). Assessment for learning: Why, what and how? Institute of Education, University of London.Google Scholar
Xu, F., & Matsuda, P. K. (2017). Disciplinary dialogues section: Perspectives on multimodal composition. Journal of Second Language Writing, 38, 79. doi:10.1016/j.jslw.2017.10.006CrossRefGoogle Scholar
Xu, Y. (2021). Investigating the effects of digital multimodal composing on Chinese EFL learners’ writing performance: A quasi-experimental study. Computer Assisted Language Learning, 36(4), 785805. doi:10.1080/09588221.2021.1945635CrossRefGoogle Scholar
Yi, Y. (2017). Establishing multimodal literacy research in the field of L2 writing: Let's move the field forward. Journal of Second Language Writing, 38, 9091. doi:10.1016/j.jslw.2017.10.010CrossRefGoogle Scholar
Yi, Y., & Angay-Crowder, T. (2016). Multimodal pedagogies for teacher education in TESOL. TESOL Quarterly, 50(4), 988998. doi:10.1002/tesq.326CrossRefGoogle Scholar
Yi, Y., Shin, B. S., & Cimasko, T. (2020). Special issue: Multimodal composing in multilingual learning and teaching contexts. Journal of Second Language Writing, 47, 100717. doi:10.1016/j.jslw.2020.100717CrossRefGoogle Scholar
Yin, R. K. (2009). Case study research: Design and methods (4th ed.). Sage.Google Scholar
Zhang, M., Akoto, M., & Li, M. (2023). Digital multimodal composing in post-secondary L2 settings: A review of the empirical landscape. Computer Assisted Language Learning, 36(4), 694721. doi:10.1080/09588221.2021.1942068CrossRefGoogle Scholar