Hostname: page-component-78c5997874-m6dg7 Total loading time: 0 Render date: 2024-11-06T00:24:29.160Z Has data issue: false hasContentIssue false

Research methods for IDs and TBLT: A substantive and methodological review

Published online by Cambridge University Press:  15 March 2024

Lara Bryfonski*
Affiliation:
Georgetown University
Yunjung (Yunie) Ku
Affiliation:
Georgetown University
Alison Mackey
Affiliation:
Georgetown University
*
Corresponding author: Lara Bryfonski; Email: [email protected]
Rights & Permissions [Opens in a new window]

Abstract

As part of ongoing efforts to characterize the extent to which tasks and interaction-driven language learning are influenced by individual differences (IDs), task-based researchers have thus far examined variables like learners’ levels of L2 anxiety, motivation, cognitive creativity, working memory capacity, and aptitude. Building on a tradition of prior syntheses in task-based language teaching (TBLT, e.g., Plonsky & Kim, 2016), we carried out a methodological review of the practices used by researchers who have examined learners’ IDs in task-based language learning. We searched journal articles published between 2000 and 2023 and identified 135 unique samples for analysis. Each empirical study was coded for relevant contextual and demographic variables as well as for methodological features related to the investigation of individual differences. We observed that of 30 individual differences investigated in TBLT research over the last two decades, the top five most common were motivation, working memory, L2 proficiency, anxiety, and aptitude. Interesting patterns related to operationalizations, instruments, coding, analyses, and reporting practices. In this paper, we report these results and summarize the most and least common methodological practices, also pointing out gaps and possibilities for future directions. We conclude with recommendations for researchers interested in embarking on empirical investigations of individual differences and TBLT based on best practices.

Type
Research Article
Creative Commons
Creative Common License - CCCreative Common License - BY
This is an Open Access article, distributed under the terms of the Creative Commons Attribution licence (http://creativecommons.org/licenses/by/4.0), which permits unrestricted re-use, distribution and reproduction, provided the original article is properly cited.
Copyright
© The Author(s), 2024. Published by Cambridge University Press

Introduction

Researchers in the field of second language acquisition (SLA) have long been interested in learners’ individual differences (IDs), and the complex role they play in the second language (L2) learning process. For example, Larsen-Freeman and Long’s (Reference Larsen-Freeman and Long1991) classic text notes that “it is undeniable that important individual differences between language learners exist” (p. 153). A substantial body of L2 research on IDs has amassed, including motivation (e.g., Dörnyei & Kormos, Reference Dörnyei and Kormos2000), L2 anxiety (e.g., Teimouri, Goetze, & Plonsky, Reference Teimouri, Goetze and Plonsky2019), working memory capacity (e.g., Mackey, Adams, Stafford, & Winke, Reference Mackey, Adams, Stafford and Winke2010) and aptitude (e.g. Li, Reference Li2016; Sparks, Reference Sparks2012), often focusing on how these factors might moderate L2 development (DeKeyser, Reference DeKeyser2012; Robinson, Reference Robinson2005). This research includes theoretical, empirical, and meta-analytic studies.

Moving from general SLA work to studies of task-based language teaching (TBLT), an important line of research has focused on how individual differences might help to explain the extent to which learners can benefit from tasks (Awwad & Tavakoli, Reference Awwad and Tavakoli2019; Butler & Zeng, Reference Butler and Zeng2014; Kim et al., Reference Kim, Payant and Pearson2015; Sato & McDonough, Reference Sato and McDonough2020). Researchers have used a variety of methods and techniques to understand the impact of IDs on task-based interaction and learning, ranging from assessments and interviews to questionnaires and stimulated recalls, amongst others. The current paper presents a methodological review of practices used by researchers studying learner IDs in task-based language learning, with a detailed analysis of what emerged as the top five most frequently investigated IDs in TBLT research to date. We pay particular attention to the instruments, coding, analyses, and reporting practices utilized by researchers in this area, with goals of surveying the domains that have been of greatest interest to researchers, providing empirically-grounded methodological guidance, and highlighting potential avenues for further investigation.

Literature review

The goal of this paper is to examine how IDs are studied within task-based research. Most task-based researchers agree that a task can be broadly defined as an activity with a communicative purpose and a non-linguistic outcome (Ellis, Reference Ellis2018; Long, Reference Long2015; Mackey, Reference Mackey2020a). Task-based approaches in the literature vary, including models that follow a pre-task, post-task sequence (Ellis, Reference Ellis2003), those that are based on a task cycle with an element of focus on form (Willis, Reference Willis1996), and those that follow a sequence of pedagogic tasks approximating real-life target tasks (Long, Reference Long2015). Regardless of the approach, task-based researchers and practitioners are interested in how tasks facilitate the kinds of negotiation for meaning and interaction known to support successful SLA (Gass & Mackey, Reference Gass and Mackey2006; Mackey, Reference Mackey2020a). Researchers are often also interested in how manipulating specific task-related variables impacts linguistic and non-linguistic outcomes. These variables include increasing the cognitive complexity of the task (e.g., Robinson, Reference Robinson2011a), repeating the task (e.g., Bygate, Reference Bygate2018, Mackey, Reference Mackey1999), or offering planning time (e.g., Bygate & Samuda, Reference Bygate, Samuda and Ellis2005). In addition to pedagogic uses, tasks are also used as tools for eliciting oral or written L2 production in empirical SLA investigations (e.g., Housen et al., Reference Housen, Kuiken and Vedder2012; Yousefi, Reference Yousefi2016).

Research on individual differences

A subset of the research into tasks and second language learning investigates how individual differences among learners might mediate task outcomes and processes. Following Li et al. (Reference Li, Hiver and Papi2022) and Ortega (Reference Ortega2009), individual differences can be broadly categorized into four groups: cognitive (e.g., aptitude), conative (e.g., motivation), affective (e.g., anxiety), and demographic (e.g., age) differences. IDs are generally conceptualized as learner-internal factors, either fixed or changeable, that can affect the process and/or products of second language acquisition and may be mediated by the environment. IDs have been investigated within learners as well as for other interlocutors like teachers (e.g., Bryfonski, Reference Bryfonski2021) and non-teachers (Gurzynski-Weiss & Plonsky, Reference Gurzynski-Weiss, Plonsky and Gurzynski-Weiss2017). However, a few ID variables have garnered sustained attention by second language acquisition researchers for decades: aptitude, working memory, cognitive creativity, motivation, and anxiety.

Aptitude has generally been used to mean cognitive abilities that are posited to be predictive of speed, efficiency, and success in terms of language learning. Carroll’s classic (Reference Carroll and Diller1981) definition claims “an individual’s initial state of readiness and capacity for learning a foreign language, and probable facility in doing so given the presence of motivation and opportunity” (p. 86). Aptitude has been a topic of research interest since at least the 1950s (Gass & Mackey, Reference Gass and Mackey2012; Skehan, Reference Skehan2015). Aptitude has been measured in a number of ways, and, as our own analysis suggests, researchers tend to believe that there is not one single aptitude factor. For example, some scholars view working memory as a subset of aptitude (e.g., Wen, Reference Wen2016). Studies that have discussed or measured aptitude and tasks in some way include Yilmaz and Granena (Reference Yilmaz and Granena2015), with overviews in Dörnyei and Skehan, (Reference Dörnyei, Skehan, Doughty and Long2003), Skehan (Reference Skehan2015), and Wen et al. (Reference Wen, Biedroń and Skehan2017) raising interesting ongoing questions that should be addressed by more research in this area. Aptitude has been the topic of a great deal of interest in the general SLA literature, with theoretical, empirical, and synthetic papers, including a comprehensive and critical synthesis of the methods utilized in studies of aptitude in second language (L2) learning by Li and Zhao (Reference Li and Zhao2021).

Working memory capacity is another cognitive area where learners differ. Working memory involves not only storage capacity or what we usually think of when we hear the term “memory” but also processing, which is what is meant by the word “working,” in other words, doing something. In an early study in this area, Mackey et al. (Reference Mackey, Adams, Stafford and Winke2010) looked at the relationship between working memory and output, concluding that individuals with greater working memory capacity produced more modified output in L2 Spanish interaction. Other studies carried out by Kim et al. (Reference Kim, Payant and Pearson2015), Révész (Reference Révész2012), Sagarra (Reference Sagarra and Han2007), Trofimovich et al. (Reference Trofimovich, Ammar, Gatbonton and Mackey2007), and Yilmaz and Sağdıç (Reference Yilmaz and Sağdıç2019) all point to the fact that working memory capacity is associated with learners’ development of the target language and mediated by other learner-external factors such as task complexity and feedback type. In terms of how we assess working memory, most tests originate from research in cognitive psychology, with three that are commonly used in SLA being operation span, counting span, and sentence span (for more information, see Gass et al., Reference Gass, Behney and Plonsky2020).

Differences in learners’ levels of cognitive creativity typically involve looking at constructs like originality, elaboration, flexibility, and fluency. Early studies involving cognitive creativity and task performance were carried out by Albert and Kormos (Reference Albert and Kormos2004, Reference Albert and Kormos2011) who demonstrated a relationship between creativity and performance on an L2 narrative task. McDonough et al. (Reference McDonough, Crawford and Mackey2015) also showed that creativity was associated with the use of questions and coordination in a group problem solving task, and Suzuki et al. (Reference Suzuki, Yasuda, Hanzawa and Kormos2022) demonstrated a close relationship between creativity and the discourse of speaking tasks. Pipes (Reference Pipes2023) provides a helpful overview of research and practice in this area.

A commonly studied conative variable that differs by individual is motivation, which is often seen as how much active, personal involvement in L2 learning there is, as well as how long learners persevere and maintain L2 skills (e.g., Dörnyei, Reference Dörnyei, Dörnyei and Ushioda2009b). One of the earliest studied individual differences in L2 research (e.g., Larsen-Freeman & Long, Reference Larsen-Freeman and Long1991), motivation has grown dramatically recently with ~277,000 citations in Google Scholar for “motivation in second language acquisition” in the last 10 years, compared with ~74,000 in the 10 years prior. Dörnyei’s (Reference Dörnyei2005) highly influential theory of the L2 motivational self-system upended traditional frameworks of motivation and inspired many later studies to investigate motivational thinking as part of learner psychology, concepts of self, and identity. Meta-analytic research (Al-Hoorie, Reference Al-Hoorie2018; Yousefi & Mahmoodi, Reference Yousefi and Mahmoodi2022) investigating the L2 motivational self-system has tied motivation to learners’ subjective intended effort, underscoring the importance of motivation as an ID in L2 learning. More recently, Leeming and Harris (Reference Leeming and Harris2022) have called for using Self-Determination Theory to understand the motivational benefits of tasks within a TBLT framework.

Finally, anxiety, one of the most extensively researched affective factors, has also been shown to vary amongst individual second language learners. What has often been termed “foreign language anxiety” concerns three related performance anxieties: communication apprehension, test anxiety, and fear of negative evaluation (Horwitz et al., Reference Horwitz, Horwitz and Cope1986). Anxiety can be dynamic, fluctuating throughout tasks that might be associated with changes in linguistic performance (see, for example, Bashori et al., Reference Bashori, Van Hout, Strik and Cucchiarini2022; Papi & Khajavy, Reference Papi and Khajavy2023). Early research in L2 learning posited optimal levels of anxiety (which introspective measures suggest might be related to tasks and interlocutors) where language learning could be enhanced versus negative levels, which were assumed to be associated with impending anxiety. Baralt and Gurzynski-Weiss (Reference Baralt and Gurzynski-Weiss2011) compared learners’ state anxiety during task-based interaction in computer-mediated and face-to-face communication, finding learners’ reported state anxiety to be comparable across modalities. Current research on anxiety has explored the construct from the perspective of complex dynamic system theory, motivating researchers to delve into the very sources that drive the dynamic nature of anxiety (Papi & Khajavy, Reference Papi and Khajavy2023). This also encourages practitioners to design pedagogical interventions that may help learners manage anxiety more efficiently.

Syntheses in task-based L2 research

We now turn to our methodological synthesis of current practices in task-based research that has investigated learner IDs. Our general approach follows that used by earlier synthetic research (e.g., Plonsky & Kim, Reference Plonsky and Kim2016) in that we review substantive and methodological features rather than quantitatively synthesize effect sizes. Prior TBLT meta-analyses have examined the extent to which task-based interaction facilitates the acquisition of grammatical and lexical knowledge by synthesizing effect sizes (Cobb, Reference Cobb2010; Keck et al., Reference Keck, Iberri-Shea, Tracy-Ventura, Wa-Mbaleka, Norris and Ortega2006; Mackey & Goo, Reference Mackey, Goo and Mackey2007). Mackey and Goo (Reference Mackey, Goo and Mackey2007) investigated how different task and design features mediated interaction-driven learning, as well as whether the effects of task-based interaction were durable over time. Ziegler (Reference Ziegler2016) examined methodological features of task-based interaction research by investigating the context of the interaction focusing on computer-mediated communication (CMC) versus face-to-face (FTF) interaction. She found only a small difference between CMC and FTF interaction, favoring CMC for productive measures, but she cautioned about the stability of the finding due to the lack of delayed posttests in the primary studies.

Other meta-analyses have investigated specific task-based features and variables such as Jackson and Suethanapornkul’s (Reference Jackson and Suethanapornkul2013) examination of nine studies testing Robinson’s Cognition Hypothesis (Robinson, Reference Robinson2001), which resulted in a small but positive effect for accuracy but not fluency when complexity was increased along resource-directing dimensions. Sasayama et al. (Reference Sasayama, Malicka, Norris, Wen and Ahmadian2018) subsequently updated the finding that increasing task complexity by manipulating the tense needed to complete tasks (“here and now” versus “there and then”) led to greater syntactic complexity whereas manipulating complexity by the number of elements or reasoning demands led to greater lexical complexity (also see Révész, Reference Révész2009).

While these meta-analyses examined task-based L2 outcomes, other meta-analytic work has examined TBLT from a programmatic perspective. For example, a meta-analysis by Cobb (Reference Cobb2010) built on work investigating task-based interaction (e.g., Mackey & Goo, Reference Mackey, Goo and Mackey2007) by looking at 15 studies of learners performing oral communication tasks, finding differences on outcome measures that examined grammatical knowledge. Another programmatic-based meta-analysis by Bryfonski and McKay (Reference Bryfonski and McKay2017) examined 52 studies of longitudinal implementation of TBLT (as defined by primary authors), finding a positive effect for task-based approaches for a variety of learning outcomes as well as positive qualitative stakeholder perceptions.

Finally, there has been methodological work, including syntheses of TBLT research focusing on substantive rather than statistical findings, and methodological choices made by primary authors. Plonsky and Brown (Reference Plonsky and Brown2015), for example, meta-analyzed 18 meta-analyses of corrective feedback (focusing on its role as a key element in interaction-based tasks), finding the domain definitions caused each meta-analysis to draw different conclusions. Plonsky and Kim (Reference Plonsky and Kim2016) examined the substantive and methodological features of task-based learner production research. They analyzed 85 primary studies from 2006 to 2015, concluding, interestingly, that task-based researchers showed a preference for investigations of grammar, vocabulary, accuracy, and interaction with much less focus on pronunciation, pragmatics, and task performance work. In summary, while syntheses of TBLT research to date have reviewed prior studies with a focus on various methodological practices and findings, no studies have yet targeted the role of individual differences in task-based research, which is the goal of the current paper.

Motivation for the study

Given the ongoing interest in both individual differences as they relate to task-based language learning and teaching, and the focus on understanding methodological choices, the current study was guided by the following questions:

  1. 1) What are the demographic features of recent task-based research that investigated individual differences?

  2. 2) What kinds of individual differences have been investigated in recent task-based research?

  3. 3) How have individual differences been operationalized and measured in recent task-based research?

  4. 4) What sorts of analyses and reporting practices are most commonly seen in recent task-based research that focuses on individual differences?

Method

To answer these research questions, we carried out a substantive and methodological review, meaning that rather than synthesizing effect sizes (e.g., Cohen’s d, r) from the outcomes of quantitative studies, we systematically examined features of prior research. In doing this, we follow best practices in meta-analytic research recommended by a number of researchers (including, Mackey, Reference Mackey2020b; Norris & Ortega, Reference Norris and Ortega2006; Plonsky & Oswald, Reference Plonsky, Oswald and Plonsky2015) and prior methodological synthesis (e.g. Plonsky & Kim, Reference Plonsky and Kim2016; Plonsky & Oswald, Reference Plonsky, Oswald and Plonsky2015; Plonsky et al., Reference Plonsky, Marsden, Crowther, Gass and Spinner2020) in the domain of TBLT.

Inclusion and exclusion criteria

To systematically sample prior task-based research that has examined learners’ individual differences, we applied the following inclusion and exclusion criteria. The first defining characteristic of included studies was a focus on individual differences in the domain of TBLT.

We took an inclusive perspective on individual difference variables, operationalized from top-down and bottom-up perspectives. Top-down perspectives included the individual differences that commonly appear in texts on tasks and have long histories of being studied in the field (e.g., aptitude and working memory). Bottom-up perspectives included individual differences that emerged from our grounded coding on what types of individual difference variables were included in TBLT studies. Any learner-internal variables that mediated the processes and/or outcomes of second language acquisition were included. Exclusion criteria ruled out studies from non-task-based perspectives, for example, studies that examined individual differences but used linguistic tests like Grammaticality Judgement Tasks (e.g., Yilmaz & Granena, Reference Yilmaz and Granena2019) without tasks being a focus. Also excluded were studies that examined TBLT from non-learner perspectives, such as studies that explored teachers’ individual differences (e.g., Bryfonski, Reference Bryfonski2021), or individual differences that were not examined in light of task-based interventions, implementations, or interactions.

We adopted a similar broad operationalization of both individual differences and TBLT, including, for example, studies that examined TBLT from the perspective of learners’ needs, pedagogic tasks approximating target tasks (Long, Reference Long2015), task-supported language teaching (as in Ellis et al., Reference Ellis, Skehan, Li, Shintani and Lambert2020), task cycles (as in Willis, Reference Willis1996) and/or pre-, during- and post-tasks (as in Ellis, Reference Ellis2003; Reference Ellis2018). We included quantitative studies that utilized tasks to examine L2 production or outcome data (e.g. Complexity, Accuracy, Fluency/Complexity, Accuracy, Lexis, and Fluency (CAF/CALF; Bui & Skehan, Reference Bui and Skehan2018; Housen et al., Reference Housen, Kuiken and Vedder2012; Skehan, Reference Skehan1989) measures, oral or written measures), as well as qualitative studies of learners’ perceptions of TBLT and task-based interaction.

Following prior task-based methodological syntheses, we included only published peer-reviewed journal articles, meaning we excluded dissertations, theses, book chapters, conference presentations, and all types of unpublished research.

In statistical meta-analyses, methodologists typically recommend an inclusive approach to avoid publication bias. In other words, only including published studies may lead to positively skewed effect sizes due to the bias for statistically significant findings in academic publishing. However, in the meta-synthesis reported here, we aimed to systematically describe the popular areas, methods, and practices, rather than aggregate statistical effects (see, for example, a similar decision and motivation by Li and Zhao, Reference Li and Zhao2021). So, while book chapters and unpublished work such as theses and doctoral dissertations offer valuable contributions to the field, journal articles tend to have greater visibility and impact in terms of readership, and so we believe they reflect the most current areas of inquiry in this domain, and unpublished, non-referred work can be safely excluded for the purpose of this study. Finally, to limit the scope of our search to only recent, accessible research, we only included studies published between 2000 and 2023, where we expected to see the most growth and interest in IDs in task-based research at the time this study was written. We had to exclude studies that were not available in English as they were not accessible to us. A full list of synthesized studies is available at iris-database.org.

Search techniques

To access the relevant body of literature, four databases were reviewed: Linguistics and Language Behavior Abstracts (LLBA), Google Scholar, Educational Resources Information Center (ERIC), and Web of Science. We utilized the following terms in various combinations to search these databases: “task-based language teaching,” “TBLT,” “task supported,” “task- based,” “language learning,” and “individual differences.” We then cross-checked our list against articles recently published in eight journals that publish research related to our research questions: Applied Linguistics, Language Learning, Language Teaching Research, the Modern Language Journal, Studies in Second Language Acquisition, System, TASK Journal, TESOL Quarterly, Language Learning & Technology (LLT), the Annual Review of Applied Linguistics (ARAL), and Computer Assisted Language Instruction Consortium (CALICO). We also examined review articles relevant to our research questions (Chong & Reinders, Reference Chong and Reinders2020; Donate, Reference Donate2022; Ehrman et al., Reference Ehrman, Leaver and Oxford2003; Li & Zhao, Reference Li and Zhao2021; Nikolov, & Djigunović, Reference Nikolov and Djigunović2006; Roberts, Reference Roberts2012; Robinson, Reference Robinson and Robinson2011b; Smith & González-Lloret, Reference Smith and González-Lloret2021) and cross-checked the reference sections against the results from our database searches.

The total studies retrieved from the databases included 323 possible candidates for inclusion, with 133 studies being ultimately selected based on the inclusion and exclusion criteria discussed above. During the coding process, nine studies that were previously included via the criteria described above were found to be outside the scope of the study (e.g., because they did not use tasks as defined by any of the common standards outlined above) and were excluded. This resulted in a total sample of 133 studies included, contributing 135 unique samples. While we believe our sample paints an accurate and current picture of the domain of ID research in TBLT, of course, we do not believe or claim it is exhaustive. Other search terms, backwards-citation checks, a wider range of journals, and/or larger databases could all have uncovered additional studies. Our lack of time, space, and resources to examine literature not printed in English is also a limitation. Despite these shortcomings, given that we did manage to identify what we view as a substantial sample of included studies, spanning a range of timeframes and journals, we took the sample as sufficiently representative to proceed with the analysis, as shown in Tables 1 and 2.

Table 1. Studies of Individual Differences in TBLT from 2000 to 2023

Table 2. Studies of individual differences in TBLT across journals

Note: Table 2 only includes journals that contributed more than one unique sample. All other journals included in this study contributed only one study to the sample.

Table 1 shows that most of the included studies (88.15%) were implemented from 2012 to 2023 while only a few of them (11.85 %) were conducted before 2011.

Coding and analysis

To synthesize the relevant characteristics of the included studies, a coding scheme was developed to extract data from the following key areas: general study characteristics (journal, year, etc.), study context characteristics (country, language, modality, etc.), study participant characteristics (L1s, TLs, learner proficiency levels, etc.), research variables under investigation (IDs, dependent variables, etc.), task and design characteristics (task types, implementations, etc.), ID instrument characteristics (methods), statistical analyses (if applicable), coding methods, and open science practices. These characteristics and coding methods are illustrated in Table 3, with the full coding scheme and data set being available for download on IRIS (iris-database.org). To ensure the coding scheme would effectively obtain the characteristics listed above for our area of interest, the scheme was subjected to pilot and revision coding. The coding scheme was revised and refined before being utilized with the full sample of included studies. We then conducted inter-coder reliability testing. Two coders first discussed the coding scheme together and then independently coded 10 sample studies. The results from those 10 samples were then compared to ensure similar coverage for each coded category. Given the low-inference nature of the coding scheme, the coders achieved 91% agreement after their first meeting (with disagreements in seven categories). To resolve these coding discrepancies, which were mainly in the areas of context of the study (foreign versus second language) and statistical tests used, the ratings from a third coder were used, and the first two coders discussed and agreed upon how to code the disagreed upon data going forward. A second round of interrater reliability was then conducted to ensure reliability of the disagreed upon categories going forward. Two raters coded five additional studies from the sample. Once 100% rating agreement was achieved, the remainder of the studies were split up between two raters.

Table 3. Coding Scheme Summary

* CMC= computer mediated communication; F2F = face to face; SEM = structural equation modeling; TL = target language

In terms of analysis, the features listed in Table 3 that were based on categorical coding were analyzed using frequencies and percentages. For continuous data such as n sizes, treatment lengths, and number of tests conducted, we examined measures of central tendency and dispersion. For all open-ended items, we collapsed categories where possible and again analyzed them using frequencies and percentages.

Results

RQ1: The Demographic Features of the Recent Task-based Research

Demographics of the sample

The studies we analyzed included 9433 participants with an average n size per study of 70 and a range of 6 to 612 participants.

Context

As illustrated in Table 4, our analysis showed that the studies mainly focused on students learning languages in foreign language settings (89.63%), where they had relatively limited access to the target language. Also, the majority of studies were lab-based (62.22%) versus classroom-based studies (37.03%). As documented in studies of trends in applied linguistics research (e.g., Andringa & Godfroid, Reference Andringa and Godfroid2020), the majority of studies took place in university contexts (71.85%), followed by language institutes (17.78%), with a relatively small percentage of studies taking place at the secondary (9.63%) or elementary school level (7.41%). Finally, most studies in our sample were conducted in face-to-face modes (85.93%), with the sample also representing a few (k = 19) computer-mediated settings.

Table 4. Study context characteristics

* Percentages do not always add up to 100 because some studies met multiple criteria

Participants

Examining the participants within the included studies, we found the majority (43.7%) of participants were rated as intermediate level, non-heritage (94.07%) language learners as illustrated in Table 5. Note that percentages do not add up to 100 because some studies met multiple criteria. The L1 backgrounds of the learners in this sample were varied, with 17.78% of studies examining learners from a mix of L1 backgrounds and a significant portion of the studies (23.70%) not reporting the L1 backgrounds of the learners. This is because we took a strict coding approach to L1 background; for example, when authors described participants as “Chinese learners of English” we did not assume an L1 background of Mandarin (given that, to take just one example, there are hundreds of recognized languages in China, with Mandarin and Cantonese being the two most commonly spoken). For a clearer picture of the range of world regions represented by the included studies, we plotted the setting where the study took place in Figure 1.

Table 5. Participant characteristics

Figure 1. Countries represented by included studies.

Note: The size of the dots represents the number of studies in that region.

In summary, in keeping with previously described trends in applied linguistics research, the majority of the studies we analyzed investigated the learning of English (85.19%) as opposed to other L2s. After English, the only other TLs investigated were Spanish (8.89%), Korean (2.22%), Mandarin (1.48%), German (1.48%), French (0.74%) and Russian (0.74%).

RQ 2: Types of Individual Differences in Recent Task-based Research

To answer Research Question 2: “What kinds of individual differences have been investigated in recent task-based research?” in the included studies, we identified 30 individual differences being studied. We examined both the independent and dependent variables (where applicable) in each included study. For the majority of studies, the independent variables were the individual differences examined in relation to a variety of dependent variables that were typically outcome variables (e.g., anxiety, aptitude, cognitive style, creativity, gender, motivation, personality, prior knowledge, proficiency, and working memory). However, in some cases, IDs also emerged as dependent variables. This is especially the case in motivation research, which often examines the impact of various task manipulations on motivation as an outcome.

The most commonly examined ID was motivation, closely followed by working memory and L2 proficiency. Anxiety, aptitude, gender, prior knowledge, and learner interests were also commonly examined. These findings point to the variety of sub-areas of interest within task-based research, although some of the IDs identified, as illustrated in Table 6, represent overlapping constructs. For example, working memory is often examined as a sub-construct of aptitude. For the purposes of the study reported in this chapter, we coded based on the terms as they were used by primary authors.

Table 6. Research variables

RQ 3: Operationalization and Measurement of Individual Differences

To answer Research Question 3, “How have individual differences been operationalized and measured in recent task-based research?”, we examined the sorts of instruments used to elicit or measure each of the IDs previously identified to gain insight into how these constructs were operationalized in task-based research. Due to space constraints, this study presents only the five most commonly examined ID variables but the full dataset is available on IRIS (iris-database.org) together with operationalizations and methods for the less commonly examined ID variables.

As noted in relation to Research Question 2 above, the most common ID investigated in the included studies was motivation (30 of 135 studies, or 22.22%). This could be an artifact of time, as motivation research was one of the first individual difference variables to be investigated in L2 research (Larsen-Freeman & Long, Reference Larsen-Freeman and Long1991). Researchers investigating motivation mainly did so through the use of questionnaires (93.33%) as presented in Table 7. Authors adapted their questionnaires from a variety of pre-existing sources, citing instruments described in Boekaerts (Reference Boekaerts2002), Clément et al. (Reference Clément, Dörnyei and Noels1994), Gardner (Reference Gardner1985), Lam and Law (Reference Lam and Law2007), Martin et al. (Reference Martin, Myers and Mottet1999), Pietri (Reference Pietri2015), Pyun et al. (Reference Pyun, Kim, Cho and Lee2014), Taguchi et al. (Reference Taguchi, Magid, Papi, Dörnyei and Ushioda2009), and Troia et al. (Reference Troia, Harbaugh, Shankland, Wolbers and Lawrence2012), amongst others. Gardner’s (Reference Gardner1985) Attitudes Motivation Test Battery and the questionnaire assessing trait-based L2 regulatory focus from Taguchi et al. (Reference Taguchi, Magid, Papi, Dörnyei and Ushioda2009) were the only materials of this kind to appear in more than one study each. A variety of studies created questionnaires specifically tailored to the study or tasks utilized in the classroom. For example, Torres and Serafini (Reference Torres and Serafini2016) developed a questionnaire consisting of items related to learners’ persistence with the task, interest in the activities, and satisfaction with their performance. Other methods of elicitation included journal entries (Sampson, Reference Sampson2012), thermometer ratings (Azkarai & Kopinska, Reference Azkarai and Kopinska2020), and interviews (Ruan et al., Reference Ruan, Duan and Du2015).

Table 7. Instruments used for investigating motivation in task-based research

Six of the motivation studies examined how learners’ motivational profiles impacted their L2 production during or after task performance as measured by CALF (e.g., Han & McDonough, Reference Han and McDonough2021). Ten studies examined how various task manipulations or conditions were related to learners’ motivation (e.g., Torres & Serafini, Reference Torres and Serafini2016). For example, five out of those ten studies examined the relationship between motivation and task complexity, five examined motivation across task types or conditions, and one examined motivation and task repetition. Some of these studies also assessed motivation in conjunction with other IDs such as anxiety, attitudes, task engagement, interest, and proficiency. Studies of how TBLT is mediated by motivation, then, clearly represent rich and interesting areas.

Working memory was the second most commonly investigated ID in task-based research (17.78% of studies, as shown in Table 8). All studies that investigated working memory utilized some form of a memory span task, which can be loosely operationalized as the longest list of items (words, digits, sounds, etc.) a participant can recall. The most commonly used were operation-span tasks (41.67%), where participants complete math problems, and reading span tasks (29.17%), where participants are asked to read sentences and remember the final word. Studies cited classic reading span tasks by Daneman and Carpenter (Reference Daneman and Carpenter1980) and the speaking-span version (Daneman & Green, Reference Daneman and Green1986). Authors also utilized reading span adaptations for other languages such as for Hungarian (Révész, Reference Révész2012) and Farsi (Shahnazari, Reference Shahnazari2013). For spatial working memory tasks, authors implemented forward Corsi block-tapping tasks (Zalbidea & Sanz, Reference Zalbidea and Sanz2020) or online spatial tasks such as Blockspan and Shapebuilder (Nielson, Reference Nielson2014), both of which ask participants to remember and reproduce flashing or multi-colored shapes in a grid. Several studies note the drawbacks of classic reading-span and listening-span tasks such as Daneman and Carpenter’s (Reference Daneman and Carpenter1980) for learners who might be asked to complete the tasks in their L2, as justification for using other types of non-language working memory tasks such as spatial memory tasks. The majority of TBLT studies involving working memory (54.17%) investigated the impact of working memory on some dimension of task performance (as measured by CAF/CALF). Five of the included studies investigated the relationship between working memory and corrective feedback during task-based interactions (Goo, Reference Goo2012; Kim et al., Reference Kim, Payant and Pearson2015; Lai et al., Reference Lai, Fei and Roots2008; Liao & Zhang, Reference Liao and Zhang2022; Révész, Reference Révész2012), and one investigated the production of modified output following corrective feedback (Mackey et al., Reference Mackey, Adams, Stafford and Winke2010).

Table 8. Instruments used for investigating working memory in task-based research

The next most commonly investigated ID in task-based research was L2 proficiency (17.78%). The issue of operationalizing L2 proficiency, namely that it is often not clearly operationalized in applied linguistics research, has been discussed extensively in the literature (see for example, Bachman and Clark’s (Reference Bachman and Clark1987), early work as well as Malovrh and Benati’s (Reference Malovrh and Benati2018) and Park et al.’s (Reference Park, Solon, Dehghan-Chaleshtori and Ghanbar2022) more recent contributions). While it is a frequently used outcome variable in L2 research, we are conceptualizing proficiency as an ID in the current study due to its routine use as an internal mediator of task effects in TBLT research.

We found that studies in task-based research also use a variety of methods to operationalize L2 proficiency (see Table 9). The primary studies we investigated examined the extent to which L2 proficiency mediated L2 outcomes based on a variety of task-related variables such as task complexity (e.g., Awwad & Tavakoli, Reference Awwad and Tavakoli2019; Ghahdarijani, Reference Ghahdarijani2012; Kim, Reference Kim2011; Xu & Fan, Reference Xu and Fan2021), pre-task planning (e.g., Bui, Reference Bui2019) and task type (e.g., oral vs. written, Kim, Reference Kim2011; or receptive vs. productive, Zareinajad et al., Reference Zareinajad, Rezaei and Shokrpour2015). Studies that investigated L2 proficiency as an ID utilized outcome measures such as CAF (25% of the proficiency studies), listening comprehension (8.33%), interaction/discourse patterns (4.17%; Butler & Zeng, Reference Butler and Zeng2014), vocabulary development (8.33%; Kim, Reference Kim2011), how often learners noticed others’ errors (4.17%; Sato & McDonough, Reference Sato and McDonough2020), and learners’ awareness of L2 pragmalinguistic features (4.17%; Takahashi, Reference Takahashi2005). To operationalize L2 proficiency, authors utilized the instruments identified in Table 10. The most common assessment was a standardized TOEFL test (20.83%). Other frequently used assessments included enrollment status in a particular grade (Butler & Zeng, Reference Butler and Zeng2014) or class (Kim, Reference Kim2011) and C-tests (e.g., Dörnyei & Kormos, Reference Dörnyei and Kormos2000; Monteiro & Kim, Reference Monteiro and Kim2020).

Table 9. Instruments used for investigating L2 proficiency in task-based research

Table 10. Instruments used for investigating anxiety in task-based research

The next most commonly examined ID was anxiety (11.85%, see table 10). All of the included studies utilized questionnaires to measure anxiety. One study (Wang et al., Reference Wang, East and Li2021) also included semi-structured and stimulated recalls (Gass & Mackey, Reference Gass and Mackey2016) to formulate a subsequently developed anxiety questionnaire. Each of the studies utilized or adapted their anxiety questionnaire from a different source, with sources including: the Foreign Language Classroom Anxiety Scale (Horwitz et al., Reference Horwitz, Horwitz and Cope1986), Abolghasemi’s Test Anxiety Inventory (Abolghasemi et al.,Reference Abolghasemi, Asadi Moghaddam, Najarian and Shokrkon1996), Brunfaut and Révész (Reference Brunfaut and Révész2015), which was adapted from the Foreign Language Listening Anxiety Scale (Elkhafaifi, Reference Elkhafaifi2005), Second Language Writing Anxiety Inventory, (Cheng, Reference Cheng2004), MacIntyre, and Gardner (Reference MacIntyre and Gardner1994), A self-perceived communication competence scale (McCroskey, & McCroskey, Reference McCroskey and McCroskey1988), Pyun et al. (Reference Pyun, Kim, Cho and Lee2014), Robinson (Reference Robinson2001), and Yashima (Reference Yashima2002). The Horwitz et al. (Reference Horwitz, Horwitz and Cope1986) scale was identified as the most commonly used instrument to measure anxiety in general L2 research in Teimouri et al.’s (Reference Teimouri, Goetze and Plonsky2019) meta-analysis of L2 anxiety and achievement. However, in our sub-set of task-based studies, we found a wider range of approaches being implemented.

In these studies, 37.50% utilized CAF as an outcome measure, while one study utilized listening comprehension assessments (Ghahdarijani, Reference Ghahdarijani2012), and one examined the quantity and quality of interactions (Révész, Reference Révész2011). Six of the studies examined anxiety in conjunction with other IDs such as task motivation (Mahdavirad, Reference Mahdavirad2017; Wang et al., Reference Wang, East and Li2021), attitudes (Pyun, Reference Pyun2013), and willingness to communicate (van de Guchte et al., Reference van de Guchte, van Batenburg and van Weijen2022). Researchers also examined how task complexity (56.25%) or task repetition (6.25%) was related to anxiety during task-based interventions.

Aptitude was the fifth most commonly investigated ID in task-based research (6.67%). Many studies that investigated aptitude (44.44% of them) utilized CALF as the outcome measure. The Modern Language Aptitude Test (MLAT; Carroll & Sapon, Reference Carroll and Sapon1959) was the most commonly used method of operationalizing language aptitude in these studies followed by the LLAMA aptitude tests (Kourtali & Révész, Reference Kourtali and Révész2020; Monteiro & Kim, Reference Monteiro and Kim2020) and Pimsleur’s Language Aptitude Battery (Kormos & Trebits, Reference Kormos and Trebits2012; Li et al., Reference Li, Ellis and Zhu2019). However, two other aptitude tests were also utilized by task-based researchers in our sample: the Hungarian Language Aptitude test and the Oxford Language Aptitude test (see Table 11).

Table 11. Instruments used for investigating aptitude in task-based research

Researchers investigating aptitude in TBLT did so by examining the relationship between manipulating task complexity and aptitude (44%, all but one manipulated reasoning demands), planning time (22%), or task type (oral vs. written modes, 11%; picture description vs. narrative tasks, 11%).

RQ 4: analyses and Reporting Practices in Recent Task-Based Research

Finally, to answer Research Question 4, “What sorts of analyses and reporting practices are most commonly seen in recent task-based research that focuses on individual differences?”, we first looked at the study designs. We found that the majority of the research was quantitative (72.59%) or mixed methods (23.70%), with the rest being qualitative (3.0%) as illustrated in Table 12. Thirty-nine (28.89%) of the studies were longitudinal, and twenty-eight (20.74%) tracked changes over time using pre/post and/or immediate and/or delayed posttests, although only ten (7.41% of the sample) utilized delayed posttests. On average, the length of treatment in the longitudinal studies was 10 weeks, ranging from one to 40 weeks. More studies utilized oral tasks (67.41%) than written tasks (36.30%); however, both were well represented in the sample. Over a third of the studies utilized some form of CAF measures to examine L2 outcomes.

Table 12. Design and task types

We next examined the most commonly implemented statistical analyses and coding practices of the included studies. More than a third (37.69%) of the quantitative studies in our sample utilized more than 10 statistical tests per study whereas 7.69% of the included studies ran no statistical tests at all. Around half of the studies (55.38%) ran fewer than 10 statistical tests. Most studies utilized frequencies and percentages (54.81%) followed by correlations (37.04%), t-tests (28.89%), and ANOVAs (25.19%) as demonstrated in Table 13. These are slightly different findings for our study than those reported in previous syntheses. In other words, the findings we report here for task-based ID research are not always the same as findings presented in prior methodological syntheses of task research. For example, Plonsky and Kim (Reference Plonsky and Kim2016) found that in task-based learner production studies, ANOVA was the most common test utilized by researchers.

Table 13. Statistical analyses and coding practices

Finally, we examined the sorts of open science practices implemented by authors of included studies. Forty-nine (36.00%) studies made their full tasks available in an appendix or an online repository (IRIS, iris-database.org or The Task Bank, tblt.indiana.edu). Thirty-nine studies (29.00%) made other instruments (such as background questionnaires) available on IRIS. In other words, 74 of 135 studies (54.81%) did not make any tasks or instruments available. Seven studies made their full datasets available, and two studies acknowledged receiving badges for open science. This might be because open science practices have increased in recent years but were seldom practiced in the earlier period for which we collected studies (see Figure 2).

Figure 2. Open Science practices in TBLT ID research over time.

Discussion

Our research provides an overview of the range of IDs investigated in recent, peer reviewed TBLT research along with information about how they are being investigated. We found that this domain of research is growing in popularity, with relatively few articles in this domain published in the early 2000s, up to nearly 10 per year in the 2010s and 15 per year in the 2020s. Our analysis shows that researchers are interested in a diverse array of IDs with motivation, working memory, L2 proficiency, anxiety, and aptitude standing out as the most commonly researched. This finding aligns with interest in L2 research in general where these IDs have robust enough empirical histories to have all been the subjects of other meta-analyses, for example there are prior meta-analyses on motivation (Al-Hoorie, Reference Al-Hoorie2018), working memory (Shin, Reference Shin2020), anxiety (Teimouri et al., Reference Teimouri, Goetze and Plonsky2019), and aptitude (Li, Reference Li2016), among others. More than 20 IDs emerged from our analysis, meaning there is ample room for more work in various domains of task-based ID research. Interestingly, ten IDs only appeared in one study each: emotional intelligence, heritage identity, interaction mindset, L1 fluency, multiple intelligences, tolerance of ambiguity, risk-taking, emotions, L2 self-system, and metacognitive strategies. This may be due to the fact that some of these IDs can be linked or subsumed into other IDs. For example, L2 risk-taking has been tied to specific domains of personality (Brown, Reference Brown2000; Pyun et al., Reference Pyun, Kim, Cho and Lee2014). These less commonly investigated IDs point to future potential avenues where task-based ID research might progress.

Our methodological synthesis also uncovered that researchers of the most commonly investigated domains of task-based ID research tend to rely on the same methodological tools. For example, the majority of studies investigating motivation and anxiety relied on questionnaires to operationalize ID variables. This leads us to question whether less commonly implemented tools, for example, those from motivation research, such as journals and written feedback could be triangulated with the more commonly used questionnaires and whether this might lead to a more robust operationalization of the dynamic nature of L2 motivation (e.g., Dörnyei, Reference Dörnyei, Ellis and Larsen-Freeman2009a).

While Derrick (Reference Derrick2016) found that only 58% of L2 studies reported the origins of their instruments, we found for task-based research that authors noted whether they adapted from an existing instrument or developed an instrument in-house for the purposes of the study.

Echoing previous findings in task-based methodological syntheses (Plonsky & Kim, Reference Plonsky and Kim2016), we found that ID researchers also rely heavily on changes in L2 output based on the CAF/CALF framework (Housen et al., Reference Housen, Kuiken and Vedder2012; Skehan Reference Skehan1998a; Reference Skehan1998b; Reference Skehan2009) to operationalize L2 performance and development. Other methods used include assessing listening comprehension, interaction/discourse patterns, vocabulary development, how often learners noticed others’ errors, and learners’ awareness of L2 pragmalinguistic features.

In terms of the task variables investigated in these studies, our study shows that researchers were mainly interested in investigations of task complexity (27.41%), planning time (12.59%), manipulating task types (11.85%), and corrective feedback (5.93%), among other variables. This range of interests in task-based ID research seems to be representative of domains of interest in TBLT more generally, as evidenced by the recent trends in conferences (Sasayama, Reference Sasayama2019), handbooks (Samuda & Bygate, Reference Samuda and Bygate2008), encyclopedias, and edited collections (Wen et al., Reference Wen, Biedroń and Skehan2017) (as noted in a review of recent edited collections by Bryfonski, Reference Bryfonski2020).

From a methodological standpoint (our fourth research question), only 39 (28.89%) of the studies we investigated were longitudinal, in contrast to 88 (65.19%) that were cross-sectional. Historically, many IDs have been considered to be fixed, unchangeable characteristics, which may lead researchers to focus on cross-sectional study designs. However, there is also evidence suggesting that IDs like aptitude or working memory might in fact be improvable via training exercises (Bialystok & DePape, Reference Bialystok and DePape2009; Davidson et al., Reference Davidson, Kabat-Zinn, Schumacher, Rosenkranz, Muller, Santorelli, Urbanowski, Harrington, Bonus and Sheridan2003; Linck et al., Reference Linck, Osthus, Koeth and Bunting2014). Other studies have found that constructs like motivation or anxiety might be dynamic rather than static, fluctuating by context, including at different times. We are encouraged that for the included longitudinal studies, the average time frame studied was 10 weeks, or slightly less than one academic semester. Many researchers in our field have called for more long-term research (e.g., Long, Reference Long2016; Mackey & Goo, Reference Mackey, Goo and Mackey2007). Additionally, the majority of the research we investigated was concentrated in a few contexts, namely, EFL contexts with adult language learners. To move the domain of task-based ID research forward, we believe it is important to recognize the need and value of and support research conducted outside the “WEIRD” (Western, Educated, Industrialized, Rich, and Democratic) contexts traditionally investigated by applied linguists, and social scientists more generally (Andringa & Godfroid, Reference Andringa and Godfroid2020; Henrich et al., Reference Henrich, Heine and Norenzayan2010). By focusing our investigations mainly on TL (English), the generalizability of findings from these studies of IDs in TBLT is limited.

In terms of our fourth research question, we found that investment in open science practices in the domain of task-based ID research is still developing. Derrick (Reference Derrick2016) reported that only 17% of authors in three journals provided instruments in an appendix or in an online repository. We found slightly more (29%) for task-based ID research. Applied linguistics has heralded a push towards open-science practices in recent years, including recognition of open data and materials through badges in major journals (e.g., Studies in Second Language Acquisition, Annual Review of Applied Linguistics), repositories for instruments and materials (IRIS, Marsden et al., Reference Marsden, Mackey, Plonsky, Mackey and Marsden2015), repositories for tasks (the Task Bank; Gurzynski-Weiss, Reference Gurzynski-Weiss2021), and registered replications and reports (Morgan-Short et al., Reference Morgan-Short, Marsden, Heil, Issa, Leow, Mikhaylova, Mikołajczak, Moreno, Slabakova and Szudarski2018). Open science practices are an important way to promote scientific equity through the sharing of knowledge, instruments, and findings in freely accessible and permanent repositories. While there is growing excitement around open access in applied linguistics research, practices such as open-access publishing (e.g., Zhu, Reference Zhu2017) or making data freely available have not yet been fully embraced by L2 researchers (and academics more broadly), and this was born out in our findings as well.

Recommendations for Future Research

From a content perspective, the results of this methodological review demonstrate that task-based ID research is expanding beyond the most often studied constructs (motivation, working memory, proficiency). While there is always room for development of studies involving these most commonly researched IDs, we uncovered many other lesser-studied IDs that have the potential to impact TBLT research. To take one example, a few studies have investigated cognitive creativity as an ID (including, for example, Albert & Kormos, Reference Albert and Kormos2011; McDonough et al., Reference McDonough, Crawford and Mackey2015; Zabihi et al., Reference Zabihi, Rezazadeh and Ansari2013). IDs like cognitive creativity have the potential to shed light on interesting relationships in how learners approach tasks or task-based interaction, for example investigating how learners’ cognitive creativity interacts with their ability to find solutions to task-based problems or utilize learning strategies. However, research in this area has yet to pick up momentum. Less studied IDs, like creativity and emotions, might be profitably combined with other more commonly studied IDs like motivation, (as in Pipes, Reference Pipes2023) to better understand the various ways in which learner IDs mediate outcomes during task-based interactions or interventions.

The task-based ID research that has been conducted so far has relied on a relatively small set of methodological approaches. For example, researchers investigating L2 proficiency could aim to triangulate data from multiple sources in order to present the most accurate, and most transferable, view of participants’ developmental levels. This might mean triangulating from standardized test scores in addition to enrollment status and in-house tests or assessments. The results of task-based assessments (e.g., Ellis et al., Reference Ellis, Skehan, Li, Shintani and Lambert2020; Noroozi & Taheri, Reference Noroozi and Taheri2022; Norris et al., Reference Norris, Brown, Hudson and Bonk2002) would also be useful to examine in conjunction with other standardized proficiency tests as they are often more representative and better aligned to the kinds of tasks learners complete in task-based interventions (e.g., see Boers et al., Reference Boers, Bryfonski, Faez and McKay2021).

From a methodological standpoint, we recommend more research focusing on IDs in TBLT from qualitative or mixed methods perspectives. Only four studies (2.96%) included in our methodological synthesis were qualitative, and 32 (23.70%) utilized mixed methods. Again, triangulation of qualitative measures along with quantitative results from questionnaires (the most commonly implemented tool in TBLT ID research according to our findings) such as through semi-structured or stimulated recall interviews, journals, role-plays, classroom discourse, long term case studies, or other qualitative datasets would facilitate our understanding of how learners’ individual differences might impact task performance and outcomes. In quantitative studies, we also recommend more longitudinal research that examines changes in L2 outcomes or learners’ IDs over time, with a greater focus on longer term effects through the use of delayed posttests or follow-up interviews. Some task-based interventions, such as interactively provided corrective feedback, have been shown to have delayed effects (Lee & Lyster, Reference Lee and Lyster2016; Mackey, Reference Mackey1999; Mackey & Goo, Reference Mackey, Goo and Mackey2007; Sheen, Reference Sheen2010). As such, delayed posttests are necessary to observe the contribution of learners’ IDs with how durable outcomes are over time.

In the domain of statistical practices, we found that more than a third (37.69%) of the quantitative studies in our sample employed more than 10 parametric statistical tests (and some studies utilized many more). This should be viewed in the light of calls in prior work (e.g., Larsson et al., Reference Larsson, Plonsky, Sterling, Kytö, Yaw and Wood2023; Plonsky, Reference Plonsky2013; Reference Plonsky and Plonsky2015) for researchers to expand their repertoire of statistical practices in quantitative and mixed methods research and prioritize examinations of descriptive statistics, effect sizes, and confidence intervals over running large numbers of null hypothesis statistical tests. In terms of reporting practices too, we recommend authors be explicit about demographic data, including clearly stating the L1s of participants, describing the full context in which the study took place, and including as much descriptive data as possible such that future meta-analytic work can be easily conducted and studies can be replicated if necessary.

Finally, we note that outreach and inclusivity is critical in task-based research. Task-based pedagogy is a worldwide interest and therefore requires a global perspective. We believe an important priority in this area is for research to investigate learners studying languages other than English. While we recognize the global impact of English, our understanding of language learning cannot currently be generalized without the addition of a robust variety of other target languages and in more diverse contexts. Additionally, researchers excited about task-based ID research should consider making their materials such as tasks and data freely accessible in online repositories to aid in replication efforts and to expand the usage of common tools and tasks.

Data availability statement

The experiment in this article earned Open Data and Materials badges for transparent practices. The data and materials are available at https://www.iris-database.org/details/pWxNY-asADp

Competing interest

The author(s) declare none.

References

Abolghasemi, A., Asadi Moghaddam, A., Najarian, B., & Shokrkon, H. (1996). Scale reliability for measurement of test anxiety of Ahwaz’s guidance school girls. Journal of Psychology and Educational Sciences of Ahwaz Chamran University, 3, 6174.Google Scholar
Al-Hoorie, A.H. (2018). The L2 motivational self system: A meta-analysis. Studies in Second Language Learning and Teaching, 8, 721754. https://doi.org/10.14746/ssllt.2018.8.4.2CrossRefGoogle Scholar
Al Khalil, M. K. (2016). Insights from measurement of task-related motivation. In Mackey, A., & Marsden, E. (Eds.), Advancing methodology and practice: The IRIS repository of instruments for research into second languages (pp. 243262). Routledge.Google Scholar
Andringa, S., & Godfroid, A. (2020). Sampling bias and the problem of generalizability in Applied Linguistics. Annual Review of Applied Linguistics, 40, 134142. https://doi.org/10.1017/S0267190520000033CrossRefGoogle Scholar
Awwad, A., & Tavakoli, P. (2019). Task complexity, language proficiency and working memory: Interaction effects on second language speech performance. International Review of Applied Linguistics in Language Teaching, 60, 169196, https://doi.org/10.1515/iral-2018-0378CrossRefGoogle Scholar
Albert, Á., & Kormos, J. (2004). Creativity and narrative task performance: An exploratory study. Language Learning, 54, 277310. https://doi.org/10.1111/j.1467-9922.2004.00256.xCrossRefGoogle Scholar
Albert, Á., & Kormos, J. (2011). Creativity and narrative task performance: An exploratory study. Language Learning, 61, 7399. https://doi.org/10.1111/j.1467-9922.2011.00643.xCrossRefGoogle Scholar
Azkarai, A., & Kopinska, M. (2020). Young EFL learners and collaborative writing: A study on patterns of interaction, engagement in LREs, and task motivation. System, 94, 114. https://doi.org/10.1016/j.system.2020.102338CrossRefGoogle Scholar
Bachman, L. F., Clark, J. L. D. (1987) The measurement of foreign/second language proficiency, The Annals of the American Academy of Political and Social Science, 490, 2033. https://doi.org/10.1177/0002716287490001003Google Scholar
Baralt, M., & Gurzynski-Weiss, L. (2011). Comparing learners’ state anxiety during task-based interaction in computer-mediated and face-to-face communication. Language Teaching Research, 15, 201229. https://doi.org/10.1177/0265532210388717CrossRefGoogle Scholar
Bashori, M., Van Hout, R., Strik, H., & Cucchiarini, C. (2022). Web-based language learning and speaking anxiety. Computer Assisted Language Learning, 35, 10581089. https://doi.org/10.1080/09588221.2020.1770293CrossRefGoogle Scholar
Bialystok, E., & DePape, A. M. (2009). Musical expertise, bilingualism, and executive functioning. Journal of Experimental Psychology: Human Perception and Performance, 35, 565574. https://doi.org/10.1037/a0012735Google ScholarPubMed
Boekaerts, M. (2002). Motivation to learn: Education practices (Vol. 10). International Academy of Education.Google Scholar
Boers, F., Bryfonski, L., Faez, F., & McKay, T. (2021). A call for cautious interpretation of meta-analytic reviews. Studies in Second Language Acquisition, 43, 224. https://doi.org/10.1017/S0272263120000327CrossRefGoogle Scholar
Brown, H. D. (2000). Principles of language learning and teaching (Vol. 4). Longman.Google Scholar
Brunfaut, T., & Révész, A. (2015). The role of task- and listener-characteristics in second language listening. TESOL Quarterly, 49, 141168. https://doi.org/10.1002/tesq.168CrossRefGoogle Scholar
Bryfonski, L. (2020). Current trends and new developments in task-based language teaching. ELT Journal, 74, 492511. https://doi.org/10.1093/elt/ccaa043CrossRefGoogle Scholar
Bryfonski, L. (2021). From task-based training to task-based instruction: Novice language teachers’ experiences and perspectives. Language Teaching Research, 125. https://doi.org/10.1177/13621688211026570Google Scholar
Bryfonski, L. & McKay, T. H. (2017). TBLT implementation and evaluation: A meta-analysis. Language Teaching Research, 23, 603632. https://doi.org/10.1177/1362168817744389CrossRefGoogle Scholar
Bui, G. (2019). Influence of learners’ prior knowledge, L2 proficiency and pre-task planning on L2 lexical complexity. International Review of Applied Linguistics in Language, 59, 543567. https://doi.org/10.1515/iral-2018-0244CrossRefGoogle Scholar
Bui, G., & Skehan, P. (2018). Complexity, accuracy, and fluency. The TESOL Encyclopedia of English Language Teaching, 17. https://doi.org/10.1002/9781118784235.eelt0046CrossRefGoogle Scholar
Butler, Y. G., & Zeng, W. (2014). Young foreign language learners’ interactions during task-based paired assessments. Language Assessment Quarterly, 11, 4575. https://doi.org/10.1080/15434303.2013.869814CrossRefGoogle Scholar
Bygate, M. (2018). Learning language through task repetition. John Benjamins.CrossRefGoogle Scholar
Bygate, M., & Samuda, V. (2005). Integrative planning through the use of task repetition. In Ellis, R. (Ed.), Planning and task performance in a second language (pp. 3774). John Benjamins.CrossRefGoogle Scholar
Carroll, J. (1981). Twenty-five years of research on foreign language aptitude. In Diller, K. (Ed.), Individual differences and universals in language learning aptitude (pp. 83118), Newbury House.Google Scholar
Carroll, J. B., & Sapon, S. M. (1959). Modern language aptitude test: MLAT. The Psychological Corporation.Google Scholar
Cheng, Y. (2004). A measure of second language writing anxiety: Scale development and preliminary validation. Journal of Second Language Writing, 13, 313335. https://doi.org/10.1016/j.jslw.2004.07.001CrossRefGoogle Scholar
Chong, S. W., & Reinders, H. (2020). Technology-mediated task-based language teaching: A qualitative research synthesis. Language Learning & Technology, 24, 7086. http://hdl.handle.net/10125/44739Google Scholar
Clément, R., Dörnyei, Z., & Noels, K. A. (1994). Motivation, self-confidence, and group cohesion in the foreign language classroom. Language Learning, 44, 417448. https://doi.org/10.1111/j.1467-1770.1994.tb01113.xCrossRefGoogle Scholar
Cobb, M. (2010). Meta-analysis of the effectiveness of task-based interaction in form-focused instruction of adult learners in foreign and second language teaching. (Unpublished doctoral dissertation). University of San Francisco, CA.Google Scholar
Daneman, M., & Carpenter, P. A. (1980). Individual differences in working memory and reading. Journal of Verbal Learning and Verbal Behavior, 19, 450466. https://doi.org/10.1016/S0022-5371(80)90312-6CrossRefGoogle Scholar
Daneman, M., & Green, I. (1986). Individual differences in comprehending and producing words in context. Journal of Memory and Language, 25, 118. https://doi.org/10.1016/0749-596X(86)90018-5CrossRefGoogle Scholar
Davidson, R. J., Kabat-Zinn, J., Schumacher, J., Rosenkranz, M., Muller, D., Santorelli, S. F., Urbanowski, F., Harrington, A., Bonus, K., & Sheridan, J. F. (2003). Alterations in brain and immune function produced by mindfulness meditation. Psychosomatic Medicine, 65, 564570. https://doi.org/10.1097/01.psy.0000077505.67574.e3CrossRefGoogle ScholarPubMed
DeKeyser, R. (2012). Interactions between individual differences, treatments, and structures in SLA. Language Learning, 62, 189200. https://doi.org/10.1111/j.1467-9922.2012.00712.xCrossRefGoogle Scholar
Derrick, D. J. (2016). Instrument reporting practices in second language research. TESOL Quarterly, 50, 132153. https://doi.org/10.1002/tesq.217CrossRefGoogle Scholar
Donate, Á. (2022). Task anxiety, cognition and performance on oral tasks in L2 Spanish. Journal of Spanish Language Teaching, 9, 118. https://doi.org/10.1080/23247797.2022.2090661CrossRefGoogle Scholar
Dörnyei, Z. (2005). The psychology of the language learner: Individual differences in second language acquisition. Mahwah.Google Scholar
Dörnyei, Z. (2009a). Individual differences: Interplay of learner characteristics and learning environment. In Ellis, N. C. & Larsen-Freeman, D. (Eds.), Language as a complex adaptive system (pp. 230248). Wiley-Blackwell.Google Scholar
Dörnyei, Z. (2009b). The L2 motivational self system. In Dörnyei, Z. & Ushioda, E. (Eds.), Motivation, language identity and the L2 self (pp. 942). Multilingual Matters.CrossRefGoogle Scholar
Dörnyei, Z., & Kormos, J. (2000). The role of individual and social variables in oral task performance. Language Teaching Research, 4, 275300. https://doi.org/10.1177/136216880000400305CrossRefGoogle Scholar
Dörnyei, Z., & Skehan, P. (2003). Individual differences in second language learning. In Doughty, C. J. & Long, M. H. (Eds.), The handbook of second language acquisition (pp. 589630). Blackwell.CrossRefGoogle Scholar
Elkhafaifi, H. M. (2005). Listening comprehension and anxiety in the Arabic language classroom. The Modern Language Journal, 89, 206220. https://doi.org/10.1111/j.1540-4781.2005.00275.xCrossRefGoogle Scholar
Ellis, R. (2003). Task-based language learning and teaching. Oxford University Press.Google Scholar
Ellis, R. (2018). Reflections on task-based language teaching. Multilingual Matters.Google Scholar
Ellis, R., Skehan, P., Li, S., Shintani, N., & Lambert, C. (2020). Task-based language teaching: Theory and practice. Cambridge University Press.Google Scholar
Ehrman, M. E., Leaver, B. L., & Oxford, R. L. (2003). A brief overview of individual differences in second language learning. System, 31, 313330. https://doi.org/10.1016/S0346-251X(03)00045-9CrossRefGoogle Scholar
Gardner, R. C. (1985). Social psychology and second language learning: The role of attitudes and motivation. Edward Arnold.Google Scholar
Gass, S. M., Behney, J., & Plonsky, L. (2020). Second language acquisition: An introductory course. Routledge.CrossRefGoogle Scholar
Gass, S. M., & Mackey, A. (2006). Input, interaction and output: An overview. AILA Review, 19, 317. https://doi.org/10.1075/aila.19.03gasCrossRefGoogle Scholar
Gass, S. M., & Mackey, A. (2012). The Routledge handbook of second language acquisition. Routledge.Google Scholar
Gass, S. M., & Mackey, A. (2016). Stimulated recall methodology in applied linguistics and L2 research. Routledge.CrossRefGoogle Scholar
Ghahdarijani, M. S. (2012). The impact of task complexity on Iranian EFL learners’ listening comprehension across anxiety and proficiency levels. Theory and Practice in Language Studies, 2, 10571068. https://doi.org/10.4304/tpls.2.5.1057-1068CrossRefGoogle Scholar
Goo, J. (2012). Corrective feedback and working memory capacity in interaction-driven L2 learning. Studies in Second Language Acquisition, 34, 445474. https://doi.org/10.1017/S0272263112000149CrossRefGoogle Scholar
Gurzynski-Weiss, L. (2021). A conversation between task-based researchers, language teachers, and teacher trainers. TASK, 1, 138149. https://doi.org/10.1075/task.00007.weiCrossRefGoogle Scholar
Gurzynski-Weiss, L., & Plonsky, L. (2017). Look who’s interacting: A scoping review of research involving non-teacher/non-peer interlocutors. In Gurzynski-Weiss, L. (Ed.), Expanding individual difference research in the interaction approach: Investigating learners, instructors, and other interlocutors (pp. 305324). John Benjamins.CrossRefGoogle Scholar
Han, Y., & McDonough, K. (2021). Motivation as individual differences and task conditions from a regulatory focus perspective: Their effects on L2 Korean speech performance. Innovation in Language Learning and Teaching, 15, 112. https://doi.org/10.1080/17501229.2019.1652614CrossRefGoogle Scholar
Henrich, J., Heine, S., & Norenzayan, A. (2010). The weirdest people in the world? Behavioral and Brain Sciences, 33, 6183. https://doi.org/10.1017/S0140525X0999152XCrossRefGoogle ScholarPubMed
Horwitz, E. K., Horwitz, M. B., & Cope, J. (1986). Foreign language classroom anxiety. The Modern Language Journal, 70, 125132. https://doi.org/10.1111/j.1540-4781.1986.tb05256.xCrossRefGoogle Scholar
Housen, A., Kuiken, F., & Vedder, I. (2012). Dimensions of L2 performance and proficiency: Complexity, accuracy and fluency in SLA. John Benjamins.CrossRefGoogle Scholar
Jackson, D. O., & Suethanapornkul, S. (2013). The cognition hypothesis: A synthesis and meta-analysis of research on second language task complexity. Language Learning, 63, 330367. https://doi.org/10.1111/lang.12008CrossRefGoogle Scholar
Keck, C. M., Iberri-Shea, G., Tracy-Ventura, N., & Wa-Mbaleka, S. (2006). Investigating the empirical link between task-based interaction and acquisition. In Norris, J. M. & Ortega, L. (Eds.), Synthesizing research on language learning and teaching (pp.91129). John Benjamins.CrossRefGoogle Scholar
Kim, Y. J. (2011). The role of task-induced involvement and learner proficiency in L2 vocabulary acquisition. Language Learning, 61, 100140. https://doi.org/10.1111/j.1467-9922.2008.00442.xCrossRefGoogle Scholar
Kim, Y. J., Payant, C., & Pearson, P. (2015). The intersection of task-based interaction, task complexity, and working memory. Studies in Second Language Acquisition, 37, 549581. https://doi.org/10.1017/S0272263114000618CrossRefGoogle Scholar
Kormos, J., & Trebits, A. (2012). The role of task complexity, modality, and aptitude in narrative task performance. Language Learning, 62, 439472. https://doi.org/10.1111/j.1467-9922.2012.00695.xCrossRefGoogle Scholar
Kourtali, N. E., & Révész, A. (2020). The roles of recasts, task complexity, and aptitude in child second language development. Language Learning, 70, 179218. https://doi.org/10.1111/lang.12374CrossRefGoogle Scholar
Lai, C., Fei, F., & Roots, R. (2008). The contingency of recasts and noticing. CALICO Journal, 26(1), 7090. https://doi.org/10.1558/cj.v26i1.70-90CrossRefGoogle Scholar
Lam, S. F., & Law, Y. K. (2007). The roles of instructional practices and motivation in writing performance. The Journal of Experimental Education, 75. 145164. https://doi.org/10.3200/JEXE.75.2.145-164CrossRefGoogle Scholar
Larsen-Freeman, D., & Long, M. (1991). An introduction to second language acquisition research. Longman.Google Scholar
Larsson, T., Plonsky, L., Sterling, S., Kytö, M., Yaw, K., & Wood, M. (2023). On the frequency, prevalence, and perceived severity of questionable research practices. Research Methods in Applied Linguistics, 2, 100064. https://doi.org/10.1016/j.rmal.2023.100064CrossRefGoogle Scholar
Lee, A. H., & Lyster, R. (2016). The effects of corrective feedback on instructed L2 speech perception. Studies in Second Language Acquisition, 38, 3564. https://doi.org/10.1017/S0272263115000194CrossRefGoogle Scholar
Leeming, P., & Harris, J. (2022). Self-determination theory and tasks: A motivational framework for TBLT research. TASK, 2, 164183. https://doi.org/10.1075/task.21024.leeCrossRefGoogle Scholar
Li, S. (2016). The construct validity of language aptitude: A meta-analysis. Studies in Second Language Acquisition, 38, 801842. https://doi.org/10.1017/S027226311500042XCrossRefGoogle Scholar
Li, S., Ellis, R., & Zhu, Y. (2019). The associations between cognitive ability and L2 development under five different instructional conditions. Applied Psycholinguistics, 40, 693722. https://doi.org/10.1017/S0142716418000796CrossRefGoogle Scholar
Li, S., Hiver, P., & Papi, M. (2022). The Routledge handbook of second language acquisition and individual differences. Routledge.CrossRefGoogle Scholar
Li, S., & Zhao, H. (2021). The methodology of the research on language aptitude: A systematic review. Annual Review of Applied Linguistics, 41, 2554. https://doi.org/10.1017/S0267190520000136CrossRefGoogle Scholar
Liao, Y., & Zhang, W. (2022). Corrective feedback, individual differences in working memory, and L2 development. Frontiers in Psychology, 13, 811748. https://doi.org/10.3389/fpsyg.2022.811748CrossRefGoogle ScholarPubMed
Linck, J. A., Osthus, P., Koeth, J. T., & Bunting, M. F. (2014). Working memory and second language comprehension and production: A meta-analysis. Psychonomic Bulletin & Review, 21, 861883. https://doi.org/10.3758/s13423-013-0565-2CrossRefGoogle ScholarPubMed
Long, M. H. (2015). Second language acquisition and task-based language teaching. Wiley-Blackwell.Google Scholar
Long, M. H. (2016). In defense of tasks and TBLT: Nonissues and real issues. Annual Review of Applied Linguistics, 36, 533. https://doi.org/10.1017/S0267190515000057CrossRefGoogle Scholar
MacIntyre, P. D., & Gardner, R. C. (1994). The subtle effects of language anxiety on cognitive processing in the second language. Language Learning, 44, 283305. http://doi.org/10.1111/j.1467-1770.1994.tb01103.xCrossRefGoogle Scholar
Mackey, A. (1999). Input, interaction, and second language development. Studies in Second Language Acquisition, 21, 557587. https://doi.org/10.1017/S0272263199004027CrossRefGoogle Scholar
Mackey, A. (2020a). Interaction, feedback and task research in second language learning: Methods and design. Cambridge University Press.CrossRefGoogle Scholar
Mackey, A. (2020b). The Annual Review of Applied Linguistics at 40: Looking back and moving ahead. Annual Review of Applied Linguistics, 40, 18. https://doi.org/10.1017/S0267190520000082CrossRefGoogle Scholar
Mackey, A., Adams, R., Stafford, C., & Winke, P. (2010). Exploring the relationship between modified output and working memory capacity. Language Learning, 60, 501533. https://doi.org/10.1111/j.1467-9922.2010.00565.xCrossRefGoogle Scholar
Mackey, A., & Goo, J. (2007). Interaction research in SLA: A meta-analysis and research synthesis. In Mackey, A. (Ed.), Conversational interaction in second language acquisition: A series of empirical studies (pp. 407453). Oxford University Press.Google Scholar
Mahdavirad, F. (2017). Affective variables in simple vs. complex tasks: A study of EFL learners’ perceptions. International Journal of English Language & Translation Studies, 5, 195200.Google Scholar
Malovrh, P. A., & Benati, A. G. (2018). The handbook of advanced proficiency in second language acquisition. Blackwell Handbooks in Linguistics.CrossRefGoogle Scholar
Marsden, E., Mackey, A., & Plonsky, L. (2015). The IRIS Repository: Advancing research practice and methodology. In Mackey, A. & Marsden, E. (Eds.), Advancing methodology and practice: The IRIS repository of instruments for research into second languages (pp. 121). Taylor and Francis.Google Scholar
Martin, M. M., Myers, S. A., & Mottet, T. P. (1999). Students’ motives for communication with their instructors and affective and cognitive learning. Psychological Reports, 87, 830834. https://doi.org/10.2466/pr0.2000.87.3.830CrossRefGoogle Scholar
McCroskey, J. C., & McCroskey, L. L. (1988). Self-report as an approach to measuring communication competence. Communication Research Reports, 5, 108113. https://doi.org/10.1080/08824098809359810CrossRefGoogle Scholar
McDonough, K., Crawford, W. J., & Mackey, A. (2015). Creativity and EFL students’ language use during a group problem-solving task. TESOL Quarterly, 49, 188199. https://doi.org/10.1002/tesq.211CrossRefGoogle Scholar
Meara, P. & Milton, J. (2003). X_Lex, the Swansea levels test. Express.Google Scholar
Monteiro, K., & Kim, Y. (2020). The effect of input characteristics and individual differences on L2 comprehension of authentic and modified listening tasks. System, 94, 113. https://doi.org/10.1016/j.system.2020.102336CrossRefGoogle Scholar
Morgan-Short, K., Marsden, E., Heil, J., Issa, B., Leow, R. P., Mikhaylova, A., Mikołajczak, S., Moreno, N., Slabakova, R., & Szudarski, P. (2018). Multi-site replication in SLA research: Attention to form during listening and reading comprehension in L2 Spanish. Language Learning, 68, 392437. https://doi.org/10.1111/lang.12292CrossRefGoogle Scholar
Nielson, K. B. (2014). Can planning time compensate for individual differences in working memory capacity? Language Teaching Research, 18, 272293. https://doi.org/10.1177/1362168813510377CrossRefGoogle Scholar
Nikolov, M., & Djigunović, J. M. (2006). Recent research on age, second language acquisition, and early foreign language learning. Annual Review of Applied Linguistics, 26, 234260. https://doi.org/10.1017/S0267190506000122CrossRefGoogle Scholar
Noroozi, M., & Taheri, S. (2022). Task-based language assessment: A compatible approach to assess the efficacy of task-based language teaching vs. present, practice, produce, Cogent Education, 9, 2105775. https://doi.org/10.1080/2331186X.2022.2105775CrossRefGoogle Scholar
Norris, J. M., Brown, J. D., Hudson, T. D., & Bonk, W. (2002). Examinee abilities and task difficulty in task-based second language performance assessment. Language Testing, 19, 395418. https://doi.org/10.1191/0265532202lt237oaCrossRefGoogle Scholar
Norris, J. M., & Ortega, L. (2006). Synthesizing research on language learning and teaching. John Benjamins.CrossRefGoogle Scholar
Ortega, L. (2009). Understanding second language acquisition. Hodder Education.Google Scholar
Papi, M., & Khajavy, H. (2023). Second language anxiety: Construct, effects, and sources. Annual Review of Applied Linguistics, 43, 127139. https://doi.org/10.1017/S0267190523000028CrossRefGoogle Scholar
Park, H. I., Solon, M., Dehghan-Chaleshtori, M. & Ghanbar, H. (2022). Proficiency reporting practices in research on second language acquisition: Have we made any progress? Language Learning, 72, 198236. https://doi.org/10.1111/lang.12475CrossRefGoogle Scholar
Pietri, N. J. M. (2015). The effects of task-based learning on Thai students’ skills and motivation. Asean Journal of Management & Innovation, 3, 7280. https://doi.org/10.14456/ajmi.2015.3Google Scholar
Pipes, A. (2023). Researching creativity in second language acquisition. Taylor & Francis.CrossRefGoogle Scholar
Plonsky, L. (2013). Study quality in SLA: An assessment of designs, analyses, and reporting practices in quantitative L2 research. Studies in Second Language Acquisition, 35, 655687. https://doi.org/10.1017/S0272263113000399CrossRefGoogle Scholar
Plonsky, L. (2015). Statistical power, p values, descriptive statistics, and effect sizes: A “back-to-basics” approach to advancing quantitative methods in L2 research. In Plonsky, L. (Ed.), Advancing quantitative methods in second language research (pp. 2345). Routledge.CrossRefGoogle Scholar
Plonsky, L., & Brown, D. (2015). Domain definition and search techniques in meta-analyses of L2 research (Or why 18 meta-analyses of feedback have different results). Second Language Research, 31, 267278. https://doi.org/10.1177/0267658314536436CrossRefGoogle Scholar
Plonsky, L., & Kim, Y. J. (2016). Task-based learner production: A substantive and methodological review. Annual Review of Applied Linguistics, 36, 7397. https://doi.org/10.1017/S0267190516000015CrossRefGoogle Scholar
Plonsky, L., Marsden, E., Crowther, D., Gass, S. M., & Spinner, P. (2020). A methodological synthesis and meta-analysis of judgment tasks in second language research. Second Language Research, 36, 583621. https://doi.org/10.1177/0267658319828413CrossRefGoogle Scholar
Plonsky, L., & Oswald, F. L. (2015). Meta-analyzing second language research. In Plonsky, L. (Ed.), Advancing quantitative methods in second language research (pp. 106128). Routledge.CrossRefGoogle Scholar
Pyun, D. O. (2013). Attitudes toward task-based language learning: A study of college Korean language learners. Foreign Language Annals, 46, 108121. https://doi.org/10.1111/flan.12015CrossRefGoogle Scholar
Pyun, D. O., Kim, J. S., Cho, H. Y., & Lee, J. H. (2014). Impact of affective variables on Korean as a foreign language learners’ oral achievement. System, 47, 5363. https://doi.org/10.1016/j.system.2014.09.017CrossRefGoogle Scholar
Révész, A. (2009). Task complexity, focus on form, and second language development. Studies in Second Language Acquisition, 31, 437470. https://doi.org/10.1017/S0272263109090366CrossRefGoogle Scholar
Révész, A. (2011). Task complexity, focus on L2 constructions, and individual differences: A classroom-based study. The Modern Language Journal, 95, 162181. https://doi.org/10.1111/j.1540-4781.2011.01241.xCrossRefGoogle Scholar
Révész, A. (2012). Working memory and the observed effectiveness of recasts on different L2 outcome measures. Language Learning, 62, 93132. https://doi.org/10.1111/j.1467-9922.2011.00690.xCrossRefGoogle Scholar
Roberts, L. (2012). Individual differences in second language sentence processing. Language Learning, 62, 172188. https://doi.org/10.1111/j.1467-9922.2012.00711.xCrossRefGoogle Scholar
Robinson, P. (2001). Task complexity, task difficulty, and task production: Exploring interactions in a componential framework. Applied Linguistics, 22, 2757. https://doi.org/10.1093/applin/22.1.27CrossRefGoogle Scholar
Robinson, P. (2005). Cognitive complexity and task sequencing: A review studies in a componential framework for second language task design. International Review of Applied Linguistics in Language Teaching, 43, 133. https://doi.org/10.1515/iral.2005.43.1.1CrossRefGoogle Scholar
Robinson, P. (2011a). Second language task complexity: Researching the cognition hypothesis of language learning and performance. John Benjamins.CrossRefGoogle Scholar
Robinson, P. (2011b). Second language task complexity, the cognition hypothesis, language learning, and performance. In Robinson, P. (Ed.), Second language task complexity: Researching the cognition hypothesis of language learning and performance (pp. 337). John Benjamins.CrossRefGoogle Scholar
Ruan, Y., Duan, X., & Du, X. Y. (2015). Tasks and learner motivation in learning Chinese as a foreign language. Language, Culture and Curriculum, 28, 170190. https://doi.org/10.1080/07908318.2015.1032303CrossRefGoogle Scholar
Sagarra, N. (2007). Working memory and L2 processing of redundant grammatical forms. In Han, Z. (Ed.), Understanding second language process (pp. 133147). Multilingual Matters.CrossRefGoogle Scholar
Sampson, R. (2012). The language-learning self, self-enhancement activities, and self-perceptual change. Language Teaching Research, 16, 317335. https://doi.org/10.1177/1362168812436898CrossRefGoogle Scholar
Samuda, V., & Bygate, M. (2008). Tasks in second language learning. Springer.CrossRefGoogle Scholar
Sasayama, S. (Ed). (2019). Proceedings of the TBLT in Asia 2018 conference. JALT Task-Based Language Teaching Special Interest Group.Google Scholar
Sasayama, S., Malicka, A., & Norris, J. (2018). Cognitive task complexity: A research synthesis and meta-analysis. In Wen, Z. & Ahmadian, M. J. (Eds.) Research L2 task performance and pedagogy: In honour of Peter Skehan (pp. 95132). John Benjamins.Google Scholar
Sato, M., & McDonough, K. (2020). Predicting L2 learners’ noticing of L2 errors: Proficiency, language analytical ability, and interaction mindset. System, 93, 102301. https://doi.org/10.1016/j.system.2020.102301CrossRefGoogle Scholar
Shahnazari, M. (2013). The development of a Persian reading span test for the measure of L1 Persian EFL learners’ working memory capacity. Applied Research on English Language, 2, 107116. https://doi.org/10.22108/ARE.2013.15473Google Scholar
Sheen, Y. (2010). Differential effects of oral and written corrective feedback in the ESL classroom. Studies in Second Language Acquisition, 32, 203234. https://doi.org/10.1017/S0272263109990507CrossRefGoogle Scholar
Shin, J. (2020). A meta-analysis of the relationship between working memory and second language reading comprehension: Does task type matter? Applied Psycholinguistics, 41, 873900. https://doi.org/10.1017/S0142716420000272CrossRefGoogle Scholar
Skehan, P. (1989). Individual differences in second language learning. Routledge.Google Scholar
Skehan, P. (1998a). Task-based instruction. Annual Review of Applied Linguistics, 18, 268286.CrossRefGoogle Scholar
Skehan, P. (1998b). A cognitive approach to language learning. Oxford University Press.Google Scholar
Skehan, P. (2009). Modelling second language performance: Integrating complexity, accuracy, fluency, and lexis. Applied Linguistics, 30, 510532. https://doi.org/10.1093/applin/amp047CrossRefGoogle Scholar
Skehan, P. (2015) Foreign language aptitude and its relationship with grammar: A critical overview. Applied Linguistics, 36, 367384. https://doi.org/10.1093/applin/amu072CrossRefGoogle Scholar
Sparks, R. (2012). Individual differences in L2 learning and long-term L1-L2 relationships. Language Learning, 62, 527. https://doi.org/10.1111/j.1467-9922.2012.00704.xCrossRefGoogle Scholar
Smith, B., & González-Lloret, M. (2021). Technology-mediated task-based language teaching: A research agenda. Language Teaching, 54, 518534. https://doi.org/10.1017/S0261444820000233CrossRefGoogle Scholar
Suzuki, S., Yasuda, T., Hanzawa, K., & Kormos, J. (2022). How does creativity affect second language speech production? The moderating role of speaking task type. TESOL Quarterly, 56, 13201344. https://doi.org/10.1002/tesq.3104CrossRefGoogle Scholar
Taguchi, T., Magid, M. & Papi, M. (2009). The L2 motivational self system among Japanese, Chinese, and Iranian learners of English: A comparative study. In Dörnyei, Z. & Ushioda, E. (Eds.), Motivation, language identity and the L2 self (pp.6697). Multilingual Matters.CrossRefGoogle Scholar
Takahashi, S. (2005). Pragmalinguistic awareness: Is it related to motivation and proficiency? Applied Linguistics, 26, 90120. https://doi.org/10.1093/applin/amh040CrossRefGoogle Scholar
Teimouri, Y., Goetze, J., & Plonsky, L. (2019). Second language anxiety and achievement: A meta-analysis. Studies in Second Language Acquisition, 41, 363387. https://doi.org/10.1017/S0272263118000311CrossRefGoogle Scholar
Torres, J., & Serafini, E. J. (2016). Microevaluating learners’ task-specific motivation in a task-based business Spanish course. Hispania, 99, 289304. https://doi.org/10.1353/hpn.2016.0055CrossRefGoogle Scholar
Trofimovich, P., Ammar, A., & Gatbonton, E. (2007). How effective are recasts? The role of attention, memory, and analytical ability. In Mackey, A. (Ed.), Conversational interaction in second language acquisition: A series of empirical studies (pp. 171195). Oxford University Press.Google Scholar
Troia, G. A., Harbaugh, A. G., Shankland, R. K., Wolbers, K. A., & Lawrence, A. M. (2012). Relationships between writing motivation, writing activity, and writing performance: Effects of grade, sex, and ability. Reading & Writing, 26, 1744. https://doi.org/10.1007/s11145-012-9379-2CrossRefGoogle Scholar
van de Guchte, M., van Batenburg, E., & van Weijen, D. (2022). Enhancing target language output through synchronous online learner-learner interaction:The impact of audio-, video-, and text-chat interaction on learner output and affect. Journal on Task-Based Language Teaching and Learning, 2, 218247. https://doi.org/10.1075/task.21003.gucCrossRefGoogle Scholar
Wang, Q., East, M., & Li, S. (2021). Measuring Chinese EFL learners’ motivation and anxiety when completing a video narration task: Initial steps in designing two questionnaires. System, 100, 102559. https://doi.org/10.1016/j.system.2021.102559CrossRefGoogle Scholar
Wechsler, D. (1987). Wechsler memory scale-revised manual. Psychological Cooperation Inc.Google Scholar
Wen, Z. E. (2016). Working memory and second language learning. Multilingual matters.CrossRefGoogle Scholar
Wen, Z., Biedroń, A., & Skehan, P. (2017). Foreign language aptitude theory: Yesterday, today and tomorrow. Language Teaching, 50, 131. https://doi.org/10.1017/S0261444816000276CrossRefGoogle Scholar
Willis, J. (1996). A framework for task-based learning. Longman.Google Scholar
Yashima, T. (2002). Willingness to communicate in a second language: The Japanese EFL context. The Modern Language Journal, 86, 5466. https://doi.org/10.1111/1540-4781.00136CrossRefGoogle Scholar
Yilmaz, Y., & Granena, G. (2015). The role of cognitive aptitudes for explicit language learning in the relative effects of explicit and implicit feedback. Bilingualism: Language and Cognition, 19, 147161. https://doi.org/10.1017/S136672891400090XCrossRefGoogle Scholar
Yilmaz, Y., & Granena, G. (2019). Cognitive individual differences as predictors of improvement and awareness under implicit and explicit feedback conditions. Modern Language Journal, 103, 686702. https://doi.org/10.1111/modl.12587CrossRefGoogle Scholar
Yilmaz, Y., & Sağdıç, A. (2019). The interaction between inhibitory control and corrective feedback timing. International Journal of Applied Linguistics, 170, 204227. https://doi.org/10.1075/itl.19010.yilCrossRefGoogle Scholar
Yousefi, M. A. (2016). The influence of affective variables on the complexity, accuracy, and fluency in L2 oral production: The contribution of task repetition. Journal of English Language Teaching and Learning, 17, 2548.Google Scholar
Yousefi, M., & Mahmoodi, M. H. (2022). The L2 motivational self‐system: A meta‐analysis approach. International Journal of Applied Linguistics, 32, 274294. https://doi.org/10.1111/ijal.12416CrossRefGoogle Scholar
Xu, J., & Fan, Y. (2021). Task complexity, L2 proficiency and EFL learners’ L1 use in task-based peer interaction. Language Teaching Research, 28, 120. https://doi.org/10.1177/13621688211004633Google Scholar
Zabihi, R., Rezazadeh, M., & Ansari, D. N. (2013). Creativity and learners’ performance on argumentative and narrative written tasks. The Journal of Asia TEFL, 10, 6993.Google Scholar
Zalbidea, J., & Sanz, C. (2020). Does learner cognition count on modality? Working memory and L2 morphosyntactic achievement across oral and written tasks. Applied Psycholinguistics, 41, 11711196. https://doi.org/10.1017/S0142716420000442CrossRefGoogle Scholar
Zareinajad, M., Rezaei, M., & Shokrpour, N. (2015). The effects of receptive and productive task-based listening activities on the listening ability of Iranian EFL learners at different proficiency levels. Pertanika Journal Social Sciences & Humanities, 23, 537552.Google Scholar
Zhu, Y. (2017). Who support open access publishing? Gender, discipline, seniority and other factors associated with academics’ OA practice. Scientometrics, 111, 557579. https://doi.org/10.1007/s11192-017-2316-zCrossRefGoogle ScholarPubMed
Ziegler, N. (2016). Taking technology to task: Technology-mediated TBLT, performance, and production. Annual Review of Applied Linguistics, 36, 136163. https://doi.org/10.1017/S0267190516000039CrossRefGoogle Scholar
Figure 0

Table 1. Studies of Individual Differences in TBLT from 2000 to 2023

Figure 1

Table 2. Studies of individual differences in TBLT across journals

Figure 2

Table 3. Coding Scheme Summary

Figure 3

Table 4. Study context characteristics

Figure 4

Table 5. Participant characteristics

Figure 5

Figure 1. Countries represented by included studies.Note: The size of the dots represents the number of studies in that region.

Figure 6

Table 6. Research variables

Figure 7

Table 7. Instruments used for investigating motivation in task-based research

Figure 8

Table 8. Instruments used for investigating working memory in task-based research

Figure 9

Table 9. Instruments used for investigating L2 proficiency in task-based research

Figure 10

Table 10. Instruments used for investigating anxiety in task-based research

Figure 11

Table 11. Instruments used for investigating aptitude in task-based research

Figure 12

Table 12. Design and task types

Figure 13

Table 13. Statistical analyses and coding practices

Figure 14

Figure 2. Open Science practices in TBLT ID research over time.