Hostname: page-component-78c5997874-g7gxr Total loading time: 0 Render date: 2024-11-19T13:30:55.117Z Has data issue: false hasContentIssue false
  • English
  • Français

Effects of using machine translation to mediate the revision process of Korean university students’ academic writing

Published online by Cambridge University Press:  11 September 2020

Sangmin-Michelle Lee Open the ORCID record for Sangmin-Michelle Lee [Opens in a new window]  and
Neil Briggs Open the ORCID record for Neil Briggs [Opens in a new window]
Sangmin-Michelle Lee
Affiliation:
Kyung Hee University, Korea ([email protected])
Neil Briggs
Affiliation:
Independent researcher, Canada ([email protected])
Get access Rights & Permissions [Opens in a new window]

Abstract

In recent years, marked gains in the accuracy of machine translation (MT) outputs have greatly increased its viability as a tool to support the efforts of English as a foreign language (EFL) students to write in English. This study examines error corrections made by 58 Korean university students by comparing their original L2 texts to that of MT outputs. Based on the results of the error analysis, the error types were categorized into 12 categories. Students were divided into three distinctive groups to determine differences among them according to the frequency of errors in their writing. The t-test results reveal that the numbers of errors significantly decreased in the revised versions for most of the error types among all groups. The results of the regression analysis also reveal a positive correlation relationship between the number of changes and the reduction of errors. However, the results also indicate that although all groups made error corrections at similar rates, students who less frequently committed errors in their L2 texts (higher language proficiency groups) generally tended to correct a higher proportion of errors. Based on the findings, pedagogical implications are discussed regarding how EFL teachers can effectively incorporate MT into the classroom.

Keywords

machine translationL2 writingrevision processerror analysis
Type
Regular papers
Information
ReCALL , Volume 33 , Issue 1 , January 2021 , pp. 18 - 33
Check for updates
Copyright
© The Author(s), 2020. Published by Cambridge University Press on behalf of European Association for Computer Assisted Language Learning

Access options

Get access to the full version of this content by using one of the access options below. (Log in options will check for institutional or personal access. Content may require purchase if you do not have access.)

References

Alhaisoni, E. & Alhaysony, M. (2017) An investigation of Saudi EFL university students’ attitudes towards the use of Google Translate. International Journal of English Language Education, 5(1): 72–82. https://doi.org/10.5296/ijele.v5i1.10696 Google Scholar
Andujar, A. (2016) Benefits of mobile instant messaging to develop ESL writing. System, 62: 63–76. https://doi.org/10.1016/j.system.2016.07.004 CrossRefGoogle Scholar
Back, J. (2011) Preposition errors in writing and speaking by Korean EFL learners: A corpus-based approach. Studies in British and American Language and Literature, 99: 227–247.Google Scholar
Bahri, H. & Mahadi, T. S. T. (2016) Google Translate as a supplementary tool for learning Malay: A case study at Universiti Sains Malaysia. Advances in Language and Literary Studies, 7(3): 161–167. https://doi.org/10.7575/aiac.alls.v.7n.3p.161 Google Scholar
Baraniello, V., Degano, C., Laura, L., Zahonero, M. L., Naldi, M. & Petroni, S. (2016) A wiki-based approach to computer-assisted translation for collaborative language learning. In Li, Y., Chang, M., Kravcik, M., Popescu, E., Huang, R., Kinshuk & Chen, N.-S. (eds.), State-of-the-art and future directions of smart learning. Singapore: Springer, 369–379. https://doi.org/10.1007/978-981-287-868-7_45 CrossRefGoogle Scholar
Bernardini, S. (2016) Discovery learning in the language for translation classroom. Cadernos de Tradução, 36: 14–35. https://doi.org/10.5007/2175-7968.2016v36nesp1p14 CrossRefGoogle Scholar
Bitchener, J., Young, S. & Cameron, D. (2005) The effect of different types of corrective feedback on ESL student writing. Journal of Second Language Writing, 14(3): 191–205. https://doi.org/10.1016/j.jslw.2005.08.001 CrossRefGoogle Scholar
Bowker, L. & Ciro, J. B. (2019) Machine translation and global research: Towards improved machine translation literacy in the scholarly community. Bingley: Emerald Publishing. https://doi.org/10.1108/9781787567214 CrossRefGoogle Scholar
Briggs, N. (2018) Neural machine translation tools in the language learning classroom: Students’ use, perceptions, and analyses. The JALT CALL Journal, 14(1): 3–24. https://doi.org/10.29140/jaltcall.v14n1.221 CrossRefGoogle Scholar
Bruton, A. (2009) Improving accuracy is not the only reason for writing, and even if it were … System, 37(4): 600–613. https://doi.org/10.1016/j.system.2009.09.005 CrossRefGoogle Scholar
Correa, M. (2014) Leaving the “peer” out of peer-editing: Online translators as a pedagogical tool in the Spanish as a second language classroom. Latin American Journal of Content & Language Integrated Learning, 7(1): 1–20. https://doi.org/10.5294/laclil.2014.7.1.1 CrossRefGoogle Scholar
Crossely, S. A. (2018) Technological disruption in foreign language teaching: The rise of simultaneous machine translation. Language Teaching, 51(4): 541–552. https://doi.org/10.1017/S0261444818000253 CrossRefGoogle Scholar
Ducar, C. & Schocket, D. H. (2018) Machine translation and the L2 classroom: Pedagogical solutions for making peace with Google translate. Foreign Language Annals, 51(4): 779–795. https://doi.org/10.1111/flan.12366 CrossRefGoogle Scholar
Ferris, D. (2010) Second language writing research and written corrective feedback in SLA: Intersections and practical applications. Studies in Second Language Acquisition, 32(2): 181–201. https://doi.org/10.1017/S0272263109990490 CrossRefGoogle Scholar
Ferris, D. R. (2011) Treatment of error in second language student writing (2nd ed.). Ann Arbor: University of Michigan Press. https://doi.org/10.3998/mpub.2173290 CrossRefGoogle Scholar
Ferris, D. R. & Hedgcock, J. S. (2011) Teaching ESL composition: Purpose, process, and practice (2nd ed.). New York: Routledge.Google Scholar
Ferris, D., Liu, H. & Rabie, B. (2011) The job of teaching writing: Teacher views of responding to writing. Writing & Pedagogy, 3(1): 39–77. https://doi.org/10.1558/wap.v3i1.39 CrossRefGoogle Scholar
Ferris, D. & Roberts, B. (2001) Error feedback in L2 writing classes. How explicit does it need to be? Journal of Second Language Writing, 10(3): 161–184. https://doi.org/10.1016/S1060-3743(01)00039-X CrossRefGoogle Scholar
Fredholm, K. (2015) Online translation use in Spanish as a foreign language essay writing: Effects on fluency, complexity and accuracy. Revista Nebrija de Lingüística Aplicada a la Enseñanza de Lenguas, 2015(18): 7–24. https://www.nebrija.com/revista-linguistica/files/articulosPDF/articulo_54ff41bcb4d19.pdf Google Scholar
Fredholm, K. (2019) Effects of Google Translate on lexical diversity: Vocabulary development among learners of Spanish as a foreign language. Revista Nebrija de Lingüística Aplicada a la Enseñanza de las Lenguas, 13(26): 98–117. https://doi.org/10.26378/rnlael1326300 Google Scholar
Garcia, I. & Peña, M. I. (2011) Machine translation-assisted language learning: Writing for beginners. Computer Assisted Language Learning, 24(5): 471–487. https://doi.org/10.1080/09588221.2011.582687 CrossRefGoogle Scholar
Goodwin-Jones, R. (2015) Contributing, creating, curating: Digital literacies for language learners. Language Learning & Technology, 19(3): 8–20. http://llt.msu.edu/issues/october2015/emerging.pdf Google Scholar
Göpferich, S. (2017) Cognitive functions of translation in L2 writing. In Schwieter, J. W. & Ferreira, A. (eds.), The handbook of translation and cognition. Hoboken: Wiley, 402–422. https://doi.org/10.1002/9781119241485.ch22 CrossRefGoogle Scholar
Goulet, M.-J., Simard, M., Parra Escartín, C. & O’Brien, S. (2017) Using machine translation for academic writing in English as a second language: Results of an exploratory study on linguistic quality. ASp: la revue du GERAS, 72: 5–28. https://doi.org/10.4000/asp.5045 CrossRefGoogle Scholar
Han, Y. & Hyland, F. (2015) Exploring learner engagement with written corrective feedback in a Chinese tertiary EFL classroom. Journal of Second Language Writing, 30: 31–44. https://doi.org/10.1016/j.jslw.2015.08.002 CrossRefGoogle Scholar
Im, H.-J. (2017) The university students’ perceptions or attitudes on the use of the English automatic translation in a general English class: Based on English writing lessons. Korean Journal of General Education, 11(6): 727–751.Google Scholar
Kim, E.-Y. (2011) Using translation exercises in the communicative EFL writing classroom. ELT Journal, 65(2): 154–160. https://doi.org/10.1093/elt/ccq039 CrossRefGoogle Scholar
Kim, S. (2019) Playing with machine translation in language classroom: Affordances and constraints. Multimedia-Assisted Language Learning, 22(2): 9–28.Google Scholar
Kim, Y. & Yoon, H. (2014) The use of L1 as a writing strategies L2 writing tasks. GEMA Online Journal of Language Studies, 14(3): 33–50. https://doi.org/10.17576/GEMA-2014-1403-03 CrossRefGoogle Scholar
Koehn, P. & Knowles, R. (2017, August) Six challenges for neural machine translation. In Luong, T., Birch, A., Neubig, G. & Finch, A. (eds.), Proceedings of the First Workshop on Neural Machine Translation. Stroudsburg: Association for Computational Linguistics, 28–39. https://www.aclweb.org/anthology/W17-3204/ CrossRefGoogle Scholar
Kol, S., Schcolnik, M. & Spector-Cohen, E. (2018) Google Translate in academic writing courses? The EUROCALL Review, 26(2): 50–57. https://doi.org/10.4995/eurocall.2018.10140 CrossRefGoogle Scholar
Lee, S. (2014) Grammatical error patterns in EFL students’ writing across different language proficiency levels. Foreign Languages Education, 21(1): 1–29. https://www.earticle.net/Article/A236564 CrossRefGoogle Scholar
Lee, S.-M. (2020) The impact of using machine translation on EFL students’ writing. Computer Assisted Language Learning, 33(3): 157–175. https://doi.org/10.1080/09588221.2018.1553186 CrossRefGoogle Scholar
Lewis-Kraus, G. (2016, December 14) The great A.I. awakening. The New York Times. https://www.nytimes.com/2016/12/14/magazine/the-great-ai-awakening.html Google Scholar
Liu, Y. (2009) Translation in second language writing: Exploration of cognitive process of translation. Saarbrucken: VDM Verlag.Google Scholar
Min, H.-T. (2006) The effects of trained peer review on EFL students’ revision types and writing quality. Journal of Second Language Writing, 15(2): 118–141. https://doi.org/10.1016/j.jslw.2006.01.003 Google Scholar
Nassaji, H. (2011) Correcting students’ written grammatical errors: The effects of negotiated versus nonnegotiated feedback. Studies in Second Language Learning and Teaching, 1(3): 315–334. https://doi.org/10.14746/ssllt.2011.1.3.2 CrossRefGoogle Scholar
Niño, A. (2008) Evaluating the use of machine translation post-editing in the foreign language class. Computer Assisted Language Learning, 21(1): 29–49. https://doi.org/10.1080/09588220701865482 CrossRefGoogle Scholar
O’Brien, S., Simard, M. & Goulet, M.-J. (2018) Machine translation and self-post-editing for academic writing support: Quality explorations. In Moorkens, J., Castilho, S., Gaspari, F. & Doherty, S. (eds.) Translation quality assessment: From principles to practice. Cham: Springer, 237–262. https://doi.org/10.1007/978-3-319-91241-7_11 CrossRefGoogle Scholar
O’Neill, E. M. (2016) Measuring the impact of online translation on FL writing scores. IALLT Journal of Language Learning Technologies, 46(2): 1–39. https://doi.org/10.17161/iallt.v46i2.8560 CrossRefGoogle Scholar
Osman, A. (2017) Definition of translation. Translation Journal, 20(4). https://translationjournal.net/October-2017/definition-of-translation.html Google Scholar
Pae, T.-I. (2008) A structural model for Korean EFL students’ writing performance. English Teaching, 63(2): 121–137. https://doi.org/10.15858/engtea.63.2.200806.121 Google Scholar
Qi, D. S. & Lapkin, S. (2001) Exploring the role of noticing in a three-stage second language writing task. Journal of Second Language Writing, 10(4): 277–303. https://doi.org/10.1016/S1060-3743(01)00046-7 CrossRefGoogle Scholar
Shadiev, R., Sun, A. & Huang, Y.-M. (2019) A study of the facilitation of cross-cultural understanding and intercultural sensitivity using speech-enabled language translation technology. British Journal of Educational Technology, 50(3): 1415–1433. https://doi.org/10.1111/bjet.12648 CrossRefGoogle Scholar
Sheen, Y. (2007) The effect of focused written corrective feedback and language aptitude on ESL learners’ acquisition of articles. TESOL Quarterly, 41(2): 255–283. https://doi.org/10.1002/j.1545-7249.2007.tb00059.x CrossRefGoogle Scholar
Song, J. J. (2006) The Korean language: Structure, use and context. London: Routledge. https://doi.org/10.4324/9780203390825 CrossRefGoogle Scholar
Stapa, S. H. & Majid, A. H. A. (2012) The use of first language in developing ideas in second language writing. American Journal of Social Issues & Humanities, 2(3): 148–151.Google Scholar
Stapleton, P. & Kin, B. L. K. (2019) Assessing the accuracy and teachers’ impressions of Google Translate: A study of primary L2 writers in Hong Kong. English for Specific Purposes, 56: 18–34. https://doi.org/10.1016/j.esp.2019.07.001 CrossRefGoogle Scholar
Sun, D. (2017) Application of post-editing in foreign language teaching: Problems and challenges. Canadian Social Science, 13(7): 1–5. https://doi.org/10.3968/9698 Google Scholar
Truscott, J. (2009) Arguments and appearances: A response to Chandler. Journal of Second Language Writing, 18(1): 59–60. https://doi.org/10.1016/j.jslw.2008.09.001 CrossRefGoogle Scholar
Tsai, S.-C. (2019) Using Google Translate in EFL drafts: A preliminary investigation. Computer Assisted Language Learning, 32(5/6): 510–526. https://doi.org/10.1080/09588221.2018.1527361 CrossRefGoogle Scholar
Van Praag, B. & Sanchez, H. S. (2015) Mobile technology in second language classrooms: Insights into its uses, pedagogical implications, and teacher beliefs. ReCALL, 27(3): 288–303. https://doi.org/10.1017/S0958344015000075 CrossRefGoogle Scholar
Vygotsky, L. S. (1978) Mind in society: The development of higher psychological processes. Cambridge, MA: Harvard University Press.Google Scholar
Waller, L. & Papi, M. (2017) Motivation and feedback: How implicit theories of intelligence predict L2 writers’ motivation and feedback orientation. Journal of Second Language Writing, 35: 54–65. https://doi.org/10.1016/j.jslw.2017.01.004 CrossRefGoogle Scholar
Wang, W. & Wen, Q. (2002) L1 use in the L2 composing process: An exploratory study of 16 Chinese EFL writers. Journal of Second Language Writing, 11(3): 225–246. https://doi.org/10.1016/S1060-3743(02)00084-X CrossRefGoogle Scholar
Yang, Y. & Wang, X. (2019) Modeling the intention to use machine translation for student translators: An extension of technology acceptance model. Computers & Education, 133: 116–126. https://doi.org/10.1016/j.compedu.2019.01.015 CrossRefGoogle Scholar