Hostname: page-component-cd9895bd7-dk4vv Total loading time: 0 Render date: 2024-12-24T03:13:17.093Z Has data issue: false hasContentIssue false

What are language learners looking for in a collocation consultation system? Identifying collocation look-up patterns with user query data

Published online by Cambridge University Press:  27 April 2021

Shaoqun Wu
Affiliation:
University of Waikato, New Zealand ([email protected])
Alannah Fitzgerald
Affiliation:
University of Waikato, New Zealand ([email protected])
Alex Yu
Affiliation:
Centre for Business, Information Technology and Enterprise, Wintec, New Zealand ([email protected])
Zexuan Chen
Affiliation:
Southern Medical University, China ([email protected])

Abstract

Corpus consultation with concordancers has been recognized as a promising way for learners to study and explore language features such as collocations at their own pace and in their own time. This study examined 1.5 million search queries sent to a collocation consultation tool called FlaxCLS (Flexible Language Acquisition Collocation Learning System; http://flax.nzdl.org) over a period of two years to identify learners’ collocation look-up patterns. This paper examines and characterizes learners’ look-up patterns as they entered search queries, clicked on the query formation aids provided by the system, and navigated through the different levels of collocation information returned by the system to support collocation learning. We looked at how learners formulated query terms, and we analyzed the characteristics of query words learners entered, the characteristics of collocations they preferred, and the sample sentences they checked. Our collocation look-up pattern analyses, similar to traditional user query analyses of the web, provide interesting and revealing insights that are hard to obtain from small-scale user studies. The findings provide valuable information and pedagogical implications for data-driven learning (DDL) researchers and language teachers in designing tailored collocation consultation systems and activities. This paper also presents multidimensional analyses of learner query data, which, to the best of our knowledge, have not been explored in DDL research.

Type
Research Article
Copyright
© The Author(s), 2021. Published by Cambridge University Press on behalf of European Association for Computer Assisted Language Learning

Access options

Get access to the full version of this content by using one of the access options below. (Log in options will check for institutional or personal access. Content may require purchase if you do not have access.)

References

Aktas, R. N. & Cortes, V. (2008) Shell nouns as cohesive devices in published and ESL student writing. Journal of English for Academic Purposes, 7(1): 314. https://doi.org/10.1016/j.jeap.2008.02.002 CrossRefGoogle Scholar
Biber, D., Gray, B. & Poonpon, K. (2011) Should we use characteristics of conversation to measure grammatical complexity in L2 writing development? TESOL Quarterly, 45(1): 535. https://doi.org/10.5054/tq.2011.244483 CrossRefGoogle Scholar
Boulton, A. & Cobb, T. (2017) Corpus use in language learning: A meta-analysis. Language Learning, 67(2): 348393. https://doi.org/10.1111/lang.12224 CrossRefGoogle Scholar
Charles, M. (2014) Getting the corpus habit: EAP students’ long-term use of personal corpora. English for Specific Purposes, 35: 3040. https://doi.org/10.1016/j.esp.2013.11.004 CrossRefGoogle Scholar
Chambers, A. (2007) Popularising corpus consultation by language learners and teachers. In Hidalgo, E., Quereda, L. & Santana, J. (eds.), Corpora in the foreign language classroom: Selected papers from the Sixth International Conference on Teaching and Language Corpora (TaLC 6): University of Granada, Spain, 4-7 July, 2004. Amsterdam: Rodopi, 316.Google Scholar
Chambers, A. & O’Sullivan, Í. (2004) Corpus consultation and advanced learners’ writing skills in French. ReCALL, 16(1): 158172. https://doi.org/10.1017/S0958344004001211 CrossRefGoogle Scholar
Chan, T. & Liou, H.-C. (2005) Effects of web-based concordancing instruction on EFL students’ learning of verb–noun collocations. Computer Assisted Language Learning, 18(3): 231251. https://doi.org/10.1080/09588220500185769 CrossRefGoogle Scholar
Chen, H.-J. H. (2011) Developing and evaluating a web-based collocation retrieval tool for EFL students and teachers. Computer Assisted Language Learning, 24(1): 5976. https://doi.org/10.1080/09588221.2010.526945 CrossRefGoogle Scholar
Cobb, T. (1997) Is there any measurable learning from hands-on concordancing? System, 25(3): 301315. https://doi.org/10.1016/S0346-251X(97)00024-9 CrossRefGoogle Scholar
Coxhead, A. (2000) A new academic word list. TESOL Quarterly, 34(2): 213238. https://doi.org/10.2307/3587951 CrossRefGoogle Scholar
Crosthwaite, P., Wong, L. L. C. & Cheung, J. (2019) Characterising postgraduate students’ corpus query and usage patterns for disciplinary data-driven learning. ReCALL, 31(3): 255275. https://doi.org/10.1017/S0958344019000077 CrossRefGoogle Scholar
Daskalovska, N. (2015) Corpus-based versus traditional learning of collocations. Computer Assisted Language Learning, 28(2): 130144. https://doi.org/10.1080/09588221.2013.803982 CrossRefGoogle Scholar
Dechert, H. W. (1984) Second language production: Six hypotheses. In Dechert, H. W., Möhle, D. & Raupach, M. (eds.), Second language productions. Tübingen: Gunter Narr Verlag, 211230.Google Scholar
Frankenberg-Garcia, A. (2005) A peek into what today’s language learners as researchers actually do. International Journal of Lexicography, 18(3): 335355. https://doi.org/10.1093/ijl/eci015 CrossRefGoogle Scholar
Gaskell, D. & Cobb, T. (2004) Can learners use concordance feedback for writing errors? System, 32(3): 301319. https://doi.org/10.1016/j.system.2004.04.001 CrossRefGoogle Scholar
Hafner, C. A. & Candlin, C. N. (2007) Corpus tools as an affordance to learning in professional legal education. Journal of English for Academic Purposes, 6(4): 303318. https://doi.org/10.1016/j.jeap.2007.09.005 CrossRefGoogle Scholar
Halliday, M. A. K. (1993) Some grammatical problems in scientific English. In Halliday, M. A. K. & Martin, J. R. (eds.), Writing science: Literacy and discursive power. London: The Falmer Press, 6985.Google Scholar
Horst, M., Cobb, T. & Nicolae, I. (2005) Expanding academic vocabulary with an interactive on-line database. Language Learning & Technology, 9(2): 90110. https://doi.org/10125/44021 Google Scholar
Jansen, B. J., Spink, A. & Saracevic, T. (2000) Real life, real users, and real needs: A study and analysis of user queries on the web. Information Processing & Management, 36(2): 207227. https://doi.org/10.1016/S0306-4573(99)00056-4 CrossRefGoogle Scholar
Johns, T. (1991) Should you be persuaded: Two examples of data-driven learning. English Language Research Journal, 4: 116.Google Scholar
Johns, T. (1997) Contexts: The background, development and trialling of a concordance-based CALL program. In Wichmann, A., Fligelstone, S., McEnery, T. & Knowles, G. (eds.), Teaching and language corpora. Harlow: Addison Wesley Longman, 110115.Google Scholar
Kennedy, C. & Miceli, T. (2017) Cultivating effective corpus use by language learners. Computer Assisted Language Learning, 30(1–2): 91114. https://doi.org/10.1080/09588221.2016.1264427 CrossRefGoogle Scholar
Lewis, M. (2008) Implementing the lexical approach: Putting theory into practice. London: Heinle Cengage Learning.Google Scholar
Li, Y., Zheng, Z. & Dai, H. K. (2005) KDD cup-2005 report: Facing a great challenge. ACM SIGKDD Explorations Newsletter, 7(2): 9199. https://doi.acm.org/10.1145/1117454.1117466 CrossRefGoogle Scholar
Liu, L. (2002) A corpus-based lexical semantic investigation of verb-noun miscollocations in Taiwan learners’ English. Tamkang University, Taipei, unpublished master’s thesis.Google Scholar
Lu, X. (2011) A corpus-based evaluation of syntactic complexity measures as indices of college-level ESL writers’ language development. TESOL Quarterly, 45(1): 3662. https://doi.org/10.5054/tq.2011.240859 CrossRefGoogle Scholar
Nesselhauf, N. (2003) The use of collocations by advanced learners of English and some implications for teaching. Applied Linguistics, 24(2): 223242. https://doi.org/10.1093/applin/24.2.223 CrossRefGoogle Scholar
Park, K. (2012) Learner–corpus interaction: A locus of microgenesis in corpus-assisted L2 writing. Applied Linguistics, 33(4): 361385. https://doi.org/10.1093/applin/ams012 CrossRefGoogle Scholar
Park, K. & Kinginger, C. (2010) Writing/thinking in real time: Digital video and corpus query analysis. Language Learning & Technology, 14(3): 3150. https://doi.org/10125/44225 Google Scholar
Parkinson, J. & Musgrave, J. (2014) Development of noun phrase complexity in the writing of English for academic purposes students. Journal of English for Academic Purposes, 14: 4859. https://doi.org/10.1016/j.jeap.2013.12.001 CrossRefGoogle Scholar
Pérez-Paredes, P., Sánchez-Tornel, M., Alcaraz Calero, J. M. & Jiménez, P. A. (2011) Tracking learners’ actual uses of corpora: Guided vs non-guided corpus consultation. Computer Assisted Language Learning, 24(3): 233253. https://doi.org/10.1080/09588221.2010.539978 CrossRefGoogle Scholar
Ross, N. C. M. & Wolfram, D. (2000) End user searching on the internet: An analysis of term pair topics submitted to the Excite search engine. Journal of the American Society for Information Science, 51(10): 949958. https://doi.org/10.1002/1097-4571(2000)51:10<949:AID-ASI70>3.0.CO;2-5 3.0.CO;2-5>CrossRefGoogle Scholar
Tribble, C. (2015) Teaching and language corpora: Perspectives from a personal journey. In Leńko-Szymańska, A. & Boulton, A. (eds.), Multiple affordances of language corpora for data-driven learning. Amsterdam: John Benjamins, 3762. https://doi.org/10.1075/scl.69.03tri Google Scholar
Vyatkina, N. (2016) Data-driven learning of collocations: Learner performance, proficiency, and perceptions. Language Learning & Technology, 20(3): 159179. https://doi.org/10125/44487 Google Scholar
Wu, S., Fitzgerald, A., Yu, A. & Witten, I. (2019) Developing and evaluating a learner-friendly collocation system with user query data. International Journal of Computer-Assisted Language Learning and Teaching, 9(2): 5378. https://doi.org/10.4018/ijcallt.2019040104 CrossRefGoogle Scholar
Wu, S., Franken, M. & Witten, I. H. (2009) Refining the use of the web (and web search) as a language teaching and learning resource. Computer Assisted Language Learning, 22(3): 249268. https://doi.org/10.1080/09588220902920250 CrossRefGoogle Scholar
Wu, S., Li, L., Witten, I. H. & Yu, A. (2016) Constructing a collocation learning system from the Wikipedia corpus. International Journal of Computer-Assisted Language Learning and Teaching (IJCALLT), 6(3): 1835. https://doi.org/10.4018/IJCALLT.2016070102 CrossRefGoogle Scholar
Xie, K., Yu, H. & Cen, R. (2012) Using log mining to analyze user behavior on search engine. Frontiers of Electrical and Electronic Engineering, 7: 254260. https://doi.org/10.1007/s11460-011-0177-4 Google Scholar
Yoon, H. (2008) More than a linguistic reference: The influence of corpus technology on L2 academic writing. Language Learning & Technology, 12(2): 3148. https://doi.org/10125/44142 Google Scholar