Hostname: page-component-cd9895bd7-7cvxr Total loading time: 0 Render date: 2024-12-24T16:06:22.441Z Has data issue: false hasContentIssue false
  • English
  • Français

Website analysis in an EFL context: content comprehension, perceptions on web usability and awareness of reading strategies

Published online by Cambridge University Press:  19 May 2014

Debopriyo Roy  and
Stephen Crabbe
Debopriyo Roy
Affiliation:
University of Aizu Aizu-Wakamatsu CityJapan (email: [email protected]
Stephen Crabbe
Affiliation:
University of Portsmouth, UK (email: [email protected]
Get access Rights & Permissions [Opens in a new window]

Abstract

Website analysis is an interdisciplinary field of inquiry that focuses on both digital literacy and language competence (Brugger, 2009). Website analysis in an EFL learning context has the potential to facilitate logical thinking and in the process develop functional language proficiency. This study reported on an English language website (http://www.travelbelize.org/) analysis experiment carried out for three weeks as an in-class and homework activity in a third year (junior) level English as a Foreign Language (EFL) course at a Japanese technical university. The purpose was to explore EFL learners’ ability to analyze an English language website and produce concrete design responses in English. During the first week of the analysis (involving sixteen students selected due to performing the best during earlier in-class website analysis activities on the course), participants produced their own responses to eight open-ended design questions about the website. The second week of the analysis (involving all 59 students on the course) tested the students’ ability to search for information from the website, and recorded their impressions about the website design based on standard usability questionnaires (CSUQ, QUIS, and MPRC). The third week of the analysis had the 59 students self-report on their use of meta-cognitive reading strategies (MARSI 1.0 Questionnaire) during the website analysis. The results of the questionnaires showed that, overall, the EFL students had a basic understanding of major design questions related to information organization, screen interface design, audience, technology used, etc. However, there was statistically significant variability between responses in different groups (comprehensive evaluation, webpage design, terminology and website information and website capabilities) and the respondents were not unanimous in their impressions about the website. The result of the student self-reports on metacognitive reading strategies showed wide acceptability and use of problem-solving strategies.

Keywords

Website analysisdesignEFLcomputer-assisted language learning (CALL)
Type
Regular papers
Information
ReCALL , Volume 27 , Issue 2 , May 2015 , pp. 131 - 155
Copyright
Copyright © European Association for Computer Assisted Language Learning 2014 

Access options

Get access to the full version of this content by using one of the access options below. (Log in options will check for institutional or personal access. Content may require purchase if you do not have access.)

References

Abeleto. (2002) Objective Evaluation of Likely Usability Hazards – Preliminaries for User Testing. Abeleto: Objectives Evaluation of a Website. http://www.abeleto.nl/resources/articles/objective1.htmlGoogle Scholar
Atherton, J. S. (2002) Learning and teaching: Deep and surface learning. http://www.dmu.ac.uk/*jamesa/learning/deepsurf.htmGoogle Scholar
Benedek, J. and Miner, T. (2002) Measuring desirability: New methods for evaluating desirability in a usability lab setting. Proceedings of UPA 2002 Conference, Orlando, FL, July 8–12, 2002.Google Scholar
Block, E. (1986) The comprehension strategies of second language readers. TESOL Quarterly, 20: 463–494.Google Scholar
Brown, A. L. (1978) Knowing when, where, and how to remember: A problem of metacognition. In: Glaser, R. (ed.) Advances in instructional psychology. Vol. 1. Hillsdale: Erlbaum, 77–165.Google Scholar
Brown, A. L. (1994) The advancement of learning. Educational Researcher, 23(8): 4–12.Google Scholar
Brugger, N. (2009) Website history and the website as an object of study. New Media Society, 11(1-2): 115–132.CrossRefGoogle Scholar
Bunz, U. (2001) Usability and gratifications–Towards a website analysis model. Presented at the National Communication Association Convention, Atlanta, GA.Google Scholar
Carrell, P. L. (1983) Three Components of Background Knowledge in Reading Comprehension. Language Learning, 33(2): 183–203.Google Scholar
Chun, D. M. (2001) L2 reading on the web: Strategies for accessing information in hypermedia. Computer Assisted Language Learning, 14(5): 367–403.Google Scholar
Chuo, T. I. (2007) The Effects of the WebQuest Writing Instruction Program on EFL Learners' Writing Performance, Writing Apprehension, and Perception. TESL-EJ, 11(3): 1–27.Google Scholar
Churchill, N., Ping, L. C., Oakley, G. and Churchill, D. (2008) Digital storytelling and digital literacy Learning. Proceedings of ICICTE 2008. Corfu, Greece, 418–430.Google Scholar
Collins, A., Brown, J. and Newman, S. (1989) Cognitive apprenticeship: teaching the crafts of reading, writing, and mathematics. In: Resnick, L. (ed.) Knowing, learning, and instruction. Hillsdale, HJ: Lawrence Erlbaum, 453–494.Google Scholar
Dalal, N. P., Quible, Z. and Wyatt, K. (2000) Cognitive design of home pages: an experimental study of comprehension on the World Wide Web. Information Processing and Management, 36: 607–621.Google Scholar
Davern, M. J., Te'eni, D. and Moon, J. (2000) Content versus structure in information environments: A longitudinal analysis of website preferences. Twenty-First International Conference on Information Systems, Brisbane, Australia.Google Scholar
Day, R. and Bamford, J. (1998) Extensive reading in the second language classroom. Cambridge: Cambridge University Press.CrossRefGoogle Scholar
Dhieb-Henia, N. (2003) Evaluating the effectiveness of metacognitive strategy training for reading research articles in an ESP context. English for Specific Purposes, 22(4): 387–417.Google Scholar
Elling, S., Lentz, L. and de Jong, M. (2012) Users’ Abilities to Review Website Pages. Journal of Business and Technical Communication. 1–31.Google Scholar
Ennis, R. H. and Millman, J. (1985) Cornell critical thinking test, level X.. Pacific Grove, CA: Midwest Publications.Google Scholar
Gehrke, D. and Turban, E. (1999 Determinants of Successful Website Design: Relative Importance and Recommendations for Effectiveness. Proceedings of the 32nd Hawaii International Conference on System Sciences. Hawaii, USA.Google Scholar
Hruschka, D., Cummings, B., Cobb St. John, D., Moore, J., Khumalo-Sakutukwa, G. and Carey, J. W. (2004) Fixed-choice and open-ended response formats: A comparison from HIV Prevention Research in Zimbabwe. Field Methods, 16: 184–202.Google Scholar
Hughes, J., McAvinia, C. and King, T. (2004) What really makes students like a website? What are the implications for designing web-based language learning sites? ReCALL, 16(1): 85–102.Google Scholar
Kern, V. M., Saraiva, L. M. and Pacheco, R. C. S. (2003) Peer review in education: promoting collaboration, written expression, critical thinking, and professional responsibility. Education and Information Technologies, 8(1): 37–46.CrossRefGoogle Scholar
Kitchener, K. S. and King, P. M. (1981) Reflective judgement: Concepts of justification and their relationship to age and education. Journal of Applied Developmental Psychology, 2: 89–116.Google Scholar
Kondo-Brown, K. (2002) A FACETS Analysis of Rater Bias in Measuring Japanese Second language writing performance. Language Testing, 19(1): 3–31.Google Scholar
Lee, K. (2000) Energizing the ESL/EFL Classroom through Internet activities. The Internet TESL Journal. 6. http://iteslj.org/Articles/Lee-InternetActivities.htmlGoogle Scholar
Liaw, S. S. (2007) Understanding computers and the Internet as a work assisted tool. Computers in Human Behavior, 23(1): 399–414.Google Scholar
Lindegaard, G. and Dudek, C. (2003) What is this evasive beast we call user satisfaction? Interacting with Computers, 15: 429–452.Google Scholar
Lomicka, L. L. (1998) To gloss or not to gloss: An investigation of reading comprehension online. Language Learning & Technology, 1(2): 41–50. http://llt.msu.edu/vol1num2/article2/default.htmlGoogle Scholar
Lu, M. T. and Yeung, W. L. (1998) A Framework for Effective Commercial Web Application Development. Internet Research: Electronic Networking Applications and Policy, 8(2): 166–173.Google Scholar
Meurant, R. C. (2008) The Key Importance of L2 Digital Literacy to Korean EFL Pedagogy: College Students Use L2 English to Make Campus Video Guides with Their Cell Phone Videocams, and to View and Respond to Their Videos on an L2 English Language Social Networking Site. The International Journal of Hybrid Information Technology, 1(1): 1–7.Google Scholar
Mokhtari, K. and Reichard, C. (2002) Assessing students’ metacognitive awareness of reading strategies. Journal of Educational Psychology, 94(2): 249–259.Google Scholar
Murray, D. E. and McPherson, P. (2004) Using the Web to support language learning. Australia: NCELTR, Macquarie University.Google Scholar
Murray, D. E. and McPherson, P. (2006) Scaffolding Instruction for Reading the Web. Language Teaching Research, 10(2): 131–156.Google Scholar
Nielsen, J. (2000) Designing Web Usability: The Practice of Simplicity. Indianapolis, Indiana: New Riders Press.Google Scholar
Norman, D. A. (2013) The Design of Everyday Things: Revised and Expanded. New York: Basic Books London: MIT Press (UK edition).Google Scholar
O’Malley, J. M. and Chamot, A. U. (1990) Learning strategies in second language acquisition. New York: Cambridge University Press.Google Scholar
Rasmussen, J. (1988) A cognitive engineering approach to the modelling of decision making and its organisation in: process control, emergency management, cad/cam, office systems, and library systems. Advances in Man-Machine Systems Research, 4: 165–243.Google Scholar
Rosenfeld, L. and Morville, P. (2002) Information architecture for the World Wide Web. (2nd ed). Cambridge, MA: O’Reilly.Google Scholar
Roy, D. (2012) Website Analysis as a Tool for Task-based Language Learning and Higher Order Thinking in an EFL Context. Computer Assisted Language Learning, 25(6): 1–27.Google Scholar
Roy, D. and Brine, J. (2013) Design Thinking in EFL Context: Studying the Potential for Language Teaching and Learning. International Journal of Design Education, 6(2): 1–21.Google Scholar
Sanchez, R. P., Lorch, E. P. and Lorch, R. F. Jr. (2001) Effects of Headings on Text Processing Strategies. Contemporary Educational Psychology, 26(3): 418–428.Google Scholar
Scaife, M. and Rogers, Y. (1996) External cognition: how do graphical representations work? International Journal of Human-Computer Studies, 45: 185–213.CrossRefGoogle Scholar
Sheorey, R. and Mokhtari, K. (2001) Differences in the metacognitive awareness of reading strategies among native and non-native readers. System, 29: 431–449.Google Scholar
Spyridakis, J. H. and Standal, T. C. (1986) Headings, Previews, Logical Connectives: Effects on Reading Comprehension. Journal of Technical Writing and Communication, 16(4): 343–354.Google Scholar
Spyridakis, J. H. (1989) Signaling Effects: A Review of the Research. Journal of Technical Writing and Communication, 19(3): 227–240.Google Scholar
Spyridakis, J. H. (2000) Guidelines for Authoring Comprehensible Web Pages and Evaluating Their Success. Technical Communication, 47: 301–310.Google Scholar
Surber, J. R. and Schroeder, M. (2007) Effect of prior domain knowledge and headings on processing of informative text. Contemporary Educational Psychology, 32(3): 485–498.Google Scholar
Tullis, T. and Stetson, J. (2004) A Comparison of Questionnaires for Assessing Website Usability. Usability Professionals Association (UPA) 2004 Conference, Minneapolis, MN, June 7-11, 2004.Google Scholar
Turvey, M. T. and Shaw, R. E. (1995) Toward an ecological physics and a physical psychology. In: Solso, R. L. and Massaro, D. W. (ed.), The Science of the Mind: 2001 and Beyond. New York: Oxford University Press, 144–169.Google Scholar
Van Hoosier-Carey, G. (1997) Rhetoric by design: using web development projects in the technical communication classroom. Computers and Composition, 14: 395–407.Google Scholar
Warschauer, M. (1997) Computer-Mediated Collaborative Learning: Theory and Practice. Modern Language Journal, 8: 470–481.Google Scholar
Watson, G. and Glaser, E. (2002) Watson - Glaser Critical Thinking Appraisal - UK Edition, Pearson.Google Scholar
Yamashita, J. (2004) Reading attitudes in L1 and L2, and their influence on L2 extensive reading. Reading in a Foreign Language, 16(1): http://nflrc.hawaii.edu/rfl/April2004/yamashita/yamashita.htmlGoogle Scholar
Yeung, A. S., Jin, P. and Sweller, J. (1997) Cognitive load and learner expertise: Split-attention and redundancy effects in reading with explanatory notes. Contemporary Educational Psychology, 23: 1–2.Google Scholar
Yu, Chen-Hsiang and Miller, R. C. (2010) Enhancing Web Page Readability for Non-native Readers. Proceedings of CHI 2010, April 10–15, 2010, Atlanta, Georgia, USA.Google Scholar