본문 바로가기
KERD
논문KCI 등재

Using Technology in Language Assessment: Focusing on the Potential and Feasibility of Virtual Reality-based Language Tests

0

조회

0

다운로드

0

인용

0

참고문헌

키워드

초록

The integration of various technologies into language testing has been a consistent effort to enhance the authenticity and efficiency of language testing. Despite high expectations, the reality is that few technologies, with the exception of automatic scoring, have become staples in language testing. This has resulted in little change in listening and writing tests, while speaking and writing tests face issues of construct underrepresentation due to automatic scoring. This paper examines why various technologies have not become new paradigms in language testing, analyzing the dynamics from both solutionfirst and problem-first approach perspectives. It then explores the potential and feasibility of virtual reality-based language tests, which hold promise for more accurately assessing test-takers’ language abilities by enabling communication in spaces that simulate real-life language use situations. Lastly, to avoid the pitfalls encountered by other technologies that failed to become main paradigms, the paper discusses directions for virtual reality technology-based language testing. This paper seeks to provide valuable insights for language testers and testing organizations aiming to incorporate emerging technologies into language assessment.

Abstract

The integration of various technologies into language testing has been a consistent effort to enhance the authenticity and efficiency of language testing. Despite high expectations, the reality is that few technologies, with the exception of automatic scoring, have become staples in language testing. This has resulted in little change in listening and writing tests, while speaking and writing tests face issues of construct underrepresentation due to automatic scoring. This paper examines why various technologies have not become new paradigms in language testing, analyzing the dynamics from both solutionfirst and problem-first approach perspectives. It then explores the potential and feasibility of virtual reality-based language tests, which hold promise for more accurately assessing test-takers’ language abilities by enabling communication in spaces that simulate real-life language use situations. Lastly, to avoid the pitfalls encountered by other technologies that failed to become main paradigms, the paper discusses directions for virtual reality technology-based language testing. This paper seeks to provide valuable insights for language testers and testing organizations aiming to incorporate emerging technologies into language assessment.

참고문헌 (51)

  1. Alderson, J. C., "Diagnosing foreign language proficiency:The interface between learning and assessment" (2005), Continum
  2. Alqahtani, A. S., "Environments and system types of virtual reality technology in STEM : A survey", International Journal of Advanced Computer Science and Applications, 8(6), pp.77~89 (2017)
  3. Bachman, L. F., "Fundamental considerations in language testing" (1990), Oxford University Press
  4. Bachman, L. F., "What does language testing have to offer?", TESOL Quarterly, 25(4), pp.671~704 (1991)
  5. Bachman, L. F., "Modern language testing at the turn of the century : Assuring that what we count counts", Language Testing, 17(1), pp.1~42 (2000)
  6. Bachman, L. F., "Language testing in practice: Designing and developing useful language tests" (1996), Oxford University Press
  7. Barkaoui, K., "The effects of writing mode and computer ability on L2 test-takers’ essay characteristics and scores", Assessing Writing, 36, pp.19~31 (2018)
  8. Carr, N. T., "The companion to language assesssment", pp.1063~1078 (2013), John Wiley &Sons
  9. Chapelle, C. A., "Computer applications in second language acquisition: Foundations for teaching, testing and research" (2001), Cambridge University Press
  10. Chapelle, C. A., "Encyclopedia of language and education", pp.2263~2274 (2008), Springer
  11. Chapelle, C. A., "Assessing language through computer technology" (2006), Cambridge University Press
  12. Choi, I. -C., "Comparability of a paper-based language test and a computer-based language test", Language Testing, 20(3), pp.295~320 (2003)
  13. Chung, G. K. W. K., "Automated essay scoring: A cross-disciplinary perspective", pp.23~40 (2003), Lawrence Erlbaum Associates
  14. Cox, T. L., "Using automatic speech recognition technology with elicited oral response testing", CALICO Journal, 29(4), pp.601~618 (2012)
  15. Cumming, A., "Assessing integrated writing tasks for academic purposes : Promises and perils", Language Assessment Quarterly, 10(1), pp.1~8 (2013)
  16. Dooey, P., "Language testing and technology : Problems of transition to a new era", ReCALL, 20(1), pp.21~34 (2008)
  17. Ginther, A., "Context and content visuals and performance on listening comprehension stimuli", Language Testing, 19(2), pp.133~167 (2002)
  18. Heydari, M., "Innovation in learning-oriented language assessment: New language learning and teaching environments", pp.201~217 (2023), Palgrave MacmillanPalgrave Macmillan
  19. Hughes, A., "Testing for language teachers" (2020), Cambridge University Press
  20. Jun, H. S., "A validity argument for the use of scores from a web-search-permitted and web-source-based integrated writing test", doctoral, pp.2014
  21. Kroll, B., "Understanding TOEFL’s test of written English", RELC Journal, 22(1), pp.20~33 (1991)
  22. Lan, Y. J., "Immersion into virtual reality for language learning", Psychology of Learning and Motivation, 72, pp.1~26 (2020)
  23. 이아름, "Using Virtual Reality to Test Academic Listening Proficiency", 영어학, 19(4), pp.688~712 (2019), 한국영어학회[DOI]
  24. 이아름, "A Study on HMD-based Virtual Reality Listening Tests and Test-takers’ Perceived Levels of Presence", 멀티미디어 언어교육, 25(1), pp.9~30 (2022), 한국멀티미디어언어교육학회[DOI]
  25. Lee, H. K., "A comparative study of ESL writers’ performance in a paper-based and a computer-delivered writing test", Assessing Writing, 9(1), pp.4~26 (2004)
  26. Lin, T. J., "Language learning in virtual reality environments : Past, present, and future", Journal of Educational Technology & Society, 18(4), pp.486~497 (2015)
  27. Mandal, S., "Brief introduction of virtual reality & its challenges", International Journal of Scientific & Engineering Research, 4(4), pp.304~309 (2013)
  28. Ockey, G. J., "Construct implications of including still image or video in computer-based listening tests", Language Testing, 24(4), pp.517~537 (2007)
  29. Ockey, G. J., "Developments and challenges in the use of computer-based testing for assessing second language ability", The Modern Language Journal, 93, pp.836~847 (2009)
  30. Ockey, G. J., "Web-based virtual environments for facilitating assessment of L2 oral communication ability", Language Assessment Quarterly, 14(4), pp.346~359 (2017)
  31. Park, M., "Innovative assessment of aviation English in a virtual world : Windows into cognitive and metacognitive strategies", ReCALL, 30(2), pp.196~213 (2018)
  32. Powers, D. E., "Comparing the validity of automated and human scoring of essays", Journal of Educational Computing Research, 26(4), pp.407~425 (2002)
  33. Powers, D. E., "Stumping e-rater : Challenging the validity of automated essay scoring", Computers in Human Behavior, 18(2), pp.103~134 (2002)
  34. Raimes, A., "The TOEFL test of written English : Causes for concern", TESOL Quarterly, 24(3), pp.427~442 (1990)
  35. Sawaki, Y., "Comparability of conventional and computerized tests of reading in a second language", Language Learning & Technology, 5(2), pp.38~59 (2001)
  36. Sawaki, Y., "The Routledge handbook of language testing", pp.426~437 (2012), Routledge
  37. Shin, D., "Discursive conflicts in news media and the suspension of a government-led test of English in Korea", Language Testing in Asia, 10(1), pp.1~18 (2020)
  38. Shin, S.-K., "Theory and practice of foreign language assessment" (2010), Hankookmunhwasa
  39. 신상근, "Computer-based Language Testing: Potential and Pitfalls", 교과교육학연구, 22(3), pp.219~225 (2018), 교과교육연구소[DOI]
  40. 신상근, "가상현실기반 영어 듣기 평가 과제 및 논증기반 타당도 모형 개발 연구", 중등영어교육, 14(3), pp.84~109 (2021), 한국중등영어교육학회[DOI]
  41. Song, J., "A study of ESL students’ performance and perceptions in face-to-face and virtual-world group oral tests", doctoral, pp.2014
  42. Suvorov, R., "The companion to language assessment", pp.593~613 (2013), Wiley-Blackwell
  43. Toncic, J., "Teachers, AI grammar checkers, and the newest literacies : Emending writing pedagogy and assessment", Digital Culture & Education, 12(1), pp.26~51 (2020)
  44. Van Moere, A., "Handbook of second langauge assessment", pp.341~358 (2016), De Gruyter Mouton
  45. Wagner, E., "Are they watching? Test-taker viewing behavior during an L2 video listening test", Language Learning & Technology, 11(1), pp.67~86 (2007)
  46. Wagner, E., "Video listening tests : What are they measuring", Language Assessment Quarterly, 5(3), pp.218~243 (2008)
  47. Wagner, E., "The effect of the use of video texts on ESL listening test-taker performance", Language Testing, 27(4), pp.493~513 (2010)
  48. Xi, X., "The Routledge handbook of language testing", pp.513~529 (2012), Routledge
  49. Xi, X., "A comparison of two scoring methods for an automated speech scoring system", Language Testing, 29(3), pp.371~394 (2012)
  50. Yu, G., "From integrative to integrated language assessment:Are we there yet?", Language Assessment Quarterly, 10(1), pp.110~114 (2013)
  51. Yu, G., "Computer-based English language testing in China : Present and future", Language Assessment Quarterly, 14(2), pp.177~188 (2017)

관련 논문AI추천

이 간행물의 다른 논문 (9건)