Test-takers’ Performance and Perceptions in Total-Immersive Virtual Reality Paired Speaking Tests
0
조회
0
다운로드
0
인용
0
참고문헌
키워드
초록
This study investigated university students’ performance and perceptions of taking paired English speaking tests in fully immersive virtual reality. A total of 36 college students at an advanced level were recruited to participate in either face-to-face (N = 20) or fully immersive VR speaking tests (N = 16), designed to explore test-takers’ speaking abilities. The students were asked to perform two decision-making tasks and fill out a questionnaire asking about their preference for the test mode and perceived levels of presence after completing the tasks. The study revealed no statistically significant difference in the students’ speaking abilities between the two testing modes, suggesting that the VR paired speaking test format could potentially serve as an alternative to the face-to-face paired speaking test. In relation to the analysis of questionnaire items, the students demonstrated a high level of immersion in the virtual environments. Despite their preference for the face-to-face testing mode, they reported that the VR test could potentially replace the face-to-face speaking test. The semi-structured interview data gathered from three participants further revealed that the students, however, reported some discomfort with the paired speaking test itself due to pairing up with the other person. Furthermore, this study presents the limitations of the study and suggests implications for speaking assessments and future studies.
Abstract
This study investigated university students’ performance and perceptions of taking paired English speaking tests in fully immersive virtual reality. A total of 36 college students at an advanced level were recruited to participate in either face-to-face (N = 20) or fully immersive VR speaking tests (N = 16), designed to explore test-takers’ speaking abilities. The students were asked to perform two decision-making tasks and fill out a questionnaire asking about their preference for the test mode and perceived levels of presence after completing the tasks. The study revealed no statistically significant difference in the students’ speaking abilities between the two testing modes, suggesting that the VR paired speaking test format could potentially serve as an alternative to the face-to-face paired speaking test. In relation to the analysis of questionnaire items, the students demonstrated a high level of immersion in the virtual environments. Despite their preference for the face-to-face testing mode, they reported that the VR test could potentially replace the face-to-face speaking test. The semi-structured interview data gathered from three participants further revealed that the students, however, reported some discomfort with the paired speaking test itself due to pairing up with the other person. Furthermore, this study presents the limitations of the study and suggests implications for speaking assessments and future studies.
참고문헌 (60)
- Alderson, J. C., "State of the art review: Language testing and assessment (part two)", Language Teaching, 35(2), pp.79~113 (2002)[DOI]
- Bachman, L. F., "Language testing in practice" (1996), Oxford University Press
- Baik, Y. K., "Teaching and learning in a virtual world" (2010), Hakjisa
- Bamodu, X., "Virtual reality and virtual reality system components" (2013), Atlantis Press
- Brown, H. D., "Teaching by principles: An interactive approach to language pedagogy" (2007), Pearson Education
- Chen, G., "A comparison of reading comprehension across paper, computer screens, and tablets: Does tablet familiarity matter?", Journal of Computers in Education, 1, pp.213~225 (2014)[DOI]
- Cheng, M. T., "Learning through playing virtual age: Exploring the interactions among student concept learning, game performance, in-game behaviors, and the use of in-game characters", Computers & Education, 86(1), pp.18~29 (2015)[DOI]
- Chien, S., "Effects of peer assessment within the context of spherical video-based virtual reality on EFL students’ English-speaking performance and learning perceptions", Computers & Education, 146(3), pp.1~20 (2020)[DOI]
- Diemer, J., "The impact of perception and presence on emotional reactions: A review of research in virtual reality", Frontiers in Psychology, 6(26), pp.1~9 (2015)[DOI]
- Ducasse, A. M., "Assessing paired orals: Rater’s orientation to interaction", Language Testing, 26(3), pp.423~443 (2009)[DOI]
- Egyud, G., "Oral testing in pairs: A secondary school perspective", ELT Journal, 55(1), pp.70~76 (2001)[DOI]
- Freina, L., "A literature review on immersive virtual reality in education: State of the art and perspectives", The 11th international scientific conference e-learning and software for education, pp.133~ (2015), National Defense University
- Galaczi, E. D., "Peer-peer interaction in a paired speaking test: The case of the First Certificate in English", doctoral, pp.2004
- Galaczi, E. D., "Interactional competence across proficiency levels: How do learners manage interaction in paired speaking tests?", Applied Linguistics, 35(5), pp.553~574 (2014)[DOI]
- Ghanbarzadeh, R., "A decade of research on the use of three-dimensional virtual worlds in health care: A systematic literature review", Journal of Medical Internet Research, 16(2), pp.e47~ (2014)[DOI]
- He, A. W., "Talking and testing: Discourse approaches to the assessment of oral proficiency", pp.1~24 (1998), John Benjamins
- Hildson, J., "Language Testing in the 1990s", pp.189~197 (1991), Modern English Publications and the British Council
- Ho, C. M. I., "Designing and implementing virtual enactive role-play and structured argumentation: Promises and pitfalls", Computer Assisted Language Learning, 22(5), pp.381~408 (2009)[DOI]
- Hughes, A., "Testing for language teachers" (2003), Cambridge University Press
- Hung, S. A., "Virtual reality is not always a cure-all: Evidences from a quasi-experiment of EFL business speaking courses", Interactive Learning Environments, pp.1~17 (2023)[DOI]
- 현일선, "The Effects of Paired Partners’ Proficiency Levels on Test-Takers’ Speaking Test Performance", 교과교육학연구, 21(2), pp.156~169 (2017), 교과교육연구소[DOI]
- Jacoby, S., "Co-construction: An introduction", Research on Language and Social Interaction, 28(3), pp.171~183 (2010)[DOI]
- Jeon, M., "Globalization and native English speakers in English programme in Korea (EPIK)", Language, Culture and Curriculum, 22(3), pp.231~243 (2009)[DOI]
- Kormos, J., "Simulating conversations in oral-proficiency assessment: A conversation analysis of role plays and non-scripted interviews in language exams", Language Testing, 16(2), pp.163~188 (1999)[DOI]
- Kramsch, C., "From language proficiency to interactional competence", The Modern Language Journal, 70(4), pp.366~372 (1986)[DOI]
- Lazaraton, A., "A qualitative approach to the validation of oral language tests (Vol. 14)" (2002), Cambridge University Press
- 이아름, "A Study on HMD-based Virtual Reality Listening Tests and Test-takers’ Perceived Levels of Presence", 멀티미디어 언어교육, 25(1), pp.9~30 (2022), 한국멀티미디어언어교육학회[DOI]
- Levak, N., "Facilitating second language learners’ listening comprehension with Second Life and Skype", ReCall, 29(2), pp.200~218 (2016)[DOI]
- van Lier, L., "Reeling, writhing, drawling, stretching, and fainting in coils: Oral proficiency interviews as conversations", TESOL Quarterly, 23(3), pp.489~508 (1989)[DOI]
- de Lucia, A., "Development and evaluation of a virtual campus on Second Life: The case of second DMI", Computers & Education, 52(1), pp.220~233 (2009)[DOI]
- Lumley, T., "Specific-purpose language performance tests tasks and interaction", Australian Review of Applied Linguistics, 13(1), pp.105~136 (1996)[DOI]
- Luoma, S., "Assessing speaking" (2004), Cambridge University Press
- MacCreery, M. P., "A sense of self: The role of presence in virtual environments", Computers in Human Behavior, 29(4), pp.1635~1640 (2013)[DOI]
- Martín-Gutiérrez, J., "Virtual technologies trends in education", Eurasia J Math Sci Tech Ed, 13(2), pp.469~486 (2017)[DOI]
- McFaul, H., "A realist evaluation of student use of a virtual reality smartphone application in undergraduate legal education", British Journal of Educational Technology, 51(2), pp.572~589 (2019)[DOI]
- Melchor-Couto, S., "Foreign language anxiety levels in Second Life oral interaction", ReCALL, 29(1), pp.99~119 (2016)[DOI]
- Messick, S., "Validity and washback in language testing", Language Testing, 13(3), pp.241~256 (1996)[DOI]
- Nanjappan, V., "User-elicited dual-hand interactions for manipulating 3D objects in virtual reality environments", Human-centric Computing and Information Sciences, 8(31), pp.1~16 (2018)[DOI]
- Ockey, G. J., "Assessing L2 listening: Moving towards authenticity" (2018), John Benjamins
- 박한나, "Effects of Virtual Reality-based English Learning on Korean University Students’ Speaking Ability", 멀티미디어 언어교육, 25(4), pp.93~119 (2022), 한국멀티미디어언어교육학회[DOI]
- Park, J. S., "The promise of English: Linguistic capital and the neoliberal worker in the South Korean job market", International Journal of Bilingual Education and Bilingualism, 14(4), pp.443~455 (2011)[DOI]
- Park, M., "Development and validation of virtual interactive tasks for an aviation English assessment", doctoral, pp.2015
- Perrone, M. J., "The impact of the first certificate in English examination on the EFL classroom: A washback study", doctoral, pp.2010
- Peterson, M., "Learner interaction management in an avatar and chat-based virtual world", Computer Assisted Language Learning, 19(1), pp.79~103 (2006)[DOI]
- Peterson, M., "Learning participation patterns and strategy use in Second Life: An exploratory case study", ReCall, 22(3), pp.273~292 (2010)[DOI]
- Quian, D. D., "Comparing direct and semi-direct modes for speaking assessment: Affective effects on test takers", Language Assessment Quarterly, 6(2), pp.113~125 (2009)[DOI]
- Richards, J. C., "Approaches and methods in language teaching" (2014), Cambridge University Press
- Shin, S. K., "Theory and practice of foreign language assessment" (2010), Hankook Publishing House
- 신상근, "가상현실기반 영어 듣기 평가 과제 및 논증기반 타당도 모형 개발 연구", 중등영어교육, 14(3), pp.84~109 (2021), 한국중등영어교육학회[DOI]
- Shubert, T., "The experience of presence: Factor analytic insights", Presence : Teleoperators and Virtual Environments, 10(3), pp.266~281 (2001)[DOI]
- Song, J., "A study of ESL students’ performance and perceptions in face-to-face and virtual-world group oral tests", doctoral, pp.2014
- Steuer, J., "Defining virtual reality: Dimensions determining telepresence", The Journal of Communication, 4(24), pp.73~93 (1992)[DOI]
- Swain, M., "Examining dialogue: Another approach to content specification and to validating inferences drawn from test scores", Language Testing, 18(3), pp.275~300 (2001)[DOI]
- Taguchi, N., "Immersive virtual reality for pragmatics task development", TESOL Quarterly, 56(1), pp.308~335 (2021)[DOI]
- The paired speaking test format: Recent studies, "Taylor, L. S.", ~, pp.UCLES Research Notes, vol. 6 (2001)
- Vesisenaho, M., "Virtual reality in education: Focus on the role of emotions and physiological reactivity", Journal of Virtual Worlds Research, 12(1) (2019)[DOI]
- Walshe, N., "Developing reflective trainee teacher practice with 360-degree video", Teaching and Teacher Education, 78(1), pp.97~105 (2019)[DOI]
- Witmer, B. G., "Measuring presence in virtual environments: A presence questionnaire", Presence : Teleoperators and Virtual Environments, 7(3), pp.225~240 (1998)[DOI]
- 윤현경, "Grammar Errors in Korean EFL Learners’ TOEIC Speaking Test", 영어교육, 67(4), pp.287~309 (2012), 한국영어교육학회[DOI]
- Zhang, H., "Head-mounted display-based intuitive virtual reality training system for the mining industry", International Journal of Mining Science and Technology, 27(4), pp.717~722 (2017)[DOI]
