A Study on HMD-based Virtual Reality Listening Tests and Test-takers’ Perceived Levels of Presence
1
조회
0
다운로드
2
인용
0
참고문헌
키워드
초록
Virtual reality (VR) technology has gradually become recognized as an emerging sector showing great potential to be utilized across various fields. Its practicality has been discussed in several studies, but few studies have been conducted on the use of VR to test English listening ability. Thus, in the present study, an immersive VR listening test was developed to measure English listening proficiency, and the correlation of scores from the newly developed VR test with another validated listening test (TOEIC) was investigated by conducting a non-parametric Spearman’s rank test. The study further explored test-takers’ perceived levels of presence on an immersive VR listening test, given that presence levels are considered one of the most critical factors for the VR experience. Data were collected from 17 tertiary-level test-takers. Each test-taker underwent two different types of VR tests while wearing HMDs (Head-mounted displays): 360-degree immersive videos and a total-immersive listening task. Through test score comparisons and the analysis of responses from presence questionnaires, the VR listening test and TOEIC listening test scores showed a positive, moderate correlation. In addition, the study found that the test-takers experienced similar levels of presence regardless of test type. The study also discusses implications for language assessment and pedagogy, as well as study limitations.
Abstract
Virtual reality (VR) technology has gradually become recognized as an emerging sector showing great potential to be utilized across various fields. Its practicality has been discussed in several studies, but few studies have been conducted on the use of VR to test English listening ability. Thus, in the present study, an immersive VR listening test was developed to measure English listening proficiency, and the correlation of scores from the newly developed VR test with another validated listening test (TOEIC) was investigated by conducting a non-parametric Spearman’s rank test. The study further explored test-takers’ perceived levels of presence on an immersive VR listening test, given that presence levels are considered one of the most critical factors for the VR experience. Data were collected from 17 tertiary-level test-takers. Each test-taker underwent two different types of VR tests while wearing HMDs (Head-mounted displays): 360-degree immersive videos and a total-immersive listening task. Through test score comparisons and the analysis of responses from presence questionnaires, the VR listening test and TOEIC listening test scores showed a positive, moderate correlation. In addition, the study found that the test-takers experienced similar levels of presence regardless of test type. The study also discusses implications for language assessment and pedagogy, as well as study limitations.
참고문헌 (43)
- Bachman, L. F., "Language testing in practice" (1996), Oxford University Press
- Batty, A. O., "The impact of visual cues on item response in video-mediated tests of foreign language listening comprehension", doctor, pp.2016
- Bowman, D., "Virtual reality: How much immersion is enough?", IEEE Computer Graphics and Applications, 40(7), pp.36~43 (2007)
- Broeck, M. V., , Proceedings of the 2017 ACM on multimedia conference (2017)
- Brown, G., "Speakers, listeners, and communication" (1995), Cambridge University Press
- Chen, C. J., "Enhancing an instructional design model for virtual reality-based learning", Australasian Journal of Educational Technology, 29(5), pp.699~716 (2013)
- Cheng, A., , Proceedings of the 2017 CHI conference on human factors in computing systems (2017)
- Flowerdew, J., "Second language listening: Theory and practice" (2005), Cambridge University Press
- Freeman, J., "Effects of sensory information and prior experience on direct subjective ratings of presence", Presence: Teleoperators and Virtual Environments, 8(1), pp.1~13 (1999)
- Ginther, A., "Context and content visuals and performance on listening comprehension stimuli", Language Testing, 19(2), pp.133~167 (2002)
- 한형종, "가상현실(Virtual Reality)의 교육적 활용에 대한 예비교사 인식 분석", 컴퓨터교육학회 논문지, 23(5), pp.61~70 (2020), 한국컴퓨터교육학회[DOI]
- 김진원, "가상현실 기반 상황몰입형 영어 대화 학습 시스템", 융합정보논문지, 7(6), pp.245~251 (2017), 중소기업융합학회[DOI]
- 김미화, "가상현실을 활용한 소집단 협력학습에서 팀 구성원으로서의역할 수행이 학업성취도와 만족도에 미치는 영향", 디지털융복합연구, 15(11), pp.67~76 (2017), 한국디지털정책학회[DOI]
- 김성연, "가상현실 활용 네트워크 기반 영어 교수·학습의 효과에 관한 연구", 영어교육연구, 22(4), pp.53~74 (2010), 팬코리아영어교육학회[DOI]
- 이아름, "Using Virtual Reality to Test Academic Listening Proficiency", 영어학, 19(4), pp.688~712 (2019), 한국영어학회[DOI]
- 이익희, "360도 VR(Virtual Reality) 영상의 현실 효과에 대한 연구 - 토크쇼에서 VR 영상의 프레즌스와 감동 효과를 중심으로", 한국과학예술융합학회, 31, pp.293~303 (2017), 한국전시산업융합연구원[DOI]
- 이재성, "VR과 AR 기술 콘텐츠 사례에 나타난 몰입감과 현실감의 특성에 관한 연구", 한국실내디자인학회 논문집, 28(3), pp.13~24 (2019), 한국실내디자인학회
- 이선혜, "대학생들의 3D 가상현실을 이용한 채팅의 영어학습 효과", 영어어문교육, 16(1), pp.233~257 (2010), 한국영어어문교육학회
- Lin, T. J., "Language learning in virtual reality environments: Past, present, and future", Educational Technology & Society, 18(4), pp.486~497 (2015)
- MacCreery, M. P., "A sense of self: The role of presence in virtual environments", Computers in Human Behavior, 29(4), pp.1635~1640 (2013)
- Makransky, G., "A structural equation modeling investigation of the emotional value of immersive virtual reality in education", Educational Technology Research and Development, 66(5), pp.1141~1164 (2018)
- Müns, A., "Evaluation of a novel phantom-based neurosurgical training system", Surgical neurology international, 5 (2014)[DOI]
- Ockey, G. J., "Construct implications of including still image or video in computer-based listening tests", Language Testing, 24(4), pp.517~537 (2007)
- Ockey, G. J., "Assessing L2 listening: Moving towards authenticity" (2018), John Benjamins
- Park, M., "Development and validation of virtual interactive tasks for an aviation English assessment", doctor, pp.2015
- Ramalho, J., , Proceedings of the 2013 ACM international workshop on immersive media experiences (2013)
- Richards, J. C., "Listening comprehension: Approach, design, and procedure", TESOL Quarterly, 17(2), pp.219~240 (1983)
- Rost, M., "Teaching and researching listening" (2011), Pearson
- Schrader, C., "The influence of virtual presence: Effects on experienced cognitive load and learning outcomes in educational computer games", Computers in Human Behavior, 28(2), pp.648~658 (2012)
- Shin, D., "Using videotaped lectures for testing academic listening proficiency", International Journal of Listening, 12(1), pp.57~80 (1998)
- Shin, S. K., "Theory and practice of foreign language assessment" (2010), Hankook publishing house
- Slater, M., "Measuring presence: A response to the Witmer and Singer presence questionnaire", Presence: Teleoperators and Virtual Environments, 8(5), pp.560~565 (1999)
- Slater, M., "A framework for immersive virtual environments: Speculations on the role of presence in virtual environments", Presence: Virtual and Augmented Reality, 6(6), pp.603~616 (1997)
- Song, J., "A study of ESL students’ performance and perceptions in face-to-face and virtual-world group oral tests", doctor, pp.2014
- Steuer, J., "Defining virtual reality: Dimensions determining telepresence", The Journal of Communication, 4(24), pp.73~93 (1992)
- Suvorov, R., "Assessing L2 listening: Moving towards authenticity", pp.146~160 (2018), John Benjamins Publishing Company
- Trevino, L. K., "Flow in computer-mediated communication: Electronic mail and voice mail evaluation and impacts", Communication Research, 19(5), pp.539~573 (1992)
- Tseng, W., "Vocabulary learning in virtual environments: Learner autonomy and collaboration", System, 88(1), pp.1~17 (2019)
- Wagler, A., "Comparing virtual reality tourism to real-life experience: Effects of presence and engagement on attitude and enjoyment", Communication Research Reports, 35(5), pp.456~464 (2018)
- Wagner, E., "Utilizing the visual channel: An investigation of the use of video texts on tests of second language listening ability", doctor, pp.2006
- Wagner, E., "Video listening tests: What are they measuring?", Language Assessment Quarterly, 5(3), pp.218~243 (2008)
- Wagner, E., "The effect of the use of video texts on ESL listening test-taker performance", Language Testing, 27(4), pp.493~513 (2010)
- Witmer, B. G., "Measuring presence in virtual environments: A presence questionnaire", Presence: Teleoperators and Virtual Environments, 7(3), pp.225~240 (1998)