컴퓨터 모의구술능력 평가의 음성인식기술 활용 가능도
Applicability of Automatic Speech Recognition Technology to Computer-based Simulated Oral Proficiency Interview
0
조회
0
다운로드
4
인용
0
참고문헌
키워드
초록
Abstract
With the advent of ubiquitous era due to proliferation of network-based teaching and testing, the computerized adaptive language test (CALT) appears to be an inevitable method of language testing in the 21st century. The validation research of CALT is mostly conducted on the basis of the oral proficiency interview (OPI) done by human raters (최인철, 2004). This validation practice utilizing human raters, however, has the inherent problem with the internal validity of research, in that OPI ratings done by human raters tend to have relatively low inter-rater and intra-rater reliability. Thus, human ratings in many cases fail to meet the rigorous criteria required by high-stakes language test. Therefore, the automatic speech recognition (ASR) technology-based simulated oral proficiency interview (SOPI) merits our attention as a viable alternative approach to human rater-based OPI. In this respect, this paper attempts to investigate the plausibility and feasibility of implementing ASR-based Oral Test by exploring the relationship between ASR-based Oral Test and native speaker raters, and finally CALT that has been validated by human rater-based OPI. The findings are so revealing that it warrants more large-scale experiment in which more sophisticated ASR-based test employs more valid tasks.
참고문헌 (33)
- 최인철, "Test of Oral Proficiency(TOP)의 개발 연구", 34(1), pp.245~286 (1998)
- 최인철, "Test Fairness and Validity of TEPS", 35(4), pp.571~603 (1999)
- 최인철, "언어 수행평가분야의 전산언어학 기술 활용", 2(2), pp.245~278 (1999), 한국 멀티미디어 언어교육학회
- 최인철, "영어 의사소통능력의 모의 구술 면접 (Simulated Oral Proficiency Interview) 시험 방식 양상 타당성 검증", 16(1), pp.215~246 (2000)
- 최인철, "음성 인식 기술을 활용한 채점자 엄격도 반영 및 유창성 측정 타당성", 11(2) (2004)
- Allen, J, "Natural language understanding" (1995), Benjamin[DOI]
- Bachman, "Fundamental considerations in language testing" (1990), Oxford Univ Press
- Bachman, L, "Language testing in practice" (1996), UK: Oxford Univ. Press
- Bachman,L, "The construct validation of some components of communicative proficiency", 16(4), pp.449~465 (1982)
- Bachman, "An investigation into the comparability of two tests of English as a foreign language" (1992)
- Bernstein, J, "Reliability and validity of PhonePass spoken English tests" (2000)
- Brown, D., "Principles of language learning and teaching" (2000), NY: Prentice Hall. Inc.
- Chambers, F., "What do we mean by fluency?", 4, pp.535~544 (1997)
- Choi, I-C, "Comparability of a Paper-based Language Test and a Computer-based Language Test", 20(3) (2003), England: Edward Arnold
- Cole, R, "Survey of the state of the art in human language technology" (1997), UK: Cambridge University Press
- Cucchiarini, C, "Quantitative assessment of second language learners' fluency by means of automatic speech recognition technology", 107(2), pp.989~999 (2000)
- Gilbert, J, "Pronunciation practices as an aid to listening comprehension", pp.97~112 (1995), Dominic Press
- Henning, "A Preliminary Study of the Nature of Communicative Competence" (1992), Princeton
- Franco, H, "The SRI EduSpeak System: Recognition and Pronunciation Scoring for Language Learning" (2001)
- Khaldieh, Salim A, "The relationship between knowledge of Iraab lexical comprehension of nonnative readers of Arabic", 85(3), pp.416~431 (2001)
- Krashen,S, "Principles and practice in second language acquisition" (1982), Pergamon Press
- Krashen,S, "Input hypothesis" (1985), Longman Inc
- McNamara, T, "Modelling performance: Opening Pandora's box", 16, pp.159~179 (1995)
- McNamara, T, "Measuring second language performance" (1996), London: Longman.
- Morley, "Oral communication in TESOL", pp.51~75 (1991)
- Pennington, "Recent research in L2 phonology Implications for practice", pp.112~130 (1994)
- Price, "The subjective experience of foreign language anxiety Interviews with highly anxious students From theory and research to classroom implications", pp.101~108 (1991), Prentice Hall
- Qian, D, "Investigating the relationship between vocabulary knowledge and academic reading performance: An assessment perspective", 52(3), pp.513~536 (2002)
- Shohamy,E, "The stability of oral proficiency assessment on the oral interview testing procedure", 33, pp.527~540 (1983)
- Shohamy,E, "The validity of direct versus semi-direct oral test", 11(2), pp.99~124 (1994)
- Witt, S. M, "Use of speech recognition in computer-assisted language learning" (1999)
- Yule, "Paying attention to pronunciation The role of self-monitoring in perception", pp.765~768 (1987)
- Weir, "and validation of an English language proficiency test Testing English for university study", pp.45~110 (1988)