컴퓨터 기반 한국어 말하기 평가에 대한 수험자들의 태도 분석 - 면대면 평가와의 비교를 통한 안면타당도 분석 -
An Analysis of Examinees’ Attitudes toward Computer Based Speaking Assessments: Comparison of Face Validity with Face - to - Face Oral Interview Assessment.
2
조회
0
다운로드
7
인용
0
참고문헌
키워드
초록
In recent decades, with an increase in the application of speaking assessment computer technologies, there have been renewed debates over the validity of foreign language assessments. The purpose of this study is to investigate the value of Korean speaking assessments using computer-based test (CBT). A focus was placed on the analysis of examinees’ attitudes toward CBT speaking assessments compared with face-to-face oral interview assessments. For this research, fifty-five Korean language learners responded to eighteen questions using the Six Likert Scale. The results indicate that most of respondents felt that face-to-face speaking assessments would have a more accurate picture of their current real-life speaking abilities when compared to CBT speaking assessments. The group of respondents from the lower proficiency level in Korean overwhelmingly felt that the face-to-face interview assessment process was more accurate than the CBT speaking assessments. However, the group of respondents with the higher proficiency level in Korean felt that the differences in the effectiveness of these two assessment methods were minimal. In addition, there was little differences in the attitudes toward the two assessment tools among three groups based on the varying frequencies of computer use. Finally, there was no differences in the attitude towards the two types of assessments among three groups with varying degrees of computer literacy.
Abstract
In recent decades, with an increase in the application of speaking assessment computer technologies, there have been renewed debates over the validity of foreign language assessments. The purpose of this study is to investigate the value of Korean speaking assessments using computer-based test (CBT). A focus was placed on the analysis of examinees’ attitudes toward CBT speaking assessments compared with face-to-face oral interview assessments. For this research, fifty-five Korean language learners responded to eighteen questions using the Six Likert Scale. The results indicate that most of respondents felt that face-to-face speaking assessments would have a more accurate picture of their current real-life speaking abilities when compared to CBT speaking assessments. The group of respondents from the lower proficiency level in Korean overwhelmingly felt that the face-to-face interview assessment process was more accurate than the CBT speaking assessments. However, the group of respondents with the higher proficiency level in Korean felt that the differences in the effectiveness of these two assessment methods were minimal. In addition, there was little differences in the attitudes toward the two assessment tools among three groups based on the varying frequencies of computer use. Finally, there was no differences in the attitude towards the two types of assessments among three groups with varying degrees of computer literacy.
참고문헌 (30)
- 한국어능력 시험의 CBT, "IBT 기반 말하기 평가를 위한 문항 유형 개발, 국립국제교육원 1차 연구보고서", 국립국제교육원, 2012
- 이 향, "한국어 말하기 수행 평가의 발음 범주 채점에 대한 타당성 검증", 박사, 국어국문학과, pp.2013
- 한상미, "컴퓨터 기반 한국어 말하기 숙달도 평가 도구 개발 연구", 외국어로서의 한국어교육, 34, pp.519~554 (2009), 언어연구교육원 한국어학당
- Alderson, J. C., "Technology in testing : The present and the future", System, 28(4), pp.593~603 (2000)
- Bachman, L. F., "Fundamental considerations in language testing" (1990), Oxford Oxford University Press
- Bachman, L. F., "Modern language testing at the turn of the century : Assuring that what we count counts", Language testing, 17(1), pp.1~42 (2000)
- Brown, J. D., "Computers in language testing : Present research and some future directions", Language Learning & Technology, 1(1), pp.44~59 (1997)
- Chalhoub–Deville, M., "Computer adaptive testing in second language contexts", Annual Review of Applied Linguistics, 19, pp.273~299 (1999)
- Chapelle, C. A., "Computer Applications in Second Language Acquisition" (2001)
- Chapelle, C. A., "Assessing language through computer technology: Cambridge Language Assessment Series" (2006), Cambridge University Press
- Choi, I. C., "Comparability of a paper-based language test and a computer-based language test", Language Testing, 20(3), pp.295~320 (2003)
- Clark, J. L., "The FSI", ILR, Studies in Second Language Acquisition, pp.1988, 10(02)[DOI]
- Coniam, D., "The use of audio or video comprehension as an assessment instrument in the certification of English language teachers : A case study", System, 29(1), pp.1~14 (2001)
- Gruba, P., "Computer-based testing", Language testing and assessment, 7, pp.141~149 (1997)
- Jones, N., "The comparability of computer-based and paper-based tests : goals, approaches, and a review of research", Research Notes, 27, pp.11~14 (2007)
- Kenyon, D. M., "Comparing examinee attitudes toward computer-assisted and other oral proficiency assessments", Language Learning & Technology, 5(2), pp.60~83 (2001)
- Jeong, T. Y., "Assessing and interpreting students’ English oral proficiency using oral proficiency using D-VOICE in an EFL context", Doctor, pp.2003
- Lado, R., "Language testing: the construction and use of foreign language tests: a teacher's book" (1961), Longman
- Larson, J. W., "Testing oral language skills via the computer", Calico Journal, pp.53~66 (2000)
- Luoma, S., "speaking: Cambridge language assessment" (2004), Cambridge University Press
- Madsen, H. S., "Evaluating a computer-adaptive ESL placement test", Calico Journal, pp.41~50 (1986)
- Madsen, H. S., "Computer-assisted Language Learning and Testing: Research Issues and Praetice", pp.237~257 (1991), Newbury House
- McNamara, T. F., "Language testing" (2000), Oxford University Press
- Norris, J. M., "Concerns with computerized adaptive oral proficiency assessment", Language Learning & Technology, 5(2), pp.99~105 (2001)
- Qian, D. D., "Comparing direct and semi-direct modes for speaking assessment : Affective effects on test takers", Language Assessment Quarterly, 6(2), pp.113~125 (2009)
- Roever, C., "Web-based language testing", Language Learning & Technology, 5(2), pp.84~94 (2001)
- Russell, M., "Computer-based testing and validity : A look back into the future, Assessment in education : principles", policy & practice, 10(3), pp.279~293 (2003)
- The relationship between computer familiarity and performance on computer-based TOEFL test tasks, "Taylor, C.", Educational Testing Service, ~, pp.TOEFL Research Report No. 61 (1998)
- Taylor, C., "Examining the Relationship Between Computer Familiarity and Performance on Computer-Based Language Tasks", Language Learning, 49(2), pp.219~274 (1999)
- Turner, J. L., "Using statistics in small-scale language education research: Focus on non-parametric data" (2014), Routledge