말하기 평가 시행 도구 기술과 문항 유형간의 관계성 연구
The relationship between speaking test administration tools and item types
2
조회
0
다운로드
9
인용
0
참고문헌
키워드
초록
This article examines the relationship between test administration tools and item types. It firstly examines the difference in the test administration tools such as paper-based test, computer-based test, and web-based test, in particular, dealing with speaking test. The difference is relevant to item or task types. Based on the considerations of Bachman and Palmer (1996) and Chapelle and Douglas (2006) on test development, and Weir's (2005) definition of context validity, the application of computer technologies to test administration needs to be considered an important construct affecting test takers' performance. To investigate the item type difference among current speaking tests and its relationship with computer technology in administrating the tests, twelve test takers, five proctors, and two computer lab administrator participated in the phone interview and e-mail survey. Six popular speaking tests (TSE, PELT, IELTS, MATE, iBT TOEFL, ESPT) were selected to be analyzed. The data were analyzed in terms of item types, computer technology use, and test-takers perceptions. The implication is suggested for students, teachers, and language testers.
Abstract
This article examines the relationship between test administration tools and item types. It firstly examines the difference in the test administration tools such as paper-based test, computer-based test, and web-based test, in particular, dealing with speaking test. The difference is relevant to item or task types. Based on the considerations of Bachman and Palmer (1996) and Chapelle and Douglas (2006) on test development, and Weir's (2005) definition of context validity, the application of computer technologies to test administration needs to be considered an important construct affecting test takers' performance. To investigate the item type difference among current speaking tests and its relationship with computer technology in administrating the tests, twelve test takers, five proctors, and two computer lab administrator participated in the phone interview and e-mail survey. Six popular speaking tests (TSE, PELT, IELTS, MATE, iBT TOEFL, ESPT) were selected to be analyzed. The data were analyzed in terms of item types, computer technology use, and test-takers perceptions. The implication is suggested for students, teachers, and language testers.
참고문헌 (31)
- "MATE 개요"[URL]
- 최수영, "멀티미디어기반 영어교육" (2003), 한국문화사
- "토플Q&A게시판. 해커스홈페이지"[URL]
- Bachman, L. F., "Language testing in practice" (1996), Oxford University Press
- Breland, H., "Comparability of TOEFL CBT writing prompts: Response mode analyses" (2004), Educational Testing Service
- Bridgeman, B., "Effects of screen size, screen resolution, and display rate on computer-based test performance" (2002), Educational Testing Service
- Chapelle, C. A., "Are c-tests valid measures for L2 vocabulary research?", Second Language Research, 10(2), pp.157~187 (1994)
- Chapelle, C. A., "Computer applications in Second Language Acquisition: Foundations for teaching, testing and research" (2001), Cambridge University Press
- Chapelle, C. A., "Assessing language through computer technology" (2006), Cambridge University Press
- Chapelle, C. A., "Validation of a web-based ESL test", Language Testing, 20(4), pp.409~439 (2003)
- Choi, I., "Comparability of a paper-based language test and a computer-based language test", Language Testing, 20(3), pp.295~320 (2003)
- Cohen, Y., "The effect of specific language features on the complexity of systems for automated essay scoring", 29th Annual conference of the international association for educational assessment (2003)
- Craig, D., "Handwriting legibility and word-processing in assessing rater reliability", 석사, pp.2001
- "About the test. TSE Overview. Retrieved September 15, 2008 from the World Wide"[URL]
- Fulcher, G., "Interface design in computer-based language testing", Language Testing, 20(4), pp.384~408 (2003)
- Fulcher, G., "Second language testing" (2005), Pearson Education Limited
- Hansen, E. G., "Toward accessible computer-based tests: Prototypes for visual and other disabilities" (2004), ETS
- Hughes, A., "Testing for language teachers" (2003), Cambridge University Press
- Jamieson, J., "Design and evaluation of a computer-based TOEFL tutorial" (1998), Educational Testing Service
- Kelly, A., "Computerized scoring of essays for analytical writing assessments: Evaluating score validity", Paper presented at the Annual meeting of the National Council on Measurement in Education (2001)
- Kim, J. T., "The effectiveness of test-takers’ participation in development of an innovative web-based speaking test for international teaching assistants at American colleges. Doctoral dissertation" (2006), University of Illinois at Urbana-Champaign
- Kim, J. T., "Validation of a test screen design. Multimedia-Assisted Language Learning", Learning, 10(1), pp.62~80 (2007)
- Lazaraton, A., "Teaching oral skills in : Teaching English as a second or foreign language", pp.103~115 (2001), Heinle & Heinle
- Lee, H., "Measuring plagiarism in the second language essay-writing context", English Language Literature & Teaching, 12(1), pp.221~228 (2005)
- Lee, H. K., "A comparative study of ESL writers’ performance in a paper-based and a computer-delivered writing test", Assessing Writing, 9, pp.4~26 (2004)
- Messick, S., "Validity in : Educational Measurement", pp.3~104 (1989), American Council on Education
- EFL listening and speaking, "Teaching ESL", pp.2009, Nation, I. S. P.
- O'Malley, J. M., "Learning strategy applicatons with studetns of English as a second language", TESOL Quarterly, 19, pp.557~584 (1985)
- Roever, C., "Web-Based Language Testing", Learning & Technology, 5(2), pp.88~94 (2001)
- Taylor, C., "Examining the relationship between computer familiarity and performance on computer-based language tasks", Language Learning, 49(2), pp.219~274 (1999)
- Weir, C. J., "Language testing and validation: an evidence-based approach" (2005), Palgrave Macmillan