한국어 말하기 평가 개발 모형 및 시험타당도 검사 절차
A Test Development Model and Its Validation Procedure of Korean Speaking Tests.
0
조회
0
다운로드
3
인용
0
참고문헌
키워드
초록
This study aims to introduce a test development model to develop a Korean speaking test and validation procedure on it. There is a little published work on Korean speaking test development and validation on them. Therefore, this study attempts to initiate a discussion about it. To measure the Korean speaking proficiency of foreign learners of Korean, language testers need to consider a appropriate development model as a initial step in validation procedure because validation process on a test includes validity evidence gathering from the beginning of test development to the end (Fulcher, 2005; Kim, 2006). Based on the test development models of Bachman and Palmer(1996), Davidson and Lynch (2002), and Kim (2006), the study shows the feasibility of adopting the ADDIE model from the field of instructional technology into Korean language test development. ADDIE stands for (need) analysis, design, development, implementation, and evaluation. In each phase, the study describes features to consider for the development of a Korean speaking test. In the needs analysis phase, language testers collect information on Korean language tests by reverse-engineering test items, where reverse-engineering means test specification writing for a test. In the design and development phases, language testers plan test development procedures, and design and develop test items, test sets, and its administration. In the implementation phase, a test is administered as pilot or a main test. Finally, in the evaluation phase, validation is carried out by using all the information gathered from the previous phases. The information includes validity arguments, test results and their quantitative analysis, and rater training procedures. The test development process is not linear, but also iterative and cyclical. (Pai Chai University)
Abstract
This study aims to introduce a test development model to develop a Korean speaking test and validation procedure on it. There is a little published work on Korean speaking test development and validation on them. Therefore, this study attempts to initiate a discussion about it. To measure the Korean speaking proficiency of foreign learners of Korean, language testers need to consider a appropriate development model as a initial step in validation procedure because validation process on a test includes validity evidence gathering from the beginning of test development to the end (Fulcher, 2005; Kim, 2006). Based on the test development models of Bachman and Palmer(1996), Davidson and Lynch (2002), and Kim (2006), the study shows the feasibility of adopting the ADDIE model from the field of instructional technology into Korean language test development. ADDIE stands for (need) analysis, design, development, implementation, and evaluation. In each phase, the study describes features to consider for the development of a Korean speaking test. In the needs analysis phase, language testers collect information on Korean language tests by reverse-engineering test items, where reverse-engineering means test specification writing for a test. In the design and development phases, language testers plan test development procedures, and design and develop test items, test sets, and its administration. In the implementation phase, a test is administered as pilot or a main test. Finally, in the evaluation phase, validation is carried out by using all the information gathered from the previous phases. The information includes validity arguments, test results and their quantitative analysis, and rater training procedures. The test development process is not linear, but also iterative and cyclical. (Pai Chai University)
참고문헌 (23)
- "08년 교육기본통계조사 결과 발표. 보도자료"[URL]
- 김유정, "한국어 능력 평가 연구", 박사, 국어국문학과, pp.1999
- 김정숙, "한국어 표준 말하기 시험 측정 도구를 위한 기초 연구", 한민족어문학(구 영남어문학), 51(51), pp.227~258 (2007), 한민족어문학회
- 김한란, "성공적인 외국어 교육을 위한 기준 설정: 언어학습, 교수, 평가를 위한 유럽공통참조기준(CEFRL)의 소개 및 한국어 교육과정과 평가와의 연계", 한독일어교육학회 국제학술대회 발표 논문, pp.111~119 (2007)
- 서상규, "한국어 능력 평가 시험의 기본 모형 수립을 위한 기초적 연구", 교육 한글, 10, pp.279~316 (1997)
- 안미란, "능력 기술을 바탕으로 하는 학문 목적 한국어 읽기ㆍ쓰기 평가 문항 유형 개발", Foreign Languages Education, 15(1), pp.521~544 (2008), 한국외국어교육학회
- 전은주, "한국어 능력 평가: 말하기 능력 평가범주 설정을 위하여", 한국어학, 6(1) (1997)
- 전은주, "말하기 듣기 영역 수행 평가의 방법: 토론 교수-학습을 중심으로", 어문학교육, 27, pp.39~65 (2003)
- 정화영, "한국어 말하기 숙달도 평가 방안: FSI oral proficiency test 분석을 중심으로", 석사, pp.1999
- "Oral Proficiency Interview Tester Training Manual"[URL]
- Bachman, L F, "Statistical analyses for language assessment" (2004), Cambridge University Press
- Bachman, L. F, "Language test in practice" (1996), Oxford University Press
- Chapelle, C A, "Computer applications in second language acquisition: foundations for teaching, testing and research" (2001), Cambridge Unviersity Press
- Chapelle, C A, "Validation of a web-based ESL test", Language Testing, 20(4), pp.409~439 (2003)
- Council of Europe, "Common European Framework of Reference for languages: learning, teaching, assessment" (2001), Cambridge University press
- Davidson, F, "Testcraft: A teacher’s guide to writing and using language test specifications" (2002), Yale University Press
- Fulcher, G, "Testing second language speaking" (2003), Pearson Education Limited
- "Better communications test will silence critics"[URL]
- Kim, J. T, "The effectiveness of test-takers’ participation in development of an innovative web-based speaking test for international teaching assistants at American colleges" (2006), University of Illinois at Urbana- Champaign
- Kimm, J T, "Context validity of a speaking test: needs analysis and content analysis", Korean Journal of Applied Linguistics, 22(2), pp.137~158 (2006)
- Messick, S, "Validity, Educational Measurement (3rd ed.)" (1989), Macmillan
- "Cognitive complexity" (1997)[URL]
- Weir, C, "Language Testing and Validation: An evidence-based approach" (2005), New York Palgrave Macmillan