한국어능력시험의 구인타당도 분석
A study on the construct validity of the Test of Proficiency in Korean.
0
조회
0
다운로드
12
인용
0
참고문헌
키워드
초록
The purposes of this paper were to investigate the construct validity of Test of Proficiency in Korean(TOPIK) and to identify the adequacy of item types (subjective / objective) in Writing Section. In order to achieve the goals, the test data from three administrations of TOPIK(22th, 23th, and 24th test) were analyzed. Exploratory factor analyses and correlation analyses were conducted to obtain empirical evidences. The major findings of this study were two-folded: First, each of 4 sections in TOPIK did not represent unique domain as designed by test specification. The correlations among scores of 4 sections were relatively high compared with the results of TOEIC which shared similar test purpose with TOPIK. Also it was found that basic level test form tended to have unidimensional characteristic rather than advanced level test form. Second, there was not much unique effect of subjective items in Writing section compared with objective items. Correlations between subscores of subjective items and scores of Writing section became lower in the advanced form. The limitations and practical implications of the study to improve TOPIK were also discussed.
Abstract
The purposes of this paper were to investigate the construct validity of Test of Proficiency in Korean(TOPIK) and to identify the adequacy of item types (subjective / objective) in Writing Section. In order to achieve the goals, the test data from three administrations of TOPIK(22th, 23th, and 24th test) were analyzed. Exploratory factor analyses and correlation analyses were conducted to obtain empirical evidences. The major findings of this study were two-folded: First, each of 4 sections in TOPIK did not represent unique domain as designed by test specification. The correlations among scores of 4 sections were relatively high compared with the results of TOEIC which shared similar test purpose with TOPIK. Also it was found that basic level test form tended to have unidimensional characteristic rather than advanced level test form. Second, there was not much unique effect of subjective items in Writing section compared with objective items. Correlations between subscores of subjective items and scores of Writing section became lower in the advanced form. The limitations and practical implications of the study to improve TOPIK were also discussed.
참고문헌 (18)
- 이원경, "한국어 평가론" (2006), 태학사
- 고우리, "한국어 어휘·문법 숙달도 평가 방안 연구 : 한국어능력시험 1, 2급 문항 분석을 중심으로", 석사, pp.2004
- 한국어능력시험의 등급 부여 방식 및 평가 문항 유형 개선 방안연구, "김정숙", 한국교육과정평가원, ~ (2004)
- 김정숙, "한국어 표준 말하기 시험 측정 도구를 위한 기초 연구", 한민족어문학(구 영남어문학), (51), pp.227~258 (2007), 한민족어문학회
- 한국어능력시험 체제 개선 연구, "김정숙", 국립국제교육원, ~, pp.정책연구개발사업 2010-위탁 -02 (2011)
- 한국어능력시험 중급 어휘 목록 개발 연구, "김중섭", 국립국제교육원, ~ (2010)
- 김중섭, "한국어능력평가검사의 개발 실태 및 분석", 이중언어학, 5(1), pp.123~140 (1998), 이중언어학회
- 한국어능력시험 개선 방안 연구, "남명호", 한국교육과정평가원, ~, pp.정책연구과제 99-7-13-2 (1999)
- 한국어능력시험 등급 기준 조정 및 문제은행 구축 방안 연구, "남명호", 한국교육과정평가원, ~, pp.연구보고 CRO 2000-2 (2000)
- 민병곤, "한국어능력시험의 운영 현황 및 과제", 한국어교육, 16(3), pp.137~162 (2005), 국제한국어교육학회
- 박광배, "다변량분석" (2000), 학지사
- 서윤남, "한국어능력시험 쓰기 평가 개선방안 연구: 4회, 5회, 6회 문제 분석을 중심으로", 석사, pp.2003
- 성태제, "현대 기초통계학의 이해와 적용" (1994), 양서원
- 한국어능력시험(TOPIK)개선 방안 연구, "윤희원", 한국교육과정평가원, ~ (2010)
- 이해영, "한국어능력시험의 현황과 개선 방안", 국어교육학연구, (20), pp.197~236 (2004), 국어교육학회
- 한상미, "학문 목적 한국어 말하기 평가 연구 －대학 입학 전 과정을 중심으로－", 한국어교육, 20(1), pp.207~238 (2009), 국제한국어교육학회
- Liao, C-W., "The relationships of test scores measured by the TOEIC listening and reading test and TOEIC speaking and writing tests" (2010), ETS
- Yao, L., "Reporting valid and reliable overall scores and domain scores", Journal of Educational Measurement, 47(3), pp.339~360 (2010)