한국어능력시험 읽기 영역의 언어권에 따른 차별 기능 문항 분석
Detecting and Analysing Differential Item Functioning(DIF) in Test of Proficiency in Korean(TOPIK) Reading Comprehension
0
조회
0
다운로드
7
인용
0
참고문헌
키워드
초록
This study aims to determine the existence of Differential Item Functioning(DIF) in the Test of Proficiency in Korean(TOPIK) reading comprehension and to analyse the peculiarity and cause of DIF. The specific questions asked in the study are as follows:First, what are the peculiarity and cause of DIF regarding gender in TOPIK reading comprehension?Second, what are the peculiarity and cause of DIF regarding language difference (Chinese character-based language/non-Chinese character-based language) in TOPIK reading comprehension?The study's conclusions are as follows:First, there are 91 language - background DIF items in the 16th to 18th TOPIK reading comprehension. As a result of analysing language DIF that are favorable to Chinese character-using group, the effect of vocabulary and cultural element are found as a cause of DIF. Second, the effect of culture is divided into the effect of everyday life, the familiarity of text structure, and the effect of education experience. These are the evidence that cultural element shared by Chinese character - using group could be a cause of DIF. However, some discussion is required on to which extent such cultural element should be contained in TOPIK, as some cultural elements should be not be included in the measurement of Korean language competence.
Abstract
This study aims to determine the existence of Differential Item Functioning(DIF) in the Test of Proficiency in Korean(TOPIK) reading comprehension and to analyse the peculiarity and cause of DIF. The specific questions asked in the study are as follows:First, what are the peculiarity and cause of DIF regarding gender in TOPIK reading comprehension?Second, what are the peculiarity and cause of DIF regarding language difference (Chinese character-based language/non-Chinese character-based language) in TOPIK reading comprehension?The study's conclusions are as follows:First, there are 91 language - background DIF items in the 16th to 18th TOPIK reading comprehension. As a result of analysing language DIF that are favorable to Chinese character-using group, the effect of vocabulary and cultural element are found as a cause of DIF. Second, the effect of culture is divided into the effect of everyday life, the familiarity of text structure, and the effect of education experience. These are the evidence that cultural element shared by Chinese character - using group could be a cause of DIF. However, some discussion is required on to which extent such cultural element should be contained in TOPIK, as some cultural elements should be not be included in the measurement of Korean language competence.
참고문헌 (73)
- 이원경, "한국어 평가론" (2006), 태학사
- 고우리, "한국어 어휘·문법 숙달도 평가 방안 연구 : 한국어능력시험 1, 2급 문항 분석을 중심으로", 석사, 외국어로서의한국어교육, pp.2004
- 김성훈, "문항차별기능의 인지심리학적 해석 가능성 검토", 교육평가연구, 8(2), pp.39~62 (1995), 한국교육평가학회
- 김신영, "차별적 문항기능의 추출방법" (2001), 교육과학사
- 한국어능력시험평가기준 개발 연구, "김왕규", 교육인적자원부, ~ (2001)
- 김유정, "한국어능력시험의 난이도 분석 연구", 한국어교육, 17(1), pp.21~46 (2006), 국제한국어교육학회
- 김지인, "2000학년도 대학입학수학능력시험 외국어영역의 검사특징과 문항특성 분석", Foreign Languages Education, 8(2), pp.1~22 (2001), 한국외국어교육학회
- 한국어능력시험 등급기준 조정및 문제은행 구축 방안 연구, "남명호", 한국교육과정평가원, ~ (2000)
- 노언경, "PISA 2003 문제해결력 영역에 대한 성별 차별기능문항 추출", 교육방법연구, 22(4), pp.165~194 (2010), 한국교육방법학회
- 민병곤, "한국어능력시험의 운영 현황 및 과제", 한국어교육, 16(3), pp.137~162 (2005), 국제한국어교육학회
- 박찬호, "Differential Item Functioning Analysis of an EFL Vocabulary Test", 영어교육, 65(3), pp.23~41 (2010), 한국영어교육학회
- 서윤남, "한국어능력시험 쓰기 평가 개선방안 연구: 4회, 5회, 6회 문제 분석을 중심으로", 석사, 한국어 교육, pp.2003
- 성태제, "문항반응이론 입문" (1991), 양서원
- 성태제, "1994학년도 제1차 대학수학능력시험의 성별에 따른 차별기능 문항 추출", 교육평가연구, 7(2), pp.87~101 (1994), 한국교육평가학회
- 성태제, "문항반응이론의 이해와 적용" (2001), 교육과학사
- 손원숙, "차별기능문항 기법의 응용:교육 및 심리검사의 번안과정에서", 교육평가연구, 15(1), pp.207~225 (2002), 한국교육평가학회
- 안유진, "한국어능력시험 읽기 영역 학습자 반응 분석 연구 : 중국어권 중급 학습자를 중심으로", 석사, 외국어로서의한국어교육, pp.2010
- Andrew Sangpil Byon, "Understanding the reading process of beginning American KFL learners : Using Think-Aloud protocols", 한국어교육, 15(1), pp.259~280 (2004), 국제한국어교육학회
- 양길석, "전문가 판단방법에 따른 문항 간 차등배점의 타당성 연구", 한국교육학연구, 13(1), pp.197~219 (2007), 안암교육학회
- 오은희, "한국어 학습자의 어휘추측전략 분석 연구 : 한자권-비한자권 중·고급 학습자를 대상으로", 석사, 외국어로서의한국어교육, pp.2009
- 우혜령, "한국어능력시험의 문항에 대한 연구 : 제2회 한국어능력시험 1급 읽기 영역 문항 분석을 중심으로", 석사, 한국학, pp.2000
- 한국어능력시험 개선방안연구, "윤희원", 한국교육과정평가원, ~ (2010)
- 이경희, "차별기능문항군 추출 방법을 활용한 대학수학능력시험 수리 영역에서의 성차 탐색", 석사, 교육학, pp.2004
- 이영주, "Detecting DIF across different language groups in a reading comprehension test", 영어학, 7(1), pp.51~72 (2007), 한국영어학회
- 이완기, "영어평가 방법론 개정판" (2007), 문진미디어
- 이준호, "‘한국어능력시험’에서의 추론 기술 평가 연구- 이해 영역을 중심으로-", 한국어학, 46, pp.317~351 (2010), 한국어학회
- 이해영, "한국어 이해능력 평가의 원리 및 실제", 한국어교육, 16(3), pp.275~304 (2005), 국제한국어교육학회
- 박주경, "외국어 학습, 교수의 원리" (2007), 피어슨에듀케이션코리아
- Brown. H., D., "Principles of language learning and teaching" (2007), Pearson Longman
- 장은아, "한국어능력시험의 성별에 따른 차별기능문항 분석", 이중언어학, 32, pp.291~324 (2006), 이중언어학회
- 전은주, "한국어 능력 시험 평가 문항의 내용타당도 분석 -제12회 일반 한국어(S-TOPIK)의 쓰기 듣기 읽기 영역을 중심으로-", 국어교육학연구, (31), pp.129~165 (2008), 국어교육학회
- 전현정, "문항과 검사 수준에서의 차별기능 분석 및 원인 탐색을 위한 통합적 접근", 박사, 교육학, pp.2010
- 정은주, "한국어능력시험(TOPIK) 읽기 영역 지문의 통사론적 난이도 연구", 석사, 국어국문학, pp.2010
- 조동완, "Differential item functioning of an ESL Structure test in terms of Gender", 영어교육, 50(4), pp.141~151 (1995), 한국영어교육학회
- 조윤희, "한국어능력시험 읽기 문항 유형 및 주제 분석 :한국어능력시험 초급 읽기 영역을 중심으로", 석사, 외국어로서의한국어교육, pp.2010
- 조인옥, "한국어능력시험의 언어권별 수험자 반응분포에 대한 연구 : 제3회 시험 수험자의 답안결과를 중심으로", 석사, 국어국문학, pp.2000
- 조인옥, "한국어능력 평가 답안 분석 - 제12회 한국어능력시험 수험자 반응 연구 -", 외국어로서의 한국어교육, 32, pp.237~258 (2007), 연세대학교 언어연구교육원 한국어학당
- 진수정, "MH방법과 SIBTEST방법을 이용한 문항유형에 따른 차별기능문항의 탐색", 교육평가연구, 17(2), pp.215~236 (2004), 한국교육평가학회
- 진수정, "문항 유형에 의한 문항의 차별적 기능 탐색", 석사, 교육학, pp.2004
- Abbott, M. L., "A confirmatory approach to differential item functioning on an ESL reading assessment", Language testing, 24(1), pp.7~36 (2007)
- Item Performance Across Native Language Groups on the Test of English as a Foreign Language, "Alderman, D. L.", ETS Research, ~ (1981)
- Allalouf, A., "Constructing Better Second Language Assessments Based on Differential item Functioning Analysis", Language Assessment Quarterly, 5(2), pp.120~141 (2008)
- Content Bias in the Test of English as a Foreign Language, "Angoff, W. H.", ETS Research, ~ (1989)
- Bae, J., "A latent variable approach to listening and reading: testing factorial invariance across two groups of children in the Korean", English Two-Way Immersion Program, 1998, pp.15(3), 380~414
- Bolt, D. M., "A SIBTEST Approach to Testing DIF Hypotheses Using Experimentally Designed Test Items", Journal of Educational Measurement, 37(4), pp.307~327 (2000)
- Breland, H., "Investigating Uniform and Non-Uniform Gender DIF in Computer-Based ESL Writing Assessment", Applied Measurement in Education, 20(4), pp.377~403 (2007)
- An Analysis of TOEL CBT Writing Prompt Difficulty and Comparability for Different Gender Groups, "Breland, H.", ETS Research, ~ (2004)
- Camilli, G., "Test fairness, In Education Measurement", pp.221~256 (2006), Praeger Publishers
- Carson, J., G., "Becoming Biliterate: First Language Influences", Journal of Second Language Writing, 1(1), pp.37~60 (1992)
- Chang, H., "Detecting DIF for Polytomously Scored Items : An Adaptation of the SIBTEST Procedure", Journal of Educational Measurement, 33(3), pp.333~353 (1996)
- Chen, Z., "Linguistic and cultural bias in language proficiency tests", Language Testing, 2, pp.155~163 (1985)
- Ferne, T., "A Synthesis of 15 Years of Research on DIF in Language Testing : Methodological Advances, Challenges, and Recommendations", Language Assessment Quarterly, 4(2), pp.113~148 (2007)
- Holland, P. W., "Differential item functioning" (1993), Lawrence Erlbaum Associates
- Hudson, T., "Teaching Second Language Reading" (2007), Oxford University Press
- Jang, E. E., "Integrative Analytic Approach to Detecting and Interpreting L2 Vocabulary DIF", International Journal of Testing, 9, pp.238~259 (2009)
- Kim, M., "Detecting DIF across the different language groups in a speaking test", Language testing, 18(1), pp.89~114 (2001)
- Kim, Y. H., "Differential Functioning of Reading Subskills on the OSSLT for L1 and ELL Students : A Multidimensionality Model-Based DBF", DIF Approach, 2009, pp.59(4), 825~865
- Kunnan, A. J., "Editorial : Test Fairness, Test Bias, and DIF", Language Assessment Quarterly, 4(2), pp.109~112 (2007)
- Kunnan, A. J., "DIF in Native Language and Gender Groups in an ESL Placement Test", TESOL Quarterly, 24(4), pp.741~746 (1990)
- Lin, J., "Differential Performance by Gender in Foreign Language Testing", Paper presented at the Annual Meeting of the National Council on Measurement in Education (2003)
- Mahoney, M., "Linguistic influence on differential item functining for second language learners on the national assement of educational progress", International Journal of Testing, 8, pp.14~33 (2008)
- Pae, T. I., "Gender effect on reading comprehension with Korean EFL learners", System, 32, pp.265~281 (2004)
- Detecting DiF across Different Langauge and Gender Groups in the MELAB Essay Test using the Logistic Regression Method, "Park, T.", English Language Institute, University of Michigan, ~ (2006)
- Roever, C., "DIF in the Assessment of Second Language Pragmatics", Language Assessment Quarterly, 4(2), pp.165~189 (2007)
- Ross, T. R., "The impact of multidimensionality on the detection of differential bundle functioning using SIBTEST", 박사, pp.2007
- Ryan, K., "Differential item functioning on two tests of EFL proficiency", Language Testing, 9, pp.12~29 (1992)
- Sasaki, M., "A comparison of two methods for detecting differential item functioning in an ESL placement test", Language testing, 8, pp.95~111 (1991)
- Shealy, R., "A Model-based standardization Approach that Separates True Bias", DIF from Group Ability Differences an Detect Test Bias, DIF, pp.Psychometrika, 1993[DOI]
- Smith, W. F., "Language-Related DIF in the WASL Mathematics Test", 박사, pp.2009
- Takala, S., "Test fairness: a DIF analysis of an L2 vocabulary test", Language testing, 17(3), pp.323~340 (2000)
- Wainer, H., "Test Validity" (1988), LEA
- Zhang, J., "A cultural look at information and communication technologies in Eastern education", Education Tech Research, 55, pp.301~314 (2007)
- Zumbo, B. D., "Three Generations of DIF Analyses : Considering Where It Has Been, Where It Is Now, and Where It Is Going", Language Assessment Quarterly, 4(20), pp.223~233 (2007)
