본문 바로가기
KERD
논문KCI 등재

Gender Differential Item Functioning Analysis of an English Listening Comprehension Test

최세일|유밍밍
사단법인 한국언어학회 (The Linguistic Society of Korea)|2013.12|언어학 (EONEOHAG)|제21권 제4호|pp. 79-98|DOI 10.24303/lakdoi.2013.21.4.79

2

조회

0

다운로드

0

인용

0

참고문헌

키워드

test validityfairnessitem typedifferential item functioninglistening proficiency testitem content
주제분류언어학

초록

The purpose of this study was to track down gender differential item functioning (DIF) in an English listening comprehension test. The study employed multiple DIF detection methods to avoid inconsistent results from a single method. The results of the study showed that out of the total 100 items in the test, 9 items were found with significant uniform DIF—4 items favoring males while the other 5 in favor of females. However, subsequent analyses of test characteristics function and test information function revealed that despite the existence of the DIF items in favor of either females or males, the test as a whole was not gender biased. The authors further provided possible explanations for the items displaying gender DIF with support from the relevant research in the literature.

Abstract

The purpose of this study was to track down gender differential item functioning (DIF) in an English listening comprehension test. The study employed multiple DIF detection methods to avoid inconsistent results from a single method. The results of the study showed that out of the total 100 items in the test, 9 items were found with significant uniform DIF—4 items favoring males while the other 5 in favor of females. However, subsequent analyses of test characteristics function and test information function revealed that despite the existence of the DIF items in favor of either females or males, the test as a whole was not gender biased. The authors further provided possible explanations for the items displaying gender DIF with support from the relevant research in the literature.

참고문헌 (35)

  1. Bacon, S. M., "A study of the attitudes, motives, and strategies of university foreign language students and their disposition to authentic oral and written input", Modern Language Journal, 74(4), pp.459~473 (1990)
  2. Barati, H., "Gender‐based DIF across the subject area : A study of the Iranian National University Entrance Exam", The Journal of Teaching Language Skills, 2(3), pp.1~26 (2010)
  3. Bolger, N., "Method of measurement and gender inferences in scholastic achievement", Journal of Educational Measurement, 27(2), pp.157~164 (1990)
  4. Camilli, G., "Methods for identifying biased test items" (1994), Sage
  5. Cohen, A., "A mixture model analysis of differential item functioning", Paper presented at the annual meeting of the American Educational Research Association (2002)
  6. Davies, A., "Test fairness: A response", Language Testing, 27(2), pp.171~176 (2010)
  7. Content factors in sex differences on test questions, "Donlon, A.", Educational Testing Service, 73~28, pp.Research Memorandum (1973)
  8. Ehrman, M., "Effects of sex differences, career choice, and psychological type on adult language learning strategies", Modern Language Journal, 72, pp.253~265 (1988)
  9. Exploring differential item functioning on science achievement tests, "Hamilton, L. S.", ~, pp.CSE Technical Report 483 (1998)
  10. Kamata, A., "An Introduction to differential item functioning analysis", Learning Disabilities : A Contemporary Journal, 2, pp.49~69 (2004)
  11. Kane, M., "Validity and fairness", Language Testing, 27(2), pp.177~182 (2010)
  12. Karami, H., "Detecting gender bias in a language proficiency test", International Journal of Language Studies, 5(2), pp.27~38 (2011)
  13. Kunnan, A. J., "Test fairness and Toulmin’s argument structure", Language Testing, 27(2), pp.183~189 (2010)
  14. Kunnan, A. J., "Fairness and justice for all", Fairness and Validation in Language Assessment: Selected Papers from the 19th Language Testing Research Colloquium, pp.1~14 (2000)
  15. Lane, S., "Gender‐related differential item functioning on a middle‐school mathematics performance assessment", Educational Researcher, 15, pp.21~27 (1996)
  16. Linn, M. C., "Gender differences in national assessment of educational progress science items: what does “don’t know” really mean?", Journal of Research in Science Teaching, 24(3), pp.267~278 (1987)
  17. Lin, J., "Differential performance by gender in foreign language testing", Poster presented at the annual meeting of the National Council on Measurement in Education (2003)
  18. Sex‐related performance differences on constructed‐response and multiple choice sections of Advanced Placement Examinations, "Mazzeo, J.", College Entrance Examination Board, ~, pp.College Board Report No.92-7; ETS RR-93-5 (1993)
  19. Nandakumar, R., "Simultaneous DIF amplification and cancellation : Shealy-Stout's test for DIF", Journal of Educational Measurement, 30, pp.293~311 (1993)
  20. Nunan, D., "Language teaching methodology: A textbook for teachers" (1991), Prentice‐Hall
  21. Pae, T. I., "Gender differential item functioning on a national language test", 박사, pp.2002
  22. Pae, T. I., "Gender effect on reading comprehension with Korean EFL learners", System, 32(2), pp.265~281 (2004)
  23. Pae, T. I., "Causes of gender DIF on an EFL language test : A multiple‐data analysis over nine years", Language Testing, 29(4), pp.533~554 (2012)
  24. Pae, T., "Examining the relationship between differential item functioning and differential test functioning", Language Testing, 23(4), pp.475~496 (2006)
  25. Park, G. P., "Comparison of L2 listening and reading comprehension by university students learning English in Korea", Foreign Language Annals, 37, pp.448~458 (2004)
  26. Park, G. P., "Differential item functioning on an English listening test across gender", TESOL Quarterly, 42(1), pp.115~122 (2008)
  27. Scheuneman, J. D., "Using differential item functioning procedures to explore sources of item difficulty and group performance characteristics", Journal of Educational Measurement, 27(13), pp.109~131 (1990)
  28. Shohamy, E., "Validation of listening comprehension tests : The effect of text and question type", Language Testing, 8, pp.23~40 (1991)
  29. Takala, S., "Test fairness : A DIF analysis of an L2 vocabulary test", Language Testing, 17, pp.323~340 (2000)
  30. Thissen, D., "Beyond group mean differences : The concept of item bias", Psychological Bulletin, 99, pp.118~128 (1986)
  31. Thissen, D., "Detection of differential item functioning using the parameters of item response models, In Differential item functioning", pp.67~113 (1993), Lawrence Erlbaum
  32. Willingham, W. W., "Fairness issues in test design and use, In Gender and fair assessment", pp.227~346 (1997), Lawrence Erlbaum Associates
  33. Xi, X., "How do we go about investigating test fairness?", Language Testing, 27(2), pp.147~170 (2010)
  34. Young, D. J., "A gender‐related analysis of strategies used to process written input in the native language and a foreign language", Applied Language Learning, 8(1), pp.43~73 (1997)
  35. A handbook on the theory and methods of differential item functioning (DIF): Logistic regression modeling as a unitary framework for binary and Likert‐type (ordinal) item scores, "Zumbo, B. D.", Directorate of Human Resources Research and Evaluation, Department of National Defense, ~ (1999)

관련 논문AI추천

Test Fairness: DIF beyond Group Mean Differences박기표팬코리아영어교육학회 · 영어교육연구2009 · 제21권 제1호Differential Item Functioning Analysis of an EFL Vocabulary Test박찬호한국영어교육학회 · 영어교육2010 · 제65권 제3호A Gender–Related Differential Item Functioning Study of an English TestMasoud Geramipour, Niloufar Shahmirzadi아시아테플 · Journal of Asia TEFL2019 · 제16권 제2호Parameter Invariance for Males and Females on an English Listening Comprehension TestTae-IlPae한국영어교육학회 · 영어교육2003 · 제58권 제2호An Investigation Into Gender Effects In English Test Responses허진희외국어교육연구소 · 외국어교육연구2011 · 제25권 제1호Examining Measurement Characteristics of an English Listening Comprehension Test김영수, 최세일21세기영어영문학회 · 영어영문학212014 · 제27권 제4호

이 간행물의 다른 논문 (12건)

Gradual Divergence in MOP and POC:Focus on Burmese Noun Compounding이민경pp. 1-25A Base-generated Fragment Approach to Sluicing Constructions유은정pp. 27-56An Aspect of Sonorant Dissimilation in Takelma정진완pp. 57-78The Evaluation of L2 Pronunciation by the Raters’ Language Background강석한pp. 99-117Advanced Korean EFL Learners’ Use of the English Simple Past and Present Perfect in Controlled Contexts최문홍, 박민정pp. 119-145
원문 보기