수학능력시험 문항 분석: 선택지 매력도를 중심으로

Abstract

This paper reports on an in-depth examination of the CSAT items which are taken from the following tests: 2002 CSAT, 2003 September trial-CSAT, and 2003 CSAT. Based on three criteria, probability value, discrimination index, and an analysis of distracters, four items per test were chosen for analysis. In analyzing the test results of the items, a special attention is paid to the distracter efficiency. Items of high probability values with low discrimination indices are undesirably strongly affected by a certain alternative among the choices. Items of low probability values with low discrimination indices are found to be affected not by distracters, but by lack of knowledge in language use. A close examination of good items with appropriate probability values and discrimination indices shows that the respondents tend to choose an alternative not on its attractiveness as an answer, but on their testing strategies. That is, instead of reading the whole text first and answering the question, they usually check the pattern of the item, its similarity and difference with previous items, and apply their testing strategies. In analyzing each item, the paper provides suggestions for making the distracters more attractive to prevent the respondents from applying their testing strategies.