영어과 국가수준 학업성취도 평가의 시험 전략성 및 출제방안 탐색
An exploration into test-taking strategies and item writing techniques of the English section of the NAEA (National Assessment of Educational Achievement)
0
조회
0
다운로드
1
인용
0
참고문헌
키워드
초록
Test-wise students can get multiple-choice items right just by analyzing characteristics of options. The present study explored test-taking strategies the ninth graders usually employ while taking the NAEA. Item writers (also junior high school teachers) reported six test-taking strategies. First, it is very likely that the shortest option is not a key. Second, it is very likely that the one option different from the rest of options in terms of category is not a key. Third, it is very likely that the option with (A)-(B)-(C) in the ordering item is not a key. Fourth, it is very likely that the one option between the very similar two options is not a key. Fifth, it is very likely that the option which contained the target words twice in the grammar item is not a key. Sixth, it is very likely that the option with the general statement in the comprehension of specific information is not a key. Efforts should be made to ensure high validity of the NAEA in a way that the ninth graders minimize the test-taking strategies.
Abstract
Test-wise students can get multiple-choice items right just by analyzing characteristics of options. The present study explored test-taking strategies the ninth graders usually employ while taking the NAEA. Item writers (also junior high school teachers) reported six test-taking strategies. First, it is very likely that the shortest option is not a key. Second, it is very likely that the one option different from the rest of options in terms of category is not a key. Third, it is very likely that the option with (A)-(B)-(C) in the ordering item is not a key. Fourth, it is very likely that the one option between the very similar two options is not a key. Fifth, it is very likely that the option which contained the target words twice in the grammar item is not a key. Sixth, it is very likely that the option with the general statement in the comprehension of specific information is not a key. Efforts should be made to ensure high validity of the NAEA in a way that the ninth graders minimize the test-taking strategies.
참고문헌 (12)
- 2011년 국가수준 학업성취도 평가 출제 연구, "김미경", 국교육과정평가원, ~, pp.2011-3-1 (2011)
- 김해동, "FLEX 영어" (2010), 한국외국어대학교 출판부
- 성태제, "문항제작 및 분석의 이론과 실제" (2010), 학지사
- 2010년 국가수준 학업성취도 평가 결과 분석: 영어, "이영주", 한국교육과정평가원, ~, pp.RRE 2011-3-6 (2011)
- 국가수준 영어 학업성취도 평가의 최적의 선택지 개수 분석, "이영주", 한국교육과정평가원, ~, pp.RRE 2012-12 (2012)
- 장경숙, "학습자 배경변인과 국가수준 영어 학업성취도", 영어어문교육, 13(3), pp.253~273 (2007), 한국영어어문교육학회
- 김성연, "Options in a Multiple-Choice English Test: Quality over Quantity", 영어학, 12(1), pp.19~39 (2012), 한국영어학회
- Costin, F., "Three-choice versus four-choice items: implications for reliability and validity of objective achievement tests", Educational and Psychological Measurement, 32, pp.1035~1038 (1972)
- Haladyna, T., "How many options is enough for a multiple-choice test item?", Educational and Psychological Measurement, 53, pp.999~1010 (1991)
- Henning, G., "A guide to language testing" (1987), Heinle and Heinle Publishers
- Millman, Y., "An analysis of test-wiseness", Educational and Psychological Measurement, 25, pp.707~726 (1965)
- Owen, S., "What’s wrong with three-option multiple choice items?", Educational and Psychological Measurement, 47, pp.513~522 (1987)