Analysis of Test Qualities: English Test in a Nationwide Coalition Scholastic Ability Test
1
조회
0
다운로드
1
인용
0
참고문헌
키워드
초록
This study analyzed student test performance on the Nationwide Coalition Scholastic Ability Test to examine the consistency and appropriateness of the test items within a broad assessment framework (including the test design, development, and interpretation). The test, including 17 listening and 28 reading multiple-choice items, was administered to a total of 329 2nd grade high school students. Their responses to each individual test item was statistically analyzed by calculating the test reliability, item difficulty, and item discrimination. Overall, the test items consistently measured the students’ English ability, but further statistical and qualitative item analyses revealed room for improvement, such as an imbalance of item difficulty between the listening and reading parts of the test, reading items with low discrimination, and unreasonably weighted items. This study provides implications for improving the Nationwide Coalition Scholastic Ability Test, which can also apply to the College Scholastic Ability Test.
Abstract
This study analyzed student test performance on the Nationwide Coalition Scholastic Ability Test to examine the consistency and appropriateness of the test items within a broad assessment framework (including the test design, development, and interpretation). The test, including 17 listening and 28 reading multiple-choice items, was administered to a total of 329 2nd grade high school students. Their responses to each individual test item was statistically analyzed by calculating the test reliability, item difficulty, and item discrimination. Overall, the test items consistently measured the students’ English ability, but further statistical and qualitative item analyses revealed room for improvement, such as an imbalance of item difficulty between the listening and reading parts of the test, reading items with low discrimination, and unreasonably weighted items. This study provides implications for improving the Nationwide Coalition Scholastic Ability Test, which can also apply to the College Scholastic Ability Test.
참고문헌 (32)
- American Council on the Teaching of Foreign Languages, "ACTFL proficiency guidelines", American Council on the Teaching of Foreign Languages, ~ (2012)
- Bachman, L. F., "Fundamental considerations in language testing" (1990), Oxford University Press
- Bachman, L. F., "Statistical analyses for language assessment" (2004), Cambridge University Press
- Bachman, L. F., "Language testing in practice" (1996), Oxford University Press
- Bauer, F., "A validity study of the English subtest of the college scholastic ability test", English Teaching, 52(1), pp.41~57 (1997)
- Brown, J. D., "Testing in language programs: A comprehensive guide to English language assessment" (2005), McGraw-Hill
- Cha, K. W., "A study of English listening items of Korean scholastic aptitude test (KSAT) for college entrance", English Teaching, 47(2), pp.49~75 (1994)
- Cha, K. W., "An analysis of English listening items of the 1st, and 2nd Korean scholastic aptitude test (KSAT) for college entrance", English Teaching, 50(2), pp.209~231 (1995)
- Cha, K. W., "English listening items on the college scholastic ability test of Korea", English Teaching, 52(2), pp.265~288 (1997)
- 장경숙, "대학수학능력시험 외국어(영어)영역 읽기 난이도 예측 모형 개발", Foreign Languages Education, 11(1), pp.111~130 (2004), 한국외국어교육학회
- 허준, "대학수학능력시험 영어 듣기평가에 관하여: 영어교사들과 대학생들의 설문조사를 토대로", Foreign Languages Education, 11(3), pp.185~207 (2004), 한국외국어교육학회
- Jin, Kyung-Ae, "The Prediction of English Item Difficulty in College Scholatic Ability Test", 영어교육, 59(1), pp.267~278 (2004), 한국영어교육학회
- 진경애, "Factors Related to the Difficulty of College Scholastic Ability Test English Items", 영어교육, 60(3), pp.17~25 (2005), 한국영어교육학회
- Kim, I. D., "College scholastic ability test and English education", Foreign Languages Education, 1, pp.39~70 (1995)
- Kim, J., "Analysis of test and item characteristics of the English section of 2000 college scholastic ability test", Foreign Languages Education, 8(2), pp.1~22 (2001)
- Kim, M., "Comparing question types in the high school English textbooks and the college scholastic abilities test", English Teaching, 56(4), pp.349~371 (2001)
- 김성혜, "영어시험 타당도와 대학수학에 필요한 영어 능력", Foreign Languages Education, 18(3), pp.261~289 (2011), 한국외국어교육학회
- 김영수, "Text Readability of the College Scholastic Ability Test and High School English II Textbooks", 영어교육, 67(4), pp.195~218 (2012), 한국영어교육학회[DOI]
- Korea Institute for Curriculum and Evaluation, "2018 college scholastic ability test: Q & A", Korea Institute for Curriculum and Evaluation, ~ (2017)
- "College Scholastic Ability Test"[URL]
- Kwon, O., "High school English teachers’ concerns and needs regarding an innovation called college scholastic abilities test : An analysis through the concerns-based model", English Teaching, 48, pp.265~290 (1994)
- 권오량, "대학수학능력시험 외국어(영어) 영역 정책 변천사", 영어교육, 70, pp.3~34 (2015), 한국영어교육학회[DOI]
- 이병천, "2014 대학수학능력시험에서의 실용영어와 기초학술영어 개념과 분류 준거 연구", Foreign Languages Education, 20(3), pp.247~267 (2013), 한국외국어교육학회
- Lee, J. H., "Some comprehensive suggestions for the improvement of the college scholastic ability test(CSAT)", English Teaching, 56(2), pp.333~364 (2001)
- Ministry of Education, Science and Technology, "English national curriculum", Ministry of Education, Science and Technology, ~ (2009)
- Pellegrino, J. W., "Knowing what students know: The science and design of educational assessment" (2001), The National Academies Press
- Pellegrino J. W., "A framework for conceptualizing and evaluating the validity of instructionally relevant assessments", Educational Psychologist, 51(1), pp.59~81 (2016)
- Purpura, J. E., "Assessing grammar" (2004), Cambridge University Press
- Purpura, J. E., "Language testing and assessment: Encyclopedia of language and education", pp.33~61 (2017), Springer
- Shin, M. S., "An analysis of the structural patterns of English reading test passages in the college scholastic ability test", English Teaching, 54(4), pp.309~326 (1999)
- 신상근, "The Characteristics of Absolute Grading of the College Scholastic Ability Test English Section", 영어교육, 73(3), pp.95~113 (2018), 한국영어교육학회[DOI]
- Song, H., "The effect of the college scholastic ability test (CSAT) on Korean college students’ reading processes and their perceptions of reading in English", English Teaching, 53(4), pp.265~290 (1998)