The Characteristics of Absolute Grading of the College Scholastic Ability Test English Section
2
조회
0
다운로드
9
인용
0
참고문헌
키워드
초록
The purpose of this study was to critically examine the absolute grading system applied to the English section of South Korea’s College Scholastic Ability Test (CSAT), in a departure from a relative grading system, for the first time in 2017. English language instructors as well as English education researchers have somewhat differing understandings of the concept of absolute evaluation/grading. This paper investigated the nature of absolute evaluation/grading as presented in theses and academic papers as well as research reports, English language assessment textbooks, and press releases from the Ministry of Education (MOE). The study identified four different testing contexts in which the term absolute evaluation/grading is applied: criterion-referenced testing; grading based on fixed cut scores; measurement against external criteria; and norm-referenced testing. While retaining the same test structures as in the prior norm-referenced testing situation, the CSAT English section corresponds to the second context, that is, interpreting results based on fixed cut scores. Achievement standards essential for producing criterion-referenced tests have so far been undefined, with cut scores being arbitrarily set. The examination concluded that the CSAT English section under an absolute grading scale is essentially a norm-referenced test that produces a significantly larger percentage of higher-level test-takers. There is a fair likelihood that, unlike MOE’s claim, converting to an absolute evaluation/grading system may not bring about the intended positive change.
Abstract
The purpose of this study was to critically examine the absolute grading system applied to the English section of South Korea’s College Scholastic Ability Test (CSAT), in a departure from a relative grading system, for the first time in 2017. English language instructors as well as English education researchers have somewhat differing understandings of the concept of absolute evaluation/grading. This paper investigated the nature of absolute evaluation/grading as presented in theses and academic papers as well as research reports, English language assessment textbooks, and press releases from the Ministry of Education (MOE). The study identified four different testing contexts in which the term absolute evaluation/grading is applied: criterion-referenced testing; grading based on fixed cut scores; measurement against external criteria; and norm-referenced testing. While retaining the same test structures as in the prior norm-referenced testing situation, the CSAT English section corresponds to the second context, that is, interpreting results based on fixed cut scores. Achievement standards essential for producing criterion-referenced tests have so far been undefined, with cut scores being arbitrarily set. The examination concluded that the CSAT English section under an absolute grading scale is essentially a norm-referenced test that produces a significantly larger percentage of higher-level test-takers. There is a fair likelihood that, unlike MOE’s claim, converting to an absolute evaluation/grading system may not bring about the intended positive change.
참고문헌 (45)
- Bachman, L. F., "Fundamental considerations in language testing" (1990), Oxford University Press
- 배원희, "중등학교 영어과 성취평가제 운영 실태 및 교사 인식 연구", 중등교육연구, 64(3), pp.611~634 (2016), 사범대학부속중등교육연구소[DOI]
- Boo, J. Y., "Educational curriculum and evaluation for pre-service and in-service teachers" (2005), Kyoyukkwahaksa
- Brown, J. D., "Criterion-referenced language testing" (2002), Cambridge University Press
- 최수정, "수능영어 절대평가 정책에 대한 중등학교 교사들의 인식 연구", 영어영문학연구, 58(4), pp.371~402 (2016), 한국중앙영어영문학회[DOI]
- Chung, J., "English language education policy in Asia", pp.281~299 (2016), Springer International
- Davidson, F., "The Routledge handbook of language testing", pp.197~207 (2012), Routledge
- Glaser, R., "Instructional technology and the measurement of learning outcomes", American Psychologist, 18(8), pp.519~522 (1963)
- Hudson, T., "The companion to language assessment" (2013), Routledge
- Im, B. -B., "How to evaluate English education" (2005), Hangukmunhwasa
- Im, B. -B., "English teaching and learning assessment" (1999), Hangukmunhwasa
- Im, S. O., "A study of teachers’, students’, and parents’ perceptions of criterionreferenced evaluation in the English section of the CSAT", master’s, pp.2017
- Jang, H. S., "A study on the perception of English education due to the change of English CSAT to the criterion-referenced system", master’s, pp.2017
- Jung, H., "Development of criterion-referenced English oral proficiency interview", Honam University Research Journal, 20, pp.153~165 (1999)
- Kang, G. H., "Policy considerations for introducing absolute testing of English section of CSAT", Paper presented at the 26th KICE Curriculum and Evaluation Policy Forum, pp.17~25 (2014), Korea Institute for Curriculum and Evaluation
- Kang, H. E., "A study of learners’ perception on absolute grading system in the English section of CSAT", master’s, pp.2015
- 강석한, "영어 절대평가에서 교직 경험이 준거 설계 및 적용에 미치는 영향", 언어학 연구, (42), pp.311~335 (2017), 한국중원언어학회[DOI]
- Kim, D. K., "A proposal for performance assessment criteria with focus on speaking and writing abilities", English Teaching, 54(2), pp.175~200 (1999)
- Kim, E. H., "Trends in test results of norm-referenced and absolute testing of English as a middle school", master’s, pp.2013
- Kim, J. -L., "Assessment guidelines for primary English education" (2012), Hangukmunhwasa
- Kim, J. -S., "Curriculum and assessment for English subject" (2009), Hangukmunhwasa
- Kim, N. K., "Absolute testing of CSAT English and some suggestions for secondary English education", master’s, pp.2018
- Kim, S. -A., "Understanding English assessment" (2014), Globalcontents
- Kim, Y. -M., "An issue on introduction of the criterion-referenced evaluation (CRE) into the English domain of CSAT", Advanced Science and Technology Letters, 115, pp.107~111 (2015)
- 김용명, "수능 영어 20년: 회고와 전망", 영미어문학, (119), pp.275~299 (2015), 한국영미어문학회
- Scoring result for June trial examination of 2019 College Scholastic Ability Test, "Korea Institute for Curriculum and Evaluation.", Korea Institute for Curriculum and Evaluation, ~ (2018)
- Introduction of absolute testing in English section in CSAT, "Korea Institute for Curriculum and Evaluation.", Korea Institute for Curriculum and Evaluation, ~, pp.CAT 2014-36 (2014)
- 권오량, "대학수학능력시험 외국어(영어) 영역 정책 변천사", 영어교육, 70, pp.3~34 (2015), 한국영어교육학회[DOI]
- Kwon, S. B., "A text-mining study on public opinion toward criterion-referenced college scholastic ability test", master’s, pp.2018
- Lee, H. W., "A study of secondary teachers' perception on the criterion-referenced evaluation of CSAT", master’s, pp.2015
- Lee, J. Y., "A study about how the application of criterion-referenced evaluation in CSAT affects English studies", master’s, pp.2018
- Lee, J. -H., "Elementary English education and evaluation" (2012), Hangukmunhwasa
- Lee, S. Y., "A study on the development of national common absolute testing standards for English curriculum", English Linguistics Science, 1, pp.59~62 (1999)
- Lee, W. -K., "English assessment methodology" (2012), MunJinMedia
- Linn, R. L., "Measurement and assessment in teaching" (1995), Macmillan
- Ministry of Education, "Introduction of absolute assessment in the English section of CSAT", ~ (2014)
- Ministry of Education, "Announcement of grading results and grade notification for the 2018 CSAT", MOE, ~ (2017)
- Basic plan for 2018 CSAT, "Ministry of Education", MOE, ~ (2017)
- Shin, D., "On the issue of test specifications in the development of a criterion-referenced achievement test", English Teaching, 55(2), pp.309~330 (2010)
- Shin, R. B., "Issues of introduction of absolute testing to English section of CSAT", master’s, pp.2016
- Shin, S. -K., "Theory and practice of foreign language assessment" (2010), Hangukmunhwasa
- 신상근, "Korea’s English Curriculum: Review, Issues and Future Directions", 교과교육학연구, 21(3), pp.206~215 (2017), 교과교육연구소[DOI]
- Song, S. E., "A study of high school students’ perception on criterion-referenced evaluation of CSAT English", master’s, pp.2017
- Sung, T. -J., "Foundations of educational evaluation" (2014), Hakjisa
- Yi, J. H., "A study of students' perceptions on criterion-referenced evaluation of CSAT in 2018", master’s, pp.2016