Evaluating Intra-Grade Consistency in First and Second-Year High School Mock CSAT Reading Passages via Coh-Metrix
1
조회
0
다운로드
0
인용
0
참고문헌
키워드
초록
This corpus-informed research examines the intra-grade continuity of the first and second-year mock CSAT exams, administered quarterly by four regional educational offices: Seoul in March, Busan in June, Incheon in September, and Gyeonggi Province in November. The corpus contains a total of 200 reading passages compiled from the 2023 mock CSAT exams, analyzed via Coh-Metrix to explore a wide spectrum of linguistic features across lexical, syntactic, textual, and cohesion-related indices. Overall, the results indicated that, except for the second-grade average word length, there was no statistically significant evidence to support strong intra-grade continuity. These results provide valuable insights into the design and educational practices of the exams, highlighting areas for potential enhancement to better meet test objectives.
Abstract
This corpus-informed research examines the intra-grade continuity of the first and second-year mock CSAT exams, administered quarterly by four regional educational offices: Seoul in March, Busan in June, Incheon in September, and Gyeonggi Province in November. The corpus contains a total of 200 reading passages compiled from the 2023 mock CSAT exams, analyzed via Coh-Metrix to explore a wide spectrum of linguistic features across lexical, syntactic, textual, and cohesion-related indices. Overall, the results indicated that, except for the second-grade average word length, there was no statistically significant evidence to support strong intra-grade continuity. These results provide valuable insights into the design and educational practices of the exams, highlighting areas for potential enhancement to better meet test objectives.
참고문헌 (25)
- Chang, J., "A comparison of lexical complexity in 2016-2019 CSAT English reading passages by the types of assessment(norm-referenced assessment vs. criterion-referenced assessment)", The SNU Journal of Education Research, 28(3), pp.85~110 (2019)
- Chang, J., "A multi-dimensional comparison of CSAT English reading passages before and after the use of criterion-referenced assessment", Language Research, 58(1), pp.61~89 (2022)
- Choi, Y., "Machine learning-based item difficulty prediction model using item text features", Secondary English Education, 17(1), pp.46~66 (2024)
- Coltheart, M, "The MRC psycholinguistic database", Quarterly Journal of Experimental Psychology, 33, pp.497~505 (1981)
- Doo, S., "A comparative analysis on difficulty of LC and RC of the KCSAT and the mock KCSAT English tests", English Language Assessment, 15(2), pp.119~147 (2020)
- Graesser, A. C., "New Beginnings in Literary Studies", pp.72~88 (2008), Cambridge Scholars Publishing
- Graesser, A. C., "Discourse cohesion in text and tutorial dialogue", Information Design Journal, 15(3), pp.199~213 (2007)
- Graesser, A. C., "Coh-Metrix: Analysis of text on cohesion and language", Behavioral Research Methods, Instruments, and Computers, 36(2), pp.193~202 (2004)
- Kim, J., "A comparison of the lexical, syntactic, and discourse features between the listening and the reading texts in the College Scholastic Ability Test", Modern English Education, 22(1), pp.45~56 (2021)
- Kim, K., "An analysis on the vocabulary of recent CSAT’s English listening assessment : Lexical scales, word difficulty, and high frequency content words", English Language Teaching, 33(2), pp.23~36 (2021)
- Kim, S., "A corpus-based analysis of linguistic difficulty of the CSAT English section under absolute grading", English Language Assessment, 16(2), pp.205~227 (2021)
- Koh, N., "A comparison of the level of difficulty in the English reading part of the CSAT : Before and after the EBS-CSAT linkage policy", Secondary English Education, 10(4), pp.3~24 (2017)
- McNamara, D. S., "Automated evaluation of text and discourse with Coh-Metrix" (2014), Cambridge University Press
- Millis, K., "The influence of connectives on sentence comprehension", Journal of Memory and Language, 33, pp.128~147 (1994)
- The national curriculum of English language, "Ministry of Education", Ministry of Education, ~, pp.Notification No. 2020-255 (2020)
- Murray, J., "Connective and narrative text: The role of continuity", Memory and Cognition, 25(2), pp.227~236 (1997)
- Oh, J., "A corpus-based analysis of the linguistic complexity levels of reading passages in the Korean college entrance examination", English Language Teaching, 32(2), pp.109~126 (2020)
- Shin, Y., "Analyzing CSAT reading passages by using Coh-Metrix and VocaProfile : Focusing on four years from 2016 to 2019", Journal of Language Sciences, 26(4), pp.109~127 (2019)
- Lee, D, "The analysis of linkage of the Korea Educational Broadcasting System (EBS) with the College Scholastic Ability Test (CSAT) & trial test for CSAT and the study on improvements for the linkage (in the English part of the test)", master, pp.2015
- Lee, D., "The analysis of linkage of the Korea educational broadcasting system (EBS) with the college scholastic ability test (CSAT) & trial test for CSAT and the study on improvements for the linkage (in the English Part of the Test)", Secondary English Education, 8(4), pp.69~94 (2015)
- Lee, H, "Vocabulary analysis of the English section of the 2017 CSAT and CSAT simulations", International Language and Literature, 41, pp.195~216 (2018)
- Lee, J, "The comparative analysis on the text difficulty among English reading question types in CSAT", English Language Assessment, 17(1), pp.45~63 (2022)
- Lee, J., "A Comparison of Linguistic Aspects in English Reading Passages of 2012-2023 CSAT Mock Tests Between Grading Systems and Between June and September Tests", Journal of the Korea English Education Society, 22(1), pp.1~23 (2023)
- Park, J., "An Analysis of the Difficulty of Reading Passages in the CSAT and High School English Textbooks of the 2015 Revised Curriculum", Studies on English Language & Literature, 47(3), pp.147~170 (2021)
- Ryu, J., "An analysis of the inter-grade continuity of the reading passages of high school English mock CSAT tests using Coh-Metrix", English Language & Literature Teaching, 29(2), pp.41~59 (2023)