절대평가 도입 전후 수능 영어 독해 지문의 통사적 복잡성 비교
A comparison of syntactic complexity in CSAT reading passages before and after the introduction of criterion-referenced evaluation.
0
조회
0
다운로드
37
인용
0
참고문헌
키워드
초록
The present study aimed to compare the reading passages in the English Section of the College Scholastic Aptitude Test (CSAT) before and after the introduction of criterion-referenced evaluation in terms of syntactic complexity. By using the web-based version (Ai & Lu, 2013; Lu & Ai, 2015) of Lu’s (2010, 2011) L2 Syntactic Complexity Analyzer, the five categories of syntactic complexity were examined: length of production unit (Mean Length of Clause, Mean Length of Sentence, Mean Length of T-unit), sentence complexity (Sentence Complexity Ratio), subordination (T-unit Complexity Ratio, Complex T-unit Ratio, Dependent Clause Ratio, Dependent Clauses per T-unit), coordination (Coordinate Phrases per Clause, Coordinate Phrases per T-unit, Sentence Coordination Ratio), and particular structures (Complex Nominals per Clause, Complex Nominals per T-unit, Verb Phrases per T-unit). Results showed that the reading passages between the academic years 2016-2017 (50 passages) and 2018-2019 (50 passages) did not differ across any of the fourteen syntactic complexity measures. This study suggests the need to set benchmarks against which the development of English as a second/foreign language can be measured and to utilize them in the new era of the CSAT English Section.
Abstract
The present study aimed to compare the reading passages in the English Section of the College Scholastic Aptitude Test (CSAT) before and after the introduction of criterion-referenced evaluation in terms of syntactic complexity. By using the web-based version (Ai & Lu, 2013; Lu & Ai, 2015) of Lu’s (2010, 2011) L2 Syntactic Complexity Analyzer, the five categories of syntactic complexity were examined: length of production unit (Mean Length of Clause, Mean Length of Sentence, Mean Length of T-unit), sentence complexity (Sentence Complexity Ratio), subordination (T-unit Complexity Ratio, Complex T-unit Ratio, Dependent Clause Ratio, Dependent Clauses per T-unit), coordination (Coordinate Phrases per Clause, Coordinate Phrases per T-unit, Sentence Coordination Ratio), and particular structures (Complex Nominals per Clause, Complex Nominals per T-unit, Verb Phrases per T-unit). Results showed that the reading passages between the academic years 2016-2017 (50 passages) and 2018-2019 (50 passages) did not differ across any of the fourteen syntactic complexity measures. This study suggests the need to set benchmarks against which the development of English as a second/foreign language can be measured and to utilize them in the new era of the CSAT English Section.
참고문헌 (34)
- 고나은, "Coh-Metrix를 이용한 수능 영어 읽기 영역 지문 난이도 비교: EBS-수능 연계 정책 전후", 중등영어교육, 10(4), pp.3~24 (2017), 한국중등영어교육학회
- 교육부, "대학수학능력시험 영어영역 절대평가 도입 (교육부 보도자료2014-12-26)", 교육부, ~ (2014)
- 교육부, "2015 개정 교육과정 : 영어", 교육부, ~ (2015)
- 김정렬, "수능영어 읽기 지문에 대한 통시적 Coh-Metrix 분석", 초등교과교육연구, 27, pp.63~78 (2017)
- 문지현, "대학수학능력시험 영어 읽기 지문의 언어적 요소 분석", 현대영어교육, 18(1), pp.193~211 (2017), 현대영어교육학회
- 박광현, "학습자 언어 자동분석 방법론-동향과 활용", 인문과학연구논총, 38(1), pp.235~255 (2017), 인문과학연구소[DOI]
- "수능-EBS연계율 70→50% 축소…폐지도 고려" (2018)[URL]
- 신명신, "대학 수학 능력 시험 영어 읽기 지문의 구문 패턴 분석", 영어교육, 54(4), pp.309~326 (1999)
- 이완기, "영어과 교육과정의 변천과 영어교육의 과제", 영어교육, 70, pp.35~52 (2015), 한국영어교육학회[DOI]
- 장지연, "Coh-Metrix를 통한 2017-2018 수능 영어 독해 지문 비교: 기초 산출치, 이독성, 용이성을 중심으로", Foreign Languages Education, 25(4), pp.81~106 (2018), 한국외국어교육학회[DOI]
- 최민주, "수능 영어 문항 유형간 응집력과 어휘정보 분석", 한국콘텐츠학회 논문지, 17(12), pp.378~385 (2017), 한국콘텐츠학회[DOI]
- 황은경, "영어 논술문에서의 성별의 차이:통사적 복잡성의 분석", 영어교과교육, 15(1), pp.127~146 (2016), 한국영어교과교육학회[DOI]
- Ai, H., "Automatic treatment and analysis of learner corpus data", pp.249~264 (2013), John Benjamins
- 배지영, "The Study of the Latent Structure of Linguistic Features in Korean College Students’ L2 Argumentative Writings", 영어교과교육, 17(3), pp.1~22 (2018), 한국영어교과교육학회[DOI]
- Biber, D., "Should we use characteristics of conversation to measure grammatical complexity in L2 writing development?", TESOL Quarterly, 45(1), pp.5~35 (2011)
- Fazilatfar, A. M., "The effect of unfocused written corrective feedback on syntactic and lexical complexity of L2 writing", Procedia-Social and Behavioral Sciences, 98, pp.482~488 (2014)
- Graesser, A. C., "Coh-Metrix : Providing multilevel analyses of text characteristics", Educational Researcher, 40(5), pp.223~234 (2011)
- 김지영, "Predicting L2 Writing Proficiency Using Linguistic Complexity Measures: A Corpus-Based Study", 영어교육, 69(4), pp.27~51 (2014), 한국영어교육학회[DOI]
- 김필애, "Literature Circle in an L2 Writing Classroom and Students' Writing Development", Foreign Languages Education, 22(4), pp.49~74 (2015), 한국외국어교육학회
- Klein, D., "Advances in neural information processing systems 15 (NIPS 2002)", pp.3~10 (2003), MIT Press
- Levy, R., "Tregex and Tsurgeon: Tools for querying and manipulating tree data structures", Paper presented at the 5th International Conference on Language Resources and Evaluation (LREC 2006) (2006)
- Lu, X., "Automatic analysis of syntactic complexity in second language writing", International Journal of Corpus Linguistics, 15(4), pp.474~496 (2010)
- Lu, X., "A corpus-based evaluation of syntactic complexity measures as indices of college-level ESL writers’ language development", TESOL Quarterly, 45(1), pp.36~62 (2011)
- Lu, X., "Syntactic complexity in college-level English writing : Differences among writers with diverse L1 backgrounds", Journal of Second Language Writing, 29, pp.16~27 (2015)
- McNamara, D. S., "Automated evaluation of text and discourse with Coh-Metrix" (2014), Cambridge University Press
- Norris, J. M., "Towards an organic approach to investigating CAF in instructed SLA : The case of complexity", Applied Linguistics, 30(4), pp.555~578 (2009)
- Ortega, L., "Syntactic complexity measures and their relationship to L2proficiency : A research synthesis of college-level L2 writing", Applied Linguistics, 24(4), pp.492~518 (2003)
- 박선영, "A Corpus-Based Study of Syntactic Complexity Measures as Developmental Indices of College-Level L2 Learners’ Proficiency in Writing", 응용언어학, 28(3), pp.139~160 (2012), 한국응용언어학회
- Storch, N., "Investigating tasks in formal language learning", pp.157~177 (2007), Multilingual Matters
- Wolfe-Quintero, K., "Second language development in writing : Measures of fluency, accuracy, & complexity" (1998), University of Hawai’i Press
- Yang, W., "Different topics, different discourse : Relationships among writing topic, measures of syntactic complexity, and judgments of writing quality", Journal of Second Language Writing, 28, pp.53~67 (2015)
- Yoon, H. -J., "Linguistic complexity in L2 writing revisited : Issues of topic, proficiency, and construct multidimensionality", System, 66, pp.130~141 (2017)
- Yoon, H. -J., "The linguistic development of students of English as a second language in two written genres", TESOL Quarterly, 51(2), pp.275~301 (2017)
- 윤태진, "Comparison of Two Essay Writing Tasks with Automatically Extracted Measures", 언어학 연구, (46), pp.379~400 (2018), 한국중원언어학회[DOI]