한국어 학습자 쓰기 자동채점 자질 연구: 어휘 정교도를 중심으로
Features for Automated Scoring of Korean Learners’ Writing: Focusing on Lexical Sophistication
1
조회
0
다운로드
0
인용
0
참고문헌
키워드
초록
The purpose of this study is to extract and validatefeatures related to vocabulary proficiency for automated scoring of Koreanlearners' writing. Despite being crucial for the performance of writing automaticscoring models, research outcomes on features in the field of Korean educationhave not been sufficiently accumulated. Particularly, regarding vocabularyproficiency related to learners' vocabulary usage, various measurement indicatorsbeyond frequency-based metrics have not been developed. Therefore, in thisstudy, we developed lexical sophistication measurement indicators consideringthe characteristics of Korean and validated their validity through statisticalmethods. The results of the study showed that in correlation analysis, “Low-Frequencyword(Total),” “Low-Frequency word(Content Word),” “Narrow range word(Total),” “Narrow range word(Content Word),” “Intermediate Vocabulary(Total),”“Intermediate Vocabulary(Content Word),” “Advanced Vocabulary(ContentWord),” “Academic Vocabulary(Content Word),” and “Sino-Korean Vocabulary”exhibited moderate correlations with the score of “Language Diversity”. In logisticregression analysis, “Low-Frequency word(Content Word),” “The Widest Rangeword(Content Word),” “Basic Vocabulary(Total),” “Advanced Vocabulary(Total),” “Abstract Noun,” and “Hypernym” significantly contributed to classifying the levelof learners' writing samples, accurately classifying 74.2% of samples. This study holds significance in extracting vocabulary proficiency-related featuresfor automated assessment of Korean learners' writing and validating theireffectiveness as scoring features. If research outcomes on various scoring featurescontinue to accumulate, a comprehensive study of scoring features for automatedassessment of Korean learners' writing could be achieved.
Abstract
The purpose of this study is to extract and validatefeatures related to vocabulary proficiency for automated scoring of Koreanlearners' writing. Despite being crucial for the performance of writing automaticscoring models, research outcomes on features in the field of Korean educationhave not been sufficiently accumulated. Particularly, regarding vocabularyproficiency related to learners' vocabulary usage, various measurement indicatorsbeyond frequency-based metrics have not been developed. Therefore, in thisstudy, we developed lexical sophistication measurement indicators consideringthe characteristics of Korean and validated their validity through statisticalmethods. The results of the study showed that in correlation analysis, “Low-Frequencyword(Total),” “Low-Frequency word(Content Word),” “Narrow range word(Total),” “Narrow range word(Content Word),” “Intermediate Vocabulary(Total),”“Intermediate Vocabulary(Content Word),” “Advanced Vocabulary(ContentWord),” “Academic Vocabulary(Content Word),” and “Sino-Korean Vocabulary”exhibited moderate correlations with the score of “Language Diversity”. In logisticregression analysis, “Low-Frequency word(Content Word),” “The Widest Rangeword(Content Word),” “Basic Vocabulary(Total),” “Advanced Vocabulary(Total),” “Abstract Noun,” and “Hypernym” significantly contributed to classifying the levelof learners' writing samples, accurately classifying 74.2% of samples. This study holds significance in extracting vocabulary proficiency-related featuresfor automated assessment of Korean learners' writing and validating theireffectiveness as scoring features. If research outcomes on various scoring featurescontinue to accumulate, a comprehensive study of scoring features for automatedassessment of Korean learners' writing could be achieved.
참고문헌 (39)
- 안혜진, "한국어빈도 프로파일 구축 및 타당도 검증 연구-어휘 세련도 분석을 중심으로", 한국어교육, 34(2), pp.153~178 (2023)
- Bardakci, M, "Breadth and Depth of Vocabulary Knowledge and Their Effects on L2 Vocabulary Profiles", English Language Teaching, 9(4), pp.239~250 (2016)
- Bulté, B., "Defining and Operationalising L2 Complexity, Dimensions of L2 Performance and Proficiency : Complexity, Accuracy and Fluency in SLA", Language Learning & Language Teaching, 32, pp.21~46 (2012)
- Coxhead, A, "A New Academic Word List", TESOL quarterly, 34(2), pp.213~238 (2000)
- Crossley, S. A., "Toward a New Readability: A Mixed Model Approach", Proceedings of the Annual Meeting of the Cognitive Science Society, pp.197~202 (2007)
- Crossley, S. A., "The Tool for the Automatic Analysis of Text Cohesion(TAACO) : Automatic Assessment of Local, Global, and Text Cohesion", Behavior Research Methods, 48, pp.1227~1237 (2016)
- Graesser, A. C., "Coh-Metrix: Analysis of Text on Cohesion and Language", Behavior Research Methods, Instruments, & Computers, 36(2), pp.193~202 (2004)
- Reseach on Korean Language Education Vocabulary Content Development (Stage 4), "Han, Song-hoa", National Institute of Korean Language, ~ (2015)
- Hirao, R., "Automated Essay Scoring System for Nonnative Japanese Learners", Proceedings of the Twelfth Language Resources and Evaluation Conference, pp.1250~1257 (2020)
- Jang, Yeon-ji, "A Study on Lexical Sophistication Measurement of Korean Learner Corpus", Master, pp.2018
- 장연지, "어휘 정교도 측정을 위한 기초 연구", 국제어문, 79, pp.85~108 (2018)
- Lexical Diversity and Lexical Density in Speech and Writing: A Developmental Perspective, "Johansson, V", Lund University, 61~79, pp.Working papers (2008), Lund University, Department of Linguistics and Phonetics 53
- 주월랑, "여성결혼이민자의 어휘 사용 연구-복잡성 측정을중심으로-", 언어와 문화, 14, pp.223~248 (2018)
- 정진경, "언어권별 한국어 학습자의 어휘 풍요도 측정 연구-중국어권, 일본어권, 영어권 학습자 말뭉치의 작문 자료를 대상으로-", 국제어문, 91, pp.251~272 (2021)
- Research on Korean Language Education Vocabulary Content Development (Stage 1), "Kang, Hyoun-hwa", National Institute of Korean Language, ~ (2012)
- Research on Korean Language Education Vocabulary Content Development (Stage 2), "Kang, Hyoun-hwa", National Institute of Korean Language, ~ (2013)
- Research on Korean Language Education Vocabulary Content Development (Stage 3), "Kang, Hyoun-hwa", National Institute of Korean Language, ~ (2014)
- Ke, Z., "Automated Essay Scoring: A Survey of the State of the Art", International Joint Conference on Artificial Intelligence, pp.6300~6308 (2019)
- A Study on the Application of International Standard Korean Language Curriculum, "Kim, Jung-seob", National Institute of Korean Language, ~ (2017)
- 김민정, "단어재인에 미치는 연상과 심상성의영향", 인지과학, 20(3), pp.243~274 (2009)
- 김민수, "일본인 한국어 학습자의 작문에 나타나는 어휘 풍요도연구", 학습자중심교과교육연구, 22(2), pp.263~284 (2022)
- 김승주, "채점자질 설계를 통한 지도 학습 기반 작문 자동 채점의 타당도 확보 방안 탐색", 청람어문교육, 69, pp.265~295 (2019)
- 김선미, "한국어 학습자의 어휘 사용 양상 종단 연구", 리터러시연구, 14(3), pp.65~90 (2023)
- Kyle, K, "Measuring Syntactic Development in L2 Writing: Fine Grained Indices of Syntactic Complexity and Usage-based Indices of Syntactic Sophistication", Ph.d, pp.2016
- Kyle, K., "Automatically Assessing Lexical Sophistication Indices, Tools, Findings, and Application", Tesol Quarterly, 49(4), pp.757~786 (2015)
- Kyle, K., "The Tool for the Automatic Analysis of Lexical Sophistication (TAALES): Version 2.0", Behavior Research Methods, 50(4), pp.1030~1046 (2018)
- Laufer, B., "Vocabulary Size and Use: Lexical Richness in L2 Written Production", Applied Linguistics, 16(3), pp.307~322 (1995)
- 이진, "한국어 학습자 쓰기 자동채점을 위한 자질 연구-내용 및 구조 관련 채점 자질을 중심으로-", 국제어문, 99, pp.433~471 (2023)
- 이영주, "판별분석을 통해 살펴본 영어 능력 수준을 구별하는 어휘의 정교화 특성", The Journal of the Convergence on Culture Technology (JCCT), 8(5), pp.691~696 (2022)
- 임지룡, "국어 어휘범주의 기본층위 탐색 및 의미특성 연구", 담화와인지, 18(1), pp.153~182 (2011)
- Louviere, J. J., "Stated Choice Methods: Analysis and Applications", pp.34~82 (2000), Cambridge university press
- Nation, I, "How Large a Vocabulary is Needed for Reading and Listening?", Canadian Modern Language Review, 63, pp.59~82 (2006)
- A Study on the Development of Automated Scoring Method for Computer-based Essay and Short Answer Question Type Assessment (Ⅰ), "Park, Jong-im", Korea Institute for Curriculum and Evaluation, ~ (2022)
- Read, J, "Assessing Vocabulary" (2000), Cambridge University Press
- Saw, Shin-ngwe, "A Study on the Complexity and Accuracy of Korean Intermediate and Advanced Learners Focusing on Narrative and Argument Genre", Ph.d, pp.2022
- Sin, Myeong-seon, "A Study on Korean Academic Vocabulary Education", Ph.d, pp.2004
- Taghipour, K., "A Neural Approach to Automated Essay Scoring", Proceedings of the 2016 Conference on Empirical Methods in Natural Language Processing, pp.1882~1891 (2016)
- 원미진, "한국어 학습자의 쓰기에 나타난 어휘 풍요도 연구-숙달도 측정 도구로써어휘 풍요도 측정 가능성을 중심으로-", 어문론총, 71, pp.33~55 (2017)
- Zhu, Yu-tong, "A Study on the Aspects of Language Development of Chinese Korean Learners-Focusing on the Complexity and Accuracy-", Ph.d, pp.2019