한국어 학습자 쓰기 자동 평가에서 전략적 언어 사용 평가를 위한 채점 자질에 대한 연구 - 논설문 장르에서 드러난 담화 구조적 자질과 필자 태도적 자질을 중심으로-
Analyzing scoring features for strategic language use in automatic writing - A focus on discourse structure and authorial attitude in argumentative essays -
0
조회
0
다운로드
4
인용
0
참고문헌
키워드
초록
The objective of this study was to identify strategic language factors that significantly impact scoring in the context of editorial writing by Korean learners, with a focus on determining whether these factors could be utilized as features for automated scoring. This research specifically aimed to explore the structural aspects of texts and the qualities of the author's attitude as potential scoring features, thereby investigating the strategic use of language. To achieve this, the study classified 59 editorial pieces into two groups: 35 were designated as the upper group and 24 as the lower group. Subsequent statistical analysis assessed the relevance of discourse structure and authorial attitude as scoring features. Additionally, a qualitative analysis was conducted to identify aspects not captured statistically and to suggest improvements for future feature establishment. The findings indicate that, depending on the genre, it is essential to identify elements that facilitate the interactive meaning between readers and writers at a strategic level, beyond what can be quantified through conventional scoring features. This study posits that for the future enhancement of automated scoring systems' technical precision, it is crucial to establish a diverse set of scoring features capable of assessing advanced language use capabilities. The academic significance of this research lies in its foundational approach to addressing this issue, positioning it as a pioneering study in the field.
Abstract
The objective of this study was to identify strategic language factors that significantly impact scoring in the context of editorial writing by Korean learners, with a focus on determining whether these factors could be utilized as features for automated scoring. This research specifically aimed to explore the structural aspects of texts and the qualities of the author's attitude as potential scoring features, thereby investigating the strategic use of language. To achieve this, the study classified 59 editorial pieces into two groups: 35 were designated as the upper group and 24 as the lower group. Subsequent statistical analysis assessed the relevance of discourse structure and authorial attitude as scoring features. Additionally, a qualitative analysis was conducted to identify aspects not captured statistically and to suggest improvements for future feature establishment. The findings indicate that, depending on the genre, it is essential to identify elements that facilitate the interactive meaning between readers and writers at a strategic level, beyond what can be quantified through conventional scoring features. This study posits that for the future enhancement of automated scoring systems' technical precision, it is crucial to establish a diverse set of scoring features capable of assessing advanced language use capabilities. The academic significance of this research lies in its foundational approach to addressing this issue, positioning it as a pioneering study in the field.
참고문헌 (23)
- 공나형, "학문 목적 한국어 학습자 학술적 텍스트의 인용 동사 사용에서 드러나는 저자성 분석-서론 및 이론적 논의 부분을 중심으로-", 언어와 문화, 20(1), pp.1~27 (2024)
- 김승주, "교실 단위 작문 평가에서 활용 가능한 작문 자동 채점 프로그램의 설계 방안에 대한 연구-인지공학적 설계 접근과 채점자의 인지 부하 요인을 고려하여-", 청람어문교육, 83, pp.157~203 (2021)
- 김승주, "채점 자질 설계를 통한 지도 학습 기반 작문 자동 채점의 타당도 확보 방안 탐색", 청람어문교육, 69, pp.265~295 (2019)
- 남미정, "한국어 쓰기 자동 채점을 위한 언어 자질 탐색 연구", 박사, pp.2023
- 남미정, "한국어 쓰기 자동 채점을 위한 언어 자질 탐색 연구", 언어사실과 관점, 57, pp.9~32 (2022)
- 박종임, "채점자질을 활용한 인공지능 기반 글쓰기 자동 채점 방안 탐색", 청람어문교육, 96, pp.135~172 (2023)
- 유소영, "한국어 학습자의 연어 사용과 쓰기의 질에 관한 연구", 언어와 문화, 19(3), pp.193~224 (2023)
- 유소영, "의미연결망을 활용한 한국어 학습자의 쓰기 특성 연구", 한민족문화연구, 81, pp.201~238 (2023)
- 이슬기, "작문 평가에서 텍스트 마이닝의 활용 가능성 탐색", 작문연구, 35, pp.99~131 (2017)
- 이용상, "한국어 쓰기 평가를 위한 자동채점의 가능성 탐색", 이중언어학, 86, pp.171~191 (2022)
- 이진, "한국어 학습자 쓰기 자동 채점을 위한 자질 연구-내용 및 구조 관련 채점 자질을 중심으로-", 국제어문, 99, pp.433~471 (2023)
- 임채훈, "유의 어휘관계와 문장의미 구성", 한국어 의미학, 34, pp.349~373 (2011)
- 최숙기, "인공지능 시대의 작문 평가를 위한 ChatGPT 활용 방안 연구", 청람어문교육, 95, pp.65~109 (2023)
- 한하림, "한국어 초급 아동 학습자의 문어 담화에 나타난 응집성 발달 연구-내러티브 작문 과제를 중심으로-", 작문연구, 58, pp.209~235 (2023)
- Berman, Ruth A., "Handbook of child language", pp.354~375 (2009), Cambridge University Press
- Berman, R. A., "Relating events in narrative: A crosslinguistic developmental study" (2013), Psychology Press
- Berman, Ruth A., "Language Development across childhood and adolescence", pp.9~34 (2004), John Benjamins
- Chen, C. F. E., "Beyond the design of automated writing evaluation : Pedagogical practices and perceived learning effectiveness in EFL writing classes", Language Learning & Technology, 12(2), pp.94~112 (2008)
- Chung, "Methodological Approaches to Online Scoring of Essays", ~ (1997)
- Crossley, S. A., "Predicting second language writing proficiency : The roles of cohesion and linguistic sophistication", Journal of Research in Reading, 35(2), pp.115~135 (2012)
- Hyland, K., "Stance and Engagement : A Model of Interaction in Academic Discourse", Discourse Studies, 7, pp.173~192 (2005)
- Li, J., "Rethinking the role of automated writing evaluation(AWE)feedback in ESL writing instruction", Journal of Second Language Writing, 27, pp.1~18 (2015)
- Lim, K., "Neural automated writing evaluation for Korean L2 writing", Natural Language Engineering, 29(5), pp.1341~1363 (2023)