ChatGPT를 활용한 AI 글쓰기 의사소통 역량 평가도구 개발 과정에 대한 연구: 기술 전문가와의 상호소통을 중심으로
An Exploratory Study on Developing the AI Essay Test Tool based on ChatGPT: Focusing on the Interaction with the Engineer
1
조회
0
다운로드
5
인용
0
참고문헌
키워드
초록
본 연구는 ChatGPT를 활용한 글쓰기 의사소통 역량을 평가하는 AI 평가도구 개발에 초점을 두었다. 개발 과정에 있어 내용전문가와 기술 전문가 간의 상호작용을 통해 IT와 인문사회 영역의 융합과정을 탐구하였다. 내용 전문가와 기술 전문가는 긴밀한 소통 및 상호작용을 통해, 글쓰기 의사소통 역량의 채점기준을 탑재하였고 각 영역별(내용의 적절성, 조직의 효과성, 어법의정확성) 점수와 피드백을 제공하는 AI 평가도구를 개발하였다. 이 과정에서 본 연구는 내용과 기술이 어떻게 결합하는지에 대한 과정을 드러내고, 이후 생성형 AI를 활용한 평가도구 기술 전문가를 포함한 융합연구자들이 유의해야 할 사항 등에 대해 제시하였다.
Abstract
This study focused on the development of an AI essay tool for assessing writing-communication competence using ChatGPT. During the development process, the interaction between content expert and technical expert was emphasized to explore the fusionof IT and humanities and social sciences. Through close communication and interaction between the content and technical experts,they incorporated scoring criteria for writing-communication competence and developed an AI essay test tool that provides scoresand feedback in the appropriateness of content, effectiveness of organization, and accuracy of grammar. This process revealed howcontent and technology combine and presented considerations for future fusion researchers, including technical experts in generativeAI assessment tools.
참고문헌 (20)
- S. H. Kim, "Analysis of functions and services for the development of AI education platform", The Journal of Korean Association of Computer Education, 24(2), pp.25~37 (2021)
- "Monthly Report"[URL]
- H. Jang, "The analysis of research trends and topics about the educational use of ChatGPT", Journal of Research in Curriculum & Instruction, 27(4), pp.387~401 (2023)
- "AI trends identified at the Edutech Korea Fair" (2023)[URL]
- Substanitializing methods of restricted and extended response essay assessment through enforcing the instruction-assessment alignment, "H. Park", KICE, ~ (2019)
- K. Ercikan, "Optimizing implementation of artificial intelligence-based automated scoring : an evidence centered design approach for designing assessments for AI-based scoring", Journal of Educational Measurement, 59(3), pp.272~287 (2022)
- "Siwon School Lab-Data Bank, providing AI mock test platform ‘The Test Glider’"[URL]
- S. W. Han, "A study on the effects of communicative competence on information literacy of undergraduates", Journal of the Korean Library and Information Science, 50(1), pp.377~394 (2016)
- C. Lim, "The development and effects of design and implementation strategies for supporting web-based selfregulated learning", Journal of Educational Technology, 18(4), pp.3~23 (2002)
- B. Kim, "A study of IT convergence desired talent based on computation thinking", Proceeding of the 2014 Winter Conference of the Korean Association of Computer Education, pp.27~33 (2014)
- J. M. Lee, "Analysis of human resources practices and career path movement in the field of convergence technologies", The Journal of the Korea Contents Association, 10(5), pp.446~459 (2010)
- J. Kim, "BSC(Balanced Scorecard)implementation factors and firm performance : The role of communication, strategic alignment, and cooperation", Korean Accounting Journal, 20(1), pp.233~264 (2011)
- J. Bae, "A study on the influencing factors and performance of communication patterns among partners in collaborative R&D projects", Proceeding of the 1998 Spring Conference of KIEE and KORMS, pp.1~9 (1998)
- V. Spandel, "A Handbook for Student Performance Assessment in an Era of Restructuring", ASCD
- J. Park, "A study on the differences of the anchor papers according the rater consistence", Korean Writing Association, 14, pp.301~338 (2012)
- I. Park, "Determinants of successful R&D cooperations between SMEs and public research institutes in Korea", Journal of Korea Technology Innovation Society, 15(4), pp.783~814 (2012)
- B. Min, "Development of a writing ability diagnosis system for university first-year students － The Seoul National University essay examination", The Korean Journal of Literacy Research, 13(6), pp.45~76 (2022)
- Y. M. Park, "The method and procedure of evaluating writing ability", The Journal of Korean Language and Literature Education, pp.1~29
- S. Seo, "Study on setting the components of writing assignment", Korean Language Education Research, 33, pp.449~472 (2008)
- H. Song, "An analysis of basic grammar evaluations for college students’ writing", The Journal of Korean Language and Literature Education, 35, pp.31~57 (2015)