생성형 인공지능 ChatGPT의 영어 독해 문항 풀이 능력 탐색
Investigating the performance of generative AI ChatGPT’s reading comprehension ability
0
조회
0
다운로드
32
인용
0
참고문헌
키워드
초록
This study examines the performance of the generative Artificial Intelligence, ChatGPT, in reading comprehension tasks of recent CSAT English tests. For this, several experiments were carried out in which ChatGPT responded to CSAT English reading items from the 2021 to 2023 versions, and the correct answer rates were determined. The study investigates how the correct answer rate might vary by item type and according to the different versions of ChatGPT (3.5 and 4). The findings reveal that ChatGPT-3.5 answered approximately 69% of the reading items correctly, while GPT-4 achieved almost perfect results. Additionally, the study explores whether similar trends are found in other foreign language tests, using TOEFL iBT reading items. The results indicate a similar trend in TOEFL iBT items. The implications for teachers, test developers, and language learners on how to use this generative AI for teaching and learning and for test-preparation purposes are discussed. The study highlights the potential of using AI in the language learning and teaching processes and its potential impact on test development.
Abstract
This study examines the performance of the generative Artificial Intelligence, ChatGPT, in reading comprehension tasks of recent CSAT English tests. For this, several experiments were carried out in which ChatGPT responded to CSAT English reading items from the 2021 to 2023 versions, and the correct answer rates were determined. The study investigates how the correct answer rate might vary by item type and according to the different versions of ChatGPT (3.5 and 4). The findings reveal that ChatGPT-3.5 answered approximately 69% of the reading items correctly, while GPT-4 achieved almost perfect results. Additionally, the study explores whether similar trends are found in other foreign language tests, using TOEFL iBT reading items. The results indicate a similar trend in TOEFL iBT items. The implications for teachers, test developers, and language learners on how to use this generative AI for teaching and learning and for test-preparation purposes are discussed. The study highlights the potential of using AI in the language learning and teaching processes and its potential impact on test development.
참고문헌 (29)
- "챗GPT에 수능 영어·수학 문제 풀어보게 했더니" (2023), 고은이[URL]
- 공정식, "인공지능 ChatGPT와의 대화에서 엿본 미래의 희망", 대한토목공학회지, 71(3), pp.12~15 (2023)[DOI]
- 권서경, "대학수학능력시험 영어영역 읽기 문항 난이도 요인 탐색: EBS 연계정책 변화를 중심으로", 영어교과교육, 21(2), pp.49~71 (2022), 한국영어교과교육학회
- 김민지, "인공지능 챗봇의 교육적 활용 연구 동향 분석: 활동이론을 중심으로", 교육정보미디어연구, 27(2), pp.699~721 (2021), 한국교육정보미디어학회
- 김소연, "AI 챗봇을 도입한 초등학교 영어 디지털 교과서 활용 수업의 정의적 효과", 학습자중심교과교육연구, 21(10), pp.37~49 (2021), 학습자중심교과교육학회
- 김혜영, "영어학습을 위한 인공지능 챗봇 활용및 제작" (2019), 교육과학사
- "챗GPT, 학교 활용은 시기상조…신기술 출현 대비해야" (2023)[URL]
- "학력평가풀서비스"[URL]
- 서소담, "AI 챗봇 활용 수업이 초등 학습자의 영어 어휘 능력과 정의적 영역에 미치는 영향", 영어교과교육, 22(1), pp.149~170 (2023), 한국영어교과교육학회
- 신동광, "AI 도구를 활용한 중등교사 영어 출제 연수 사례 연구: ChatGPT를 중심으로", 어학연구, 59(1), pp.21~42 (2023), 언어교육원
- 신동광, "내용중심 영어 교수 학습의 도구로서 ChatGPT의 활용 가능성 탐색", 영어교과교육, 22(1), pp.171~192 (2023), 한국영어교과교육학회
- 임희주, "교양영어 수업에서 영어자동번역기 사용에 대한 대학생의 인식 및 태도연구 ― 영작문 수업을 중심으로", 교양교육연구, 11(6), pp.727~751 (2017), 한국교양교육학회
- 이상민, "인공신경망 기계번역의 오류분석 및 퀄리티 평가", 외국어교육연구, 34(4), pp.129~153 (2020), 외국어교육연구소[DOI]
- 정제영, "챗GPT 교육혁명" (2023), 포르체
- "챗GPT 한국에서 대학수학능력시험을 본다면....영어 2등급, 수학은 아직 낙제 수준" (2023), 정한영[URL]
- 정한민, "ChatGPT를 이용한 문헌 작성 설계 및 이슈", 한국지식정보기술학회 논문지, 18(1), pp.31~40 (2023), 한국지식정보기술학회[DOI]
- 최윤희, "인공지능기반 기계번역기와 영어교육에 대한 문헌 고찰", 총신대논총, 41, pp.211~231 (2021)
- Abbasi, S., "Measuring effectiveness of learning chatbot systems on student’s learning outcome and memory retention", Asian Journal of Applied Science and Engineering, 3(7), pp.57~66 (2014)[DOI]
- Brown, T., "Language models are few-shot learners", Advances in Neural Information Processing Systems, 33, pp.1877~1901 (2020)
- Ducar, C., "Machine translation and the L2 classroom : Pedagogical solutions for making peace with Google translate", Foreign Language Annals, 51(4), pp.779~795 (2018)[DOI]
- "TOEFL iBT® Reading Practice Questions" (2021)[URL]
- Fredholm, K., "Effects of Google Translate on lexical diversity : Vocabulary development among learners of Spanish as a foreign language", Revista Nebrija de Linguistica Aplicada a la Ense˜nanza de las Lenguas, 13(26), pp.98~117 (2019)[DOI]
- Fryer, L., "Bots as language learning tools", Language Learning and Technology, 10(3), pp.8~14 (2006)
- Kohnke, L., "ChatGPT for Language Teaching and Learning", RELC Journal (2023)
- Lee, J. H., "Chatbots", ELT Journal, 74(3), pp.338~344 (2020)
- Lee, S. M., "The impact of using machine translation on EFL students’writing", Computer Assisted Language Learning, 33(3), pp.157~175 (2020)[DOI]
- "ChatGPT: Optimizing language models for dialogue"[URL]
- "Improving language understanding by generative pre-training" (2018)[URL]
- Tsai, S. -C., "Using google translate in EFL drafts : A preliminary investigation", Computer Assisted Language Learning, 32(5-6), pp.510~526 (2019)