A Study on AI TOEIC Tutor: For English Learning by CEFR Proficiency Levels
0
조회
0
다운로드
0
인용
0
참고문헌
키워드
초록
This paper examines whether and to what extent an AI tutor affects TOEIC learning of English learners. For the study, a total of 110 students were recruited and randomly assigned to an AI tutor group (n = 57) and a human tutor group (n = 53). The study also investigates the difference in English proficiency among students in the two groups. Before the experiment, a TOEIC pre-test was administered. Based on the pre-test scores, participants were grouped into three CEFR proficiency levels: A1, A2, and B1. During the experimental period, the AI tutor group self-studied English with an AI tutor. The human tutor group took a traditional English class offered by a human tutor. After the experiment, a post-test was administered. The study found that the human tutor group increased their TOEIC test scores at all proficiency levels at the 5% significance level. On the other hand, the AI tutor group showed significant increases only at A1 and A2 levels. The group difference was statistically significant for the A1-level participants, indicating the superior effects of the AI tutor over the human tutor. On a basis of the findings, pedagogical implications are made.
Abstract
This paper examines whether and to what extent an AI tutor affects TOEIC learning of English learners. For the study, a total of 110 students were recruited and randomly assigned to an AI tutor group (n = 57) and a human tutor group (n = 53). The study also investigates the difference in English proficiency among students in the two groups. Before the experiment, a TOEIC pre-test was administered. Based on the pre-test scores, participants were grouped into three CEFR proficiency levels: A1, A2, and B1. During the experimental period, the AI tutor group self-studied English with an AI tutor. The human tutor group took a traditional English class offered by a human tutor. After the experiment, a post-test was administered. The study found that the human tutor group increased their TOEIC test scores at all proficiency levels at the 5% significance level. On the other hand, the AI tutor group showed significant increases only at A1 and A2 levels. The group difference was statistically significant for the A1-level participants, indicating the superior effects of the AI tutor over the human tutor. On a basis of the findings, pedagogical implications are made.
참고문헌 (42)
- Chinnery, G. M., "Going to the MALL: Mobile assisted language learning", Language Learning & Technology, 10(1), pp.9~16 (2006)
- Curtis, K. M, "Improving student attitudes: A study of a mathematics curriculum innovation", doctor, pp.2006
- Dörnyei, Z., "Research methods in applied linguistics" (2007), Oxford University Press
- Ellis, R., "Task-based research and language pedagogy", Language Teaching Research, 4(3), pp.193~220 (2000)[DOI]
- Gall, M., "Synthesis of research on teachers’ questioning", Educational Leadership, 42(3), pp.40~47 (1984)
- Hayashi, K., "CALL for Widening Participation: Short papers from EUROCALL 2020", pp.88~95 (2020), Research-publishing.net
- Hsieh, J. S. C., "Technological acceptance of LINE in flipped EFL oral training", Computers in Human Behavi, 70, pp.178~190 (2017)[DOI]
- Huang, W., "Chatbots for language learning : Are they really useful? A systematic review of chatbot-supported language learning", Journal of Computer Assisted Learning, 38(1), pp.237~257 (2022)[DOI]
- Istrate, A. M., "The impact of the virtual assistant (VA) on language classes", Conference proceedings of eLearning and software for education, 15(1), pp.296~301 (2019), Carol I National Defence University Publishing House
- Jones, S., "The effect of the fourth industrial revolution on general English education", Korean Journal of General Education, 12(2), pp.169~197 (2018)
- Joshi, S., "Changing the learning paradigm re", innovation in today’s higher education in India, 2018, pp.7(4), 1705~1711
- Kanero, J., "Social robots for early language learning : Current evidence and future directions", Child Development Perspectives, 12(3), pp.146~151 (2018)[DOI]
- Kannan, J., "New trends in second language learning and teaching through the lens of ICT, networked learning, and artificial intelligence", Círculo de Lingüística Aplicada a la Comunicación, 76, pp.13~30 (2018)[DOI]
- Keerthiwansha, N. W. B. S., "Artificial intelligence education (AIEd) in English as a second language (ESL) classroom in Sri Lanka", Artificial Intelligence, 6(1), pp.31~36 (2018)
- Kerr, P., "Adaptive learning", ELT Journal, 70(1), pp.88~93 (2016)[DOI]
- Kim, H. S., "Impact of mobile interactions with AI on writing performance", Modern English Education, 21(2), pp.1~13 (2020)[DOI]
- Kim, H. S., "Effects of AI chatbots on EFL students’ communication skills", Korean Journal of English Language and Linguistics, 21, pp.712~734 (2021)[DOI]
- Kim, N. Y, "Effects of different voice-chat conditions on Korean EFL learners’ speaking ability, oral interaction, and affective factors", doctor, pp.2016
- Kim, N. Y., "A study on chatbots for developing Korean college students’ English listening and reading skills", Journal of Digital Convergence, 16(8), pp.19~26 (2018)[DOI]
- Kusumaningrum, M. A. D., "An intelligent tutoring system for learning listening TOEIC", Jurnal Berdaya Mandiri, 3(1), pp.456~467 (2021)[DOI]
- van Lier, L, "Interaction in the Language Curriculum: Awareness, Autonomy and Authenticity" (1996), Longman
- Loh, H, "Recommendation for effective standardized exam preparation", LAK21: 11th International Learning Analytics and Knowledge Conference, pp.397~404 (2021)
- "Artificial intelligence in education transformation" (2020)[URL]
- Murray, D, "Student perceptions of flipped learning", Australian Computer Science Communications, 37(2), pp.57~62 (2015)
- Obari, H., "CALL and Complexity: Short papers from EUROCALL 2019", pp.327~333 (2019), Research-publishing.net
- Obari, H., "The impact of AI on teaching EFL in Japan", The Aoyama Journal of Economics, 71(4), pp.29~40 (2020)[DOI]
- Obari, H., "CALL for Widening Participation: Short papers from EUROCALL 2020", pp.253~258 (2020), Research-publishing
- Pandarova, I., "Predicting the difficulty of exercise items for dynamic difficulty adaptation in adaptive language tutoring", International Journal of Artificial Intelligence in Education, 29(3), pp.342~367 (2019)[DOI]
- Pannu, A., "Artificial intelligence and its application in different areas", Artificial Intelligence, 4(10), pp.79~84 (2015)
- Park, J. H., "Students’ perceptions of artificial intelligence technology and artificial intelligence teachers", The Journal of Korean Teacher Education, 34(2), pp.169~192 (2017)[DOI]
- Pham, X. L., "Chatbot as an intelligent personal assistant for mobile language learning", Proceedings of the 2018 2nd International Conference on Education and E-Learning, pp.16~21 (2018)
- Popenici, S. A., "Exploring the impact of artificial intelligence on teaching and learning in higher education", Research and Practice in Technology Enhanced Learning, 12(1), pp.1~13 (2017)[DOI]
- Self, J., "The defining characteristics of intelligent tutoring systems research : ITSs care, precisely", International Journal of Artificial Intelligence in Education, 10(3-4), pp.350~364 (1998)
- Selwyn, N, "The Wiley Handbook of Educational Policy", pp.457~477 (2018), John Wiley & Sons
- Shishido, M, "Proceedings of EdMedia + Innovate Learning", pp.213~218 (2019), Association for the Advancement of Computing in Education (AACE)
- Sirikanjanawong, N., "Relationship between the ICAO language proficiency requirements(LPRs)and test of English for international communication(TOEIC)scores of flight attendants in Thailand", LEARN Journal : Language Education and Acquisition Research Network, 11(1), pp.64~86 (2018)
- Slavuj, V., "Adaptivity in educational systems for language learning : A review", Computer Assisted Language Learning, 30(1-2), pp.64~90 (2017)[DOI]
- Song, S. Y., "The prospect and ethical reflection of relationship between AI robots and human beings", The Journal of English Cultural Studies, 10(3), pp.61~83 (2017)[DOI]
- Tannenbaum, R. J, "Mapping TOEIC® and TOEIC Bridge™ test scores to the Common European Framework of Reference", The Research Foundation for the TOEIC Tests: A Compendium of Studies, 2, pp.1~10 (2013)
- Woolf, B. P, "Building intelligent interactive tutors: Student-centered strategies for revolutionizing e-learning" (2008), Morgan Kaufmann
- Yang, H., "Development and application of AI chatbot for cabin crews", Korean Journal of English Language and Linguistics, 21, pp.1085~1104 (2021)[DOI]
- Yoon, S. Y., "Student readiness for AI instruction : Perspectives on AI in university EFL classrooms", Multimedia-Assisted Language Learning, 22(4), pp.134~160 (2019)[DOI]