본문 바로가기
KERD
논문KCI 등재

EFL Learners’ English Writing Feedback and Their Perception of Using ChatGPT

4

조회

0

다운로드

3

인용

0

참고문헌

키워드

주제분류영어와문학

초록

This study aims to investigate the utilization of AI-assisted feedback by EFL college learners in their English writing. Specifically, the research sought to explore how writing assisted by ChatGPT improves students’ writing skills in comparison to peer feedback. Additionally, the study aimed to understand the learners’ perceptions regarding the use of ChatGPT in editing English writing. Participants were tasked with submitting their presentation scripts before their speaking exams. They received an instructional session on how to use the tool effectively and were told useful prompts for using ChatGPT. The collected writings were analyzed holistically by two experienced EFL instructors, and analytically by using Grammarly (2022), a free online grammar and spelling checker, to identify characteristics. The analysis revealed that there was a significant difference in holistic scores including content and organization. The experimental group who used the AI tool had significantly reduced grammatical and lexical errors. However, no significant difference between the groups was found in the word counts and use of vocabulary types. Additionally, reflections from participants indicates a positive attitude toward the use of AI-assisted feedback in English writing but there were some concerns about reliability and over-reliance. The study suggests pedagogical implications for the effective integration of AI-assistance in English writing based on these findings.

Abstract

This study aims to investigate the utilization of AI-assisted feedback by EFL college learners in their English writing. Specifically, the research sought to explore how writing assisted by ChatGPT improves students’ writing skills in comparison to peer feedback. Additionally, the study aimed to understand the learners’ perceptions regarding the use of ChatGPT in editing English writing. Participants were tasked with submitting their presentation scripts before their speaking exams. They received an instructional session on how to use the tool effectively and were told useful prompts for using ChatGPT. The collected writings were analyzed holistically by two experienced EFL instructors, and analytically by using Grammarly (2022), a free online grammar and spelling checker, to identify characteristics. The analysis revealed that there was a significant difference in holistic scores including content and organization. The experimental group who used the AI tool had significantly reduced grammatical and lexical errors. However, no significant difference between the groups was found in the word counts and use of vocabulary types. Additionally, reflections from participants indicates a positive attitude toward the use of AI-assisted feedback in English writing but there were some concerns about reliability and over-reliance. The study suggests pedagogical implications for the effective integration of AI-assistance in English writing based on these findings.

참고문헌 (43)

  1. Anderson, J. R., "Acquisition of cognitive skill", Psychological Review, 89(4), pp.369~406 (1982)
  2. Bai, L., "In the face of fallible AWE feedback: How do students respond?", Educational Psychology, 37(1), pp.67~81 (2017)[DOI]
  3. Barrot, J. S., "Using ChatGPT for second language writing : Pitfalls and potentials", Assessment in Writing, 57, pp.100745~ (2023)[DOI]
  4. Briggs, N., "Neural machine translation tools in the language learning classroom : Students’ use, perceptions, and analyses", The JALT CALL Journal, 14(1), pp.2~24 (2018)[DOI]
  5. Chan, C., "Students’ voices on generative AI : Perceptions, benefits, and challenges in higher education", International Journal of Educational Technology in Higher Education, 20(43), pp.1~18 (2023)[DOI]
  6. Chang, T., "Exploring EFL students’ writing performance and their acceptance of AI-based automated writing feedback", Proceedings of the 2021 2nd international conference on education development and studies, pp.31~35 (2021), Association for Computing Machinery
  7. Cheng, G., "The impact of online automated feedback on students’ reflective journal writing in an EFL course", The Internet and Higher Education, 34, pp.18~27 (2017)[DOI]
  8. Chen, M., "Developing a corpus-based paraphrase tool to improve EFL learners’ writing skills", Computer Assisted Language Learning, 28(1), pp.22~40 (2015)[DOI]
  9. Chun, H. L., "A systematic review of AI technology use in English education", Multimedia-Assisted Language Learning, 24(1), pp.87~103 (2021)[DOI]
  10. Clifford, J., "Surveying the landscape: What is the role of machine translation in language learning? @ tic", Revista D'Innovació Educativa, (10), pp.108~121 (2013)
  11. "Can large language models provide feedback to students? A case study on ChatGPT" (2023)[URL]
  12. Dizon, G., "Examining the impact of Grammarly on the quality of mobile L2 writing", The JALT CALL Journal, 17(2), pp.74~92 (2021)[DOI]
  13. Flesch, R., "A new readability yardstick", Journal of Applied Psychology, 32(3), pp.221~233 (1948)[DOI]
  14. Gayed, M., "Exploring an AI-based writing assistant’s impact on English language learners", Computer & Education : Artificial Intelligence, 3, pp.100055~ (2022)[DOI]
  15. "Grammarly: Free online writing assistant" (2022)[URL]
  16. Grimes, D., "Utility in a fallible tool: A multi-site case study of automated writing evaluation", Journal of Technology, Learning, and Assessment, 8(6), pp.4~43 (2010)
  17. Guo, K., "Using chatbots to scaffold EFL students’ argumentative writing", Assessing Writing, 54, pp.100666~ (2022)[DOI]
  18. Hyland, K., "Feedback on second language students’ writing : State of the art", Language Teaching, 39(2), pp.83~101 (2006)[DOI]
  19. Jolley, J. R., "Free online machine translation: Use and perceptions by Spanish students and instructors", Learn languages, explore cultures, transform lives, pp.181~200 (2015), Central States Conference on the Teaching of Foreign Languages
  20. Larson-Guenette, J., "It’s just reflex now : German language learners’ use of online resource", Teaching German, 46(1) (2013)[DOI]
  21. Leki, I., "The preferences of ESL students for error correction in college-level writing classes", Foreign Language Annals, 24(3), pp.203~218 (1991)
  22. Liao, H. -C., "Enhancing the grammatical accuracy of EFL writing by using an AWE-assisted process approach", System, 62, pp.77~92 (2016)[DOI]
  23. Li. J., "Rethinking the role of automated writing evaluation(AWE)feedback in ESL writing instruction", Journal of Second Langue Writing, 27, pp.1~18 (2015)[DOI]
  24. Mahapatra, S., "Impact of ChatGPT on ESL students’ academic writing skills : A mixed methods intervention study", Smart Learning Environments, 11(9) (2024)[DOI]
  25. Mizumoto, A., "Exploring the potential of using an AI language model for automated essay scoring", Research Methods in Applied Linguistics, 2(2), pp.100050~ (2023)[DOI]
  26. Moore, S., "Student use of automated essay evaluation technology during revision", Journal of Writing Research, 8(1), pp.149~175 (2016)[DOI]
  27. O’Neill, E., "Measuring the impact of online translation on FL writing scores", The IALLT Journal, 46(2), pp.1~39 (2016)[DOI]
  28. O’Neill, R., "Stop! grammar time : University students’ perceptions of the automated feedback program Grammarly", Australasian Journal of Educational Technology, 35(1), pp.42~56 (2022)[DOI]
  29. Rahman, N., "Exploring artificial intelligence using automated writing evaluation for writing skills", Environment-Behaviour Proceedings Journal, 7, pp.547~553 (2022)[DOI]
  30. Ranalli, J., "Automated writing evaluation for formative assessment of second language writing : Investigating the accuracy and usefulness of feedback as part of argument-based validation", Educational Psychology, 1, pp.8~25 (2017)[DOI]
  31. Roscoe, J., "Presentation, expectations, and experience : Sources of student perceptions of automated writing evaluation", Computers in Human Behavior, 70, pp.207~221 (2017)
  32. Rudolph, J., "ChatGPT: Bullshit spewer or the end of traditional assessments in higher education?", Journal of Applied Learning & Teaching, 6(1), pp.342~363 (2023)[DOI]
  33. Shang, H. F., "Exploring online peer feedback and automated corrective feedback on EFL writing performance", Interactive Learning Environments, 30(1), pp.4~16 (2022)[DOI]
  34. Song, C., "Enhancing academic writing skills and motivation : Assessing the efficacy of ChatGPT in AI-assisted language learning for EFL students", Frontiers in Psychology, 14, pp.1~14 (2023)[DOI]
  35. Stevenson, M., "The effects of computer-generated feedback on the quality of writing", Assessing Writing, 19, pp.51~65 (2014)[DOI]
  36. Valijärvi, R. L., "Language students as critical users of google translate : Pitfalls and possibilities", Practitioner Research in Higher Education, 12(1), pp.61~74 (2019)
  37. Wang, M., "The potential impact of ChatGPT on education : Using history as a rearview mirror", ECNU Review Education (2023)[DOI]
  38. Wang, Y. -J., "Exploring the impact of using automated writing evaluation in English as a foreign language university students’ writing", Computer Assisted Language Learning, 26(3), pp.234~257 (2013)[DOI]
  39. Wilson, J., "Exploring the role of automated writing evaluation as a formative assessment tool supporting self-regulated learning and writing" (2024), Routledge
  40. Wilson, J., "Automated writing evaluation and feedback : Multiple metrics of efficacy", Journal of Educational Computing Research, 58, pp.87~125 (2020)[DOI]
  41. Yoon, C., "Concordancing in L2 writing class : An overview of research and issues", Journal of English Academic Purpose, 10, pp.130~139 (2011)[DOI]
  42. Yoon, S., "Student readiness for AI instruction : Perspectives on AI in university EFL classrooms", Multimedia-Assisted Language Learning, 22(4), pp.134~160 (2019)[DOI]
  43. Zhai, N., "Automated writing evaluation(AWE)feedback : A systematic investigation of college students’ acceptance", Computer Assisted Language Learning, 35(9), pp.2817~2842 (2022)[DOI]

관련 논문AI추천

이 간행물의 다른 논문 (3건)