Developing a GPT-Based Chatbot Using Advanced Prompt Engineering for English Proficiency Level-Differentiated Reading Questions
1
조회
0
다운로드
0
인용
0
참고문헌
초록
This study explores the development of an AI-facilitated chatbot for generating English reading comprehension questions, employing ChatGPT, a large language model, to meet the increasing demand for AI-enhanced English language education. Incorporating Bloom’s Taxonomy and the Common European Framework of Reference for Languages (CEFR) as foundational frameworks, the chatbot is engineered to formulate English reading questions that resonate with the varied proficiency levels of L2 learners. The study utilizes an integrative approach by combining Chain of Thought (CoT) and Few-Shot techniques in advanced prompt engineering methods to generate initial prompts for ChatGPT. Through interactions with ChatGPT, these prompts were refined, guiding the development of the chatbot. The final chatbot demonstrated its capability to produce customized English reading questions. This innovation indicates a significant advance in personalized reading instruction and assessment. It also supports the motivation for personalized learning among English language learners. This study concludes with cautious considerations and directions for future research on AI-assisted language learning tools.
Abstract
This study explores the development of an AI-facilitated chatbot for generating English reading comprehension questions, employing ChatGPT, a large language model, to meet the increasing demand for AI-enhanced English language education. Incorporating Bloom’s Taxonomy and the Common European Framework of Reference for Languages (CEFR) as foundational frameworks, the chatbot is engineered to formulate English reading questions that resonate with the varied proficiency levels of L2 learners. The study utilizes an integrative approach by combining Chain of Thought (CoT) and Few-Shot techniques in advanced prompt engineering methods to generate initial prompts for ChatGPT. Through interactions with ChatGPT, these prompts were refined, guiding the development of the chatbot. The final chatbot demonstrated its capability to produce customized English reading questions. This innovation indicates a significant advance in personalized reading instruction and assessment. It also supports the motivation for personalized learning among English language learners. This study concludes with cautious considerations and directions for future research on AI-assisted language learning tools.
참고문헌 (55)
- Anderson, L. W., "A taxonomy for learning, teaching, and assessing: A revision of Bloom’s taxonomy of educational objectives" (2001), Longman
- Assaly, I. R., "Using Bloom’s taxonomy to evaluate the cognitive levels of master class textbook's questions", English Language Teaching, 8(5), pp.100~110 (2015)[DOI]
- Baek, J., "Implicit cognitive strategies of EFL college reading : an interpretation of complex responses in think-aloud interviews", Studies in Linguistics, 38, pp.285~313 (2016)
- Barrot, J. S., "Using ChatGPT for second language writing : Pitfalls and potentials", Assessing Writing, 57, pp.100745~ (2023)[DOI]
- "Longformer: The long-document transformer" (2020)[URL]
- Bender, E. M., "On the dangers of stochastic parrots: Can language models be too big?", Proceedings of the 2021 ACM Conference on Fairness, Accountability, and Transparency, pp.610~623 (2021)
- Bloom, B. S., "Taxonomy of educational objectives: The classification of educational goals. Handbook 1: Cognitive domain" (1956), Longman
- "On the opportunities and risks of foundation models" (2021)[URL]
- Brown, T., "Language models are few-shot learners", Advances in Neural Information Processing Systems, 33, pp.1877~1901 (2020)[DOI]
- Cha, S. -M., "Exploring the utilization of ChatGPT in elementary English education", Multimedia-Assisted Language Learning, 26(3), pp.130~150 (2023)[DOI]
- Chen, C. M., "Personalised context-aware ubiquitous learning system for supporting effective English vocabulary learning", Interactive Learning Environments, 18(4), pp.341~364 (2010)[DOI]
- Chen, X., "Twenty years of personalized language learning", Educational Technology & Society, 24(1), pp.205~222 (2021)[DOI]
- Choe, Y., "Exploring ChatGPT's impact on the English summary writing of pre-service English teachers", Multimedia-Assisted Language Learning, 26(2), pp.104~132 (2023)[DOI]
- Council of Europe, "Common European framework of reference for languages: Learning, teaching, assessment" (2001), Cambridge University Press
- "Bert: Pre-training of deep bidirectional transformers for language understanding" (2018)[URL]
- Essel, H. B., "The impact of a virtual teaching assistant(chatbot)on students’learning in Ghanaian higher education", International Journal of Educational Technology in Higher Education, 19(1), pp.57~ (2022)[DOI]
- Forehand, M., "Emerging Perspectives on Learning, Teaching, and Technology", pp.41~44 (2010)
- Hwang, G. J., "Vision, challenges, roles and research issues of Artificial Intelligence in Education", Computers and Education : Artificial Intelligence, 1, pp.100001~ (2020)[DOI]
- Ismail, H. M., "Review of personalized language learning systems", 2016 12th International Conference on Innovations in Information Technology (IIT), pp.1~6 (2016), IEEE
- Jeon, J., "Large language models in education : A focus on the complementary relationship between human teachers and ChatGPT", Education and Information Technologies, 28, pp.15873~15892 (2023)[DOI]
- Kasneci, E., "ChatGPT for good? On opportunities and challenges of large language models for education", Learning and Individual Differences, 103, pp.102274~ (2023)[DOI]
- Kim, T., "A field study on the development of teaching materials for secondary English and its use of ChatGPT", Secondary English Education, 16(2), pp.207~218 (2023)[DOI]
- Kohnke, L., "ChatGPT for language teaching and learning", RELC Journal, 54(2), pp.537~550 (2023)[DOI]
- Kojima, T., "Large language models are zero-shot reasoners", Advances in Neural Information Processing Systems, 35, pp.22199~22213 (2022)
- Kooli, C., "Chatbots in education and research : A critical examination of ethical implications and solutions", Sustainability, 15(7), pp.5614~ (2023)[DOI]
- Krathwohl, D. R., "A revision of Bloom’s taxonomy : An overview", Theory into Practice, 41(4), pp.212~218 (2002)[DOI]
- Kwon, S. -K., "Investigating the performance of generative AI ChatGPT's reading comprehension ability", Journal of the Korea English Education Society, 22(2), pp.147~172 (2023)
- Lee, H. -J., "The effects of teaching Question-Answer Relationship strategy on self-generated questions, comprehension and textual recall of elementary English learners", Modern English Education, 16(3), pp.251~274 (2015)
- Lee, S., "Enhancing pre-service teachers' global Englishes awareness with technology : A focus on AI chatbots in 3D metaverse environments", TESOL Quarterly (2024)[DOI]
- Li, Y., "Can large language models write reflectively", Computers and Education : Artificial Intelligence, 4, pp.100140~ (2023)[DOI]
- Liu, P., "Pre-train, prompt, and predict : A systematic survey of prompting methods in natural language processing", ACM Computing Surveys, 55(9), pp.1~35 (2023)[DOI]
- Luckin, R., "Empowering educators to be AI-ready", Computers and Education : Artificial Intelligence, 3, pp.100076~ (2022)[DOI]
- Mageira, K., "Educational AI chatbots for content and language integrated learning", Applied Sciences, 12(7), pp.3239~ (2022)[DOI]
- Mizumoto, A., "Exploring the potential of using an AI language model for automated essay scoring", Research Methods in Applied Linguistics, 2(2), pp.100050~ (2023)[DOI]
- Murtaza, M., "AI-based personalized e-learning systems : Issues, challenges, and solutions", IEEE Access, 10, pp.81323~81342 (2022)[DOI]
- "Optimizing language models for dialogue, 2022" (2023)[URL]
- Pack, A., "Using Artificial Intelligence in TESOL : Some Ethical and Pedagogical Considerations", TESOL Quarterly (2024)[DOI]
- Peng, H., "Personalized adaptive learning : an emerging pedagogical approach enabled by a smart learning environment", Smart Learning Environments, 6, pp.1~14 (2019)[DOI]
- Pokrivcakova, S., "Preparing teachers for the application of AI-powered technologies in foreign language education", Journal of Language and Cultural Education, 7(3), pp.135~153 (2019)[DOI]
- Raffel, C., "Exploring the limits of transfer learning with a unified text-to-text transformer", Journal of Machine Learning Research, 21(140), pp.1~67 (2020)
- Rahman, S., "A critical analysis of Bloom’s taxonomy in teaching creative and critical thinking skills in Malaysia through English literature", English Language Teaching, 10, pp.245~256 (2017)[DOI]
- "Hierarchical text-conditional image generation with clip latents" (2022)[URL]
- "Exploiting cloze questions for few shot text classification and natural language inference" (2020)[URL]
- Seaman, M., "Curriculum & Teaching Dialogue", pp.29~45 (2011), Information Age Publishing Inc
- Shin, D., "Exploring the potential of using ChatGPT as a content-based English learning and teaching tool", Journal of the Korea English Education Society, 22(1), pp.171~192 (2023)[DOI]
- Soozandehfar, M. A. S., "A Critical Appraisal of Bloom’s Taxonomy", American Research Journal of English and Literature, 2(1), pp.1~10 (2016)[DOI]
- Stevani, M., "Evaluating English textbooks by using Bloom’s taxonomy to analyze reading comprehension question", SALEE : Study of Applied Linguistics and English Education, 4(1), pp.1~18 (2023)[DOI]
- Surjosuseno, T. T., "Using Bloom’s Taxonomy to teach critical reading in English as a foreign language classes", Queensland Journal of Educational Research, 15(2), pp.227~244 (1999)
- "Context-tuning: Learning contextualized prompts for natural language generation" (2022)[URL]
- Tlili, A., "What if the devil is my guardian angel : ChatGPT as a case study of using chatbots in education", Smart Learning Environments, 10(1), pp.1~15 (2023)[DOI]
- Wei, J., "Chain-of-thought prompting elicits reasoning in large language models", Advances in Neural Information Processing Systems, 35, pp.24824~24837 (2022)[DOI]
- Wei, L., "Artificial intelligence in language instruction : impact on English learning achievement, L2 motivation, and self-regulated learning", Frontiers in Psychology, 14, pp.1261955~ (2023)[DOI]
- Xiao, Y., "An exploratory study of EFL learners’ use of ChatGPT for language learning tasks : Experience and perceptions", Languages, 8(3), pp.212~ (2023)[DOI]
- Zhang, C., "Artificial intelligence in EFL speaking : Impact on enjoyment, anxiety, and willingness to communicate", System, 121, pp.103259~ (2024)[DOI]
- Zou, B., "Using artificial intelligence technology for language learning", Frontiers in Psychology, 14, pp.1287667~ (2023)[DOI]
