본문 바로가기
KERD
논문KCI 등재

Mobile-Based Chatbot to Scaffold Foreign Language Learners' Self-Regulated Learning

0

조회

0

다운로드

0

인용

0

참고문헌

키워드

주제분류교육학

초록

Despite the rapid advancements in artificial intelligence (AI) technology in education, much remains to be learned on how self-regulated learning (SRL) is facilitated using mobile-based AI chatbots. To fill this gap, our study embarked on an exploratory investigation using a mobile-based chatbot designed to promote SRL behaviors among foreign language learners. The participants in the study were 11 adult foreign language learners from the United States and South Korea who interacted with the chatbot over a four-week duration on their mobile phones. Data were collected from chatbot interaction logs, pre- and post-SRL surveys, and a system usability survey. The findings revealed that learners with higher levels of SRL skill improvement interacted with more comprehensive and targeted responses, including specific learning strategies and reflective thoughts regarding their learning processes. We also found an overall positive perceived usability toward using a mobile-based SRL chatbot and a moderate correlation between perceived usability and SRL skill improvement. Open-ended survey data provided further suggestions on chatbot improvements when developing a chatbot system for scaffolding SRL processes. This work contributes to the burgeoning field of AI in education and provides directions for future research for optimizing chatbot-driven SRL interventions.

Abstract

Despite the rapid advancements in artificial intelligence (AI) technology in education, much remains to be learned on how self-regulated learning (SRL) is facilitated using mobile-based AI chatbots. To fill this gap, our study embarked on an exploratory investigation using a mobile-based chatbot designed to promote SRL behaviors among foreign language learners. The participants in the study were 11 adult foreign language learners from the United States and South Korea who interacted with the chatbot over a four-week duration on their mobile phones. Data were collected from chatbot interaction logs, pre- and post-SRL surveys, and a system usability survey. The findings revealed that learners with higher levels of SRL skill improvement interacted with more comprehensive and targeted responses, including specific learning strategies and reflective thoughts regarding their learning processes. We also found an overall positive perceived usability toward using a mobile-based SRL chatbot and a moderate correlation between perceived usability and SRL skill improvement. Open-ended survey data provided further suggestions on chatbot improvements when developing a chatbot system for scaffolding SRL processes. This work contributes to the burgeoning field of AI in education and provides directions for future research for optimizing chatbot-driven SRL interventions.

참고문헌 (67)

  1. Abrami, P. C., "The student learning strategies questionnaire", Centre for the Study of Learning & Performance, Concordia University, ~ (2007)
  2. Aleven, V., "Supporting self-explanation of argument transcripts: Specific v. generic prompts", Workshop of Intelligent Tutoring Systems for Ill-Defined domains, 8th International Conference on Intelligent Tutoring Systems, pp.47~55 (2006)
  3. Anyichie, A. C., "Implications of supporting the development of self-regulated learning through modeling and scaffolding", Canadian Association of Educational Psychologists (CAEP) Symposium, Understanding and supporting Self-regulated learning. Presented during the annual meeting of Canadian Society for the Study of Education, pp.2~ (2015)
  4. Azevedo, R., "Adaptive human scaffolding facilitates adolescents’ self-regulated learning with hypermedia", Instructional Science, 33(5), pp.381~412 (2005)[DOI]
  5. Azevedo, R., "New science of learning: Cognition, computers and collaboration in education", pp.225~248 (2010), Springer
  6. Azevedo, R., "The effectiveness of pedagogical agents’ prompting and feedback in facilitating co-adapted learning with MetaTutor", Proceedings of the 11th International Conference on Intelligent Tutoring Systems, pp.212~221 (2012)
  7. Bangor, A., "Determining what individual SUS scores mean : Adding an adjective rating scale", Journal of usability studies, 4(3), pp.114~123 (2009)
  8. Barnard-Brak, L., "Profiles in self-regulated learning in the online learning environment", The International Review of Research in Open and Distributed Learning, 11(1), pp.61e80~ (2010)[DOI]
  9. Benz, B. F, "Improving the quality of e-learning by enhancing self-regulated learning. A synthesis of research on self-regulated learning and an implementation of a scaffolding concept", Doctor, pp.2010
  10. Boekaerts, M., "Handbook of self-regulation", pp.417~450 (2000), Academic Press
  11. Carter Jr, R. A., "Self-regulated learning in online learning environments : strategies for remote learning", Information and Learning Sciences, 121(5-6), pp.311~319 (2020)[DOI]
  12. Devolder, A., "Supporting self-regulated learning in computer-based learning environments : Systematic review of effects of scaffolding in the domain of science education", Journal of Computer Assisted Learning, 28(6), pp.557~573 (2012)[DOI]
  13. Doran, G. T., "There’s a SMART way to write management’s goals and objectives", Management Review, 70(11), pp.35~36 (1981)
  14. Du, J., "Using recommender systems to promote self-regulated learning in online education settings:Current knowledge gaps and suggestions for future research", Journal of Research on Technology in Education, 54(4), pp.557~580 (2021), Advance online publication[DOI]
  15. Du, J., "Supporting students goal setting process using chatbot: implementation in a fully online course", 2021 IEEE International Conference on Engineering, Technology & Education (TALE), pp.35~41 (2021), IEEE
  16. Ferrara, L. A., "Promoting self-regulated learning processes through interactions in resource-based digital learning environments", Doctor, pp.2017
  17. Garrido-Vargas, M, "Relationship of self-regulated learning and academic achievement among English language learners", Doctor, pp.2012
  18. Greene, J. A., "Domain-specificity of self-regulated learning processing in science and history digital libraries", Contemporary Educational Psychology, 42, pp.111~128 (2015)[DOI]
  19. Hadwin, A. F., "Innovative ways for using gStudy to orchestrate and research social aspects of self-regulated learning", Computers in Human behavior, 26(5), pp.794~805 (2010)[DOI]
  20. Hew, K. F., "Using chatbots to support student goal setting and social presence in fully online activities : learner engagement and perceptions", Journal of Computing in Higher Education, 35(1), pp.40~68 (2023)[DOI]
  21. Hidayah, I., "A framework for improving recommendation in adaptive metacognitive scaffolding", Proceedings of the fourth International Conference on Science and Technology (ICST), pp.1~5 (2018), IEEE
  22. Hoffman, B., "The influence of self-efficacy and metacognitive prompting on math problem solving efficiency", Contemporary Educational Psychology, 33(4), pp.875~893 (2008)[DOI]
  23. Housand, A., "Self-regulated learning in reading : Gifted pedagogy and instructional settings", Journal of Advanced Academics, 20(1), pp.108~136 (2008)[DOI]
  24. Hrbáčková, K., "Domain-specific context of students’ self-regulated learning in the preparation of helping professions", Social and Behavioral Sciences, 29, pp.330~340 (2011)[DOI]
  25. Jackson, T., "Handbook of self-regulation", pp.275~300 (2000), Academic Press
  26. Jansen, R. S., "Supporting learners’ self-regulated learning in Massive Open Online Courses", Computers & Education, 146, pp.103771~ (2020)[DOI]
  27. Jayawardena, R., "Promoting self-regulated learning in science : A case study of a Sri Lankan secondary school science teacher", International Journal of Information and Education Technology, 7(3), pp.195~198 (2017)[DOI]
  28. Kauffman, D. F., "Self-regulated learning in web-based environments : Instructional tools designed to facilitate cognitive strategies use, metacognitive processing and motivational beliefs", Journal of Educational Computing Research, 30, pp.139~161 (2004)[DOI]
  29. Kautz, D. D., "Promoting clinical reasoning in undergraduate nursing students : Application and evaluation of the Outcome Present State Test(OPT)model of clinical reasoning", International Journal of Nursing Education Scholarship, 2(1), pp.1~19 (2005)[DOI]
  30. Kopeinik, S., "Combining self-regulation and competence-based guidance to personalize the learning experience in Moodle", IEEE 14th International Conference on Advanced Learning Technologies, ICALT, pp.62~64 (2014)
  31. Kramarski, B., "Group-metacognitive support for online inquiry in mathematics with differential self-questioning", Journal of Educational Computing Research, 40(4), pp.365~392 (2009)[DOI]
  32. Kramarski, B., "Investigating preservice teachers’ professional growth in self-regulated learning environments", Journal of Educational Psychology, 101(1), pp.161~175 (2009)[DOI]
  33. Kuiper, R., "Thinking strategies of baccalaureate nursing students prompted by self-regulated learning strategies", Journal of Nursing Education, 49(8), pp.429~436 (2010)[DOI]
  34. Lameras, P., "Power to the teachers : An exploratory review on artificial intelligence in education", Information, 13(1), pp.14~ (2021)[DOI]
  35. Manso-Vazquez, M., "Proposal of a learning organization tool with support for metacognition", IEEE Revista Iberoamericana de Tecnologias Del Aprendizaje, 10(2), pp.35~42 (2015)[DOI]
  36. McClelland, M. M., "Growing up with assets and risks : The importance of self-regulation for academic achievement", Research in Human Development, 9(4), pp.278~297 (2012)[DOI]
  37. Meyer, E., "Improving literacy and metacognition with electronic portfolios : Teaching and learning with ePEARL", Computers & Education, 55(1), pp.84~91 (2010)[DOI]
  38. Moos, D. C., "Handbook of self-regulation of learning and performance", pp.243~253 (2017), Routledge
  39. Nakata, Y., "Toward a framework for self-regulated language-learning", TESL Canada Journal, 27(2), pp.1~10 (2010)[DOI]
  40. Nicol, D. J., "Formative assessment and self-regulated learning : A model and seven principles of good feedback practice", Studies in Higher Education, 31(2), pp.199~218 (2006)[DOI]
  41. Nielsen, J., "Usability Engineering" (1994), Academic Press
  42. Nussbaumer, A., "Recommender and guidance strategies for creating personal mashup learning environments", Computer Science and Information Systems, 11(1), pp.321~342 (2014)[DOI]
  43. Oyelere, S. S., "Do teamwork experience and self-regulated learning determine the performance of students in an online educational technology course?", Education and Information Technologies, 26(5), pp.5311~5335 (2021)[DOI]
  44. Pardo, A, "Identifying learning strategies associated with active use of video annotation software", Proceedings of the Fifth International Conference on Learning Analytics and Knowledge, pp.255~259 (2015)
  45. "TecCoBot: Technology-aided support for self-regulated learning" (2021)[URL]
  46. Pintrich, P. R., "Reliability and predictive validity of the Motivated Strategies for Learning Questionnaire(MSLQ)", Educational and Psychological Measurement, 53(3), pp.801~813 (1993)[DOI]
  47. Pintrich, P.R., "Handbook of self-regulation", pp.451~502 (2000), Academic Press
  48. Ridgley, L. M., "Gifted underachievement within a self-regulated learning framework : Proposing a task-dependent model to guide early identification and intervention", Psychology in the Schools, 57(9), pp.1365~1384 (2020)
  49. Roy, M., "The Cambridge handbook of multimedia learning", pp.271~286 (2005), Cambridge University Press
  50. Sáiz-Manzanares, M. C., "Perceived satisfaction of university students with the use of chatbots as a tool for self-regulated learning", Heliyon, 9(1) (2023)[DOI]
  51. Schworm, S., "Learning argumentation skills through the use of prompts for self-explaining examples", Journal of Educational Psychology, 99(2), pp.285~296 (2007)[DOI]
  52. Shih, K. P., "The development and implementation of scaffolding-based self-regulated learning system for e", m-learning, 2010, pp.13(1), 80~93
  53. Song, D., "Effects of self-regulation scaffolding on online participation and learning outcomes", Journal of Research on Technology in Education, 53(3), pp.249~263 (2021)[DOI]
  54. van Alten, D. C., "Effects of self-regulated learning prompts in a flipped history classroom", Computers in Human Behavior, 108, pp.106318~ (2020)[DOI]
  55. White, M. C., "Cognitive modeling and self-regulation of learning in instructional settings", Teachers College Record, 119(13), pp.1~26 (2017)
  56. Winne, P. H., "Inherent details in self-regulated learning", Educational Psychologist, 30, pp.173~187 (1995)[DOI]
  57. Winne, P. H., "Metacognition in Educational Theory and Practice", pp.277~304 (1998), Erlbaum
  58. Wollny, S., "Chatbots–an opportunity for individual assistance in education", Companion Proceedings of the 10th International Conference on Learning Analytics & Knowledge LAK20 (2020)
  59. Wong, J., "Examining the use of prompts to facilitate self-regulated learning in Massive Open Online Courses", Computers in Human Behavior, 115, pp.106596~ (2021)[DOI]
  60. Yang, J., "Effect of Embedding Prompts on Learning Performance and Metacognitive Monitoring", 2021 IEEE International Conference on Engineering, Technology & Education (TALE), pp.01~07 (2021), IEEE
  61. Zimmerman, B. J., "A social cognitive view of self-regulated academic learning", Journal of Educational Psychology, 81, pp.329~339 (1989)[DOI]
  62. Zimmerman, B. J., "Self-regulated learning and academic achievement : An overview", Educational Psychologist, 25(1), pp.3~17 (1990)[DOI]
  63. Zimmerman, B. J., "Handbook of self-regulation: Theory, research and applications", pp.13~39 (2000), Academic Press
  64. Zimmerman, B. J., "Becoming a self-regulated learner : An overview", Theory into Practice, 41(2), pp.64~70 (2002)[DOI]
  65. Zimmerman, B. J., "Self-regulated learning and academic achievement", pp.0~45 (2013), Routledge
  66. Zimmerman, B. J.,c, "The psychology of problem solving", pp.233~262 (2003), Cambridge University Press
  67. Zimmerman, B. J., "Development of a structured interview for assessing student use of self-regulated learning strategies", American Educational Research Journal, 23(4), pp.614~628 (1986)[DOI]

관련 논문AI추천

이 간행물의 다른 논문 (3건)