본문 바로가기
KERD
논문KCI 등재

테크놀로지 기반 자기조절 지원의 효과에 대한 메타분석

A meta-analysis on the effects of technology-based self-regulation support

이주원|박하은|진명화|임규연|김혜준
한국교육방법학회 (The Korean Journal Of Educational Methodology Studies)|2023.05|교육방법연구 (The Korean Journal of Educational Methodology Studies)|제35권 제2호|pp. 295-328|DOI 10.17927/tkjems.2023.35.2.295

0

조회

0

다운로드

0

인용

0

참고문헌

키워드

메타분석meta-analysis자기조절self-regulation자기조절학습self-regulated learning테크놀로지 기반 자기조절 지원technology-based self-regulated learning support
주제분류교육학

초록

본 연구는 메타분석을 통해 온라인 학습 맥락에서 테크놀로지 기반 자기조절 지원 처치의 효과를 종합적으로 파악함으로써 자기조절 지원 도구 설계에 대한 시사점을 제공하는 데 목적이 있다. 이를 위해 Web of Science와 Scopus에서 2012년부터 2022년 9월까지 발표된 논문 중 기준에 부합하는 총 33편의 연구를 선정하였다. 그 가운데 1편은 다수의 연구 사례를 포함하고 있어, 이를 반영한 총 35건의 연구 사례 수를 바탕으로 메타분석을 실시하였다. 이를 통해 테크놀로지 기반 자기조절 지원의 전체 효과 크기, 종속변인별(인지, 정의, 자기조절) 효과 크기, 자기조절의 하위요인별(인지 조절, 메타인지 조절, 행동 조절, 동기 조절) 효과 크기, 조절변인별(지원 대상, 지원 유형, 지원 목적, 개별화의 유무) 효과 크기를 산출하였다. 연구 결과는 다음과 같다. 첫째, 테크놀로지 기반 자기조절 지원의 전체 효과 크기는 0.49로 중간 정도의 효과 크기로 나타났다. 둘째, 종속변인의 속성 관련하여 인지적 영역과 자기조절에서 다소 작은 효과 크기를, 정의적 영역에서는 통계적으로 유의하지 않은 효과 크기를 보였다. 자기조절의 하위요인으로는 행동 조절과 메타인지 조절에서 다소 작은 효과 크기를, 인지 조절과 동기 조절에서 작은 효과 크기로 나타났다. 셋째, 조절변인 중 지원 유형과 처치의 개별화 여부에 따른 효과 크기가 통계적으로 유의미한 차이가 있었다. 지원 유형은 시스템, 대시보드, 복합적 지원, 프롬프트 순으로 효과 크기가 크게 나타났으며 개별화된 지원을 제공하는 도구가 그렇지 않은 도구보다 큰 효과 크기가 나타남을 확인할 수 있었다. 결론적으로 본 연구는 메타분석을 통해 테크놀로지 기반 자기조절 지원 처치의 효과를 종합적으로 분석할 수 있었으며, 이를 바탕으로 자기조절 지원 도구 설계를 위한 시사점을 제시하였다.

Abstract

This study conducted a meta-analysis to explore the effects of technology-based self-regulation interventions in online learning and to provide insights for designing self-regulation support tools. Based on the selection criteria, 33 studies published from 2012 to September 2022 were included in the final analysis, and one of the studies conducted three experiments resulting in 35 effect sizes in total. This study calculated the effect sizes of overall technology-based self-regulation support, dependent variables, sub-factors of self-regulation, and moderating variables. The results of the study are as follows: First, the overall effect size of technology-based self-regulation support was 0.49, indicating a moderate effect size. Second, among the dependent variables, slightly small effect sizes were shown in the cognitive and self-regulation variables, while the effect size of the affective variable was statistically not significant. Third, among the moderating variables, support types and personalized intervention reached statistical significance. By support types, the effect size was larger in the order of the system, dashboard, mixed support, and prompt. Interventions providing personalized support had a larger effect size than those that did not. In conclusion, this study comprehensively analyzed the effects of technology-based self-regulation support using a meta-analysis, which provided implications for the design of self-regulation support tools.

참고문헌 (107)

  1. 강윤경, "인공지능 교육프로그램이 청소년에게 미치는 효과 연구에 대한 메타분석", 교육정보미디어연구, 27(4), pp.1273~1294 (2021), 한국교육정보미디어학회[DOI]
  2. 김성빈, "온라인 고등․평생교육 학습자의 학습참여 동기와 학습 만족도 관계에서 지각된 유용성, 자기조절학습 능력의 조절효과 검증", 평생학습사회, 13(3), pp.85~107 (2017), 미래원격교육연구원
  3. 김효진, "MOOC 환경에서 자기조절학습능력과 지각된 유용성이 학습지속의향에 미치는 영향: 학습몰입의 매개효과 및 과제기술적합성의 조절효과", 교육공학연구, 38(1), pp.149~177 (2022), 한국교육공학회[DOI]
  4. 나청수, "컴퓨팅 사고력 향상을 위한 국내 SW 교육에 대한 메타분석", 교육공학연구, 34(3), pp.775~815 (2018), 한국교육공학회[DOI]
  5. "대구중등학습놀이터", 대구광역시교육지원청[URL]
  6. "대학원격교육지원센터 월간동향 vol.12" (2022), 대학원격교육지원센터[URL]
  7. "성균관대학교 iCampus", 성균관대학교[URL]
  8. 신문승, "초등학교 창의성교육 프로그램의 효과에 관한 메타분석", 초등교육연구, 22(3), pp.113~135 (2009), 한국초등교육학회
  9. 심현, "온라인 학습환경에서 멘토의 피드백이 자기조절학습능력, 자기주도학습, 학업성취에 미치는 영향", 열린교육연구, 25(1), pp.169~189 (2017), 한국열린교육학회[DOI]
  10. 양미진, "청소년상담 프로그램의 효과에 대한 메타분석", 청소년상담연구, 26(2), pp.291~316 (2018), 한국청소년상담복지개발원[DOI]
  11. "미래를 선도할 이화형 교수학습모델 ‘THE BEST’ 시범 운영" (2022), 이화여자대학교[URL]
  12. 임철일, "자기조절학습을 지원하는 기업의 이러닝 학습관리체제의 개발과 효과에 관한 연구", 교육공학연구, 21(4), pp.77~100 (2005), 한국교육공학회
  13. 정애경, "자기조절학습을 지원하는 모바일 연동 학습관리시스템 개발연구", 컴퓨터교육학회 논문지, 12(4), pp.23~34 (2009), 한국컴퓨터교육학회[DOI]
  14. 황성동, "알기 쉬운 메타분석의 이해" (2014), 학지사
  15. 황성동, "R을 이용한 메타분석" (2015), 학지사
  16. "e학습터 꿈을 이루는 공간"[URL]
  17. Alonso-Mencía, M. E., "Self-regulated learning in MOOCs : lessons learned from a literature review", Educational Review, 72(3), pp.319~345 (2020)
  18. Artino Jr, A. R., "Exploring the complex relations between achievement emotions and self-regulated learning behaviors in online learning", The Internet and Higher Education, 15(3), pp.170~175 (2012)
  19. Balloo, K., "A systematic review of interventions targeting self-regulation in higher education", Proceedings of the 2020 AERA Annual Meeting (2020), University of Southern Queensland
  20. Bannert, M., "Supporting self-regulated hypermedia learning through prompts", Instructional Science, 40, pp.193~211 (2012)
  21. Bannert, M., "Short-and long-term effects of students’self-directed metacognitive prompts on navigation behavior and learning performance", Computers in Human Behavior, 52, pp.293~306 (2015)
  22. Bernard, R., "Effect size calculation for meta-analysis", Presented at the 2009 Campbell Colloquium in Oslo (2009)
  23. Borenstein, M., "Introduction to meta-analysis" (2009), John Wiley & Sons
  24. Broadbent, J., "Comparing online and blended learner's self-regulated learning strategies and academic performance", The Internet and Higher Education, 33, pp.24~32 (2017)
  25. Broadbent, J., "Tertiary Online Teaching and Learning(Vol. 4)", pp.299~308 (2020), Springer
  26. Chang, Y., "The 5min meta-analysis : understanding how to read and interpret a forest plot", Eye, 36, pp.673~675 (2022)
  27. Chen, C. H., "Using the BookRoll e-book system to promote self-regulated learning, self-efficacy and academic achievement for university students", Journal of Educational Technology & Society, 22(4), pp.33~46 (2019)
  28. Cogliano, M., "A self-regulated learning analytics prediction-and-intervention design : Detecting and supporting struggling biology students", Journal of Educational Psychology, 114(8), pp.1801~1816 (2022)
  29. Cohen, J., "Statistical power analysis for the behavioral science" (1988), Lawrence Erldbaum Associates
  30. Cooper, H., "Synthesizing research: A guide for literature reviews" (1998), Sage
  31. Cooper, H., "Research synthesis and meta-analysis: A step-by-step approach(Vol. 2)" (2015), Sage publications
  32. Daumiller, M., "Supporting self-regulated learning with digital media using motivational regulation and metacognitive prompts", The Journal of Experimental Education, 87(1), pp.161~176 (2019)
  33. Davis, D., "Retrieval practice and study planning in MOOCs: Exploring classroom-based self-regulated learning strategies at scale", Adaptive and Adaptable Learning: 11th European Conference on Technology Enhanced Learning, pp.57~71 (2016), Springer International Publishing
  34. de Bruijn-Smolders, M., "Effective self-regulatory processes in higher education : Research findings and future directions. A systematic review", Studies in Higher Education, 41(1), pp.139~158 (2016)
  35. Dixson, W. J., "Questions of normality, Introduction to statistical analysis" (1969), McGraw-Hill
  36. Duffy, M. C., "Motivation matters : Interactions between achievement goals and agent scaffolding for self-regulated learning within an intelligent tutoring system", Computers in Human Behavior, 52, pp.338~348 (2015)
  37. Duval, S., "A nonparametric ‘trim and fill’ method of accounting for publication bias in meta-analysis", Journal of the American Statistical Association, 95, pp.89~98 (2000)
  38. Edisherashvili, N., "Supporting self-regulated learning in distance learning contexts at higher education level : systematic literature review", Frontiers in Psychology, 12, pp.1~21 (2022)
  39. Eggers, J. H., "Self-regulation strategies in blended learning environments in higher education : A systematic review", Australasian Journal of Educational Technology, 37(6), pp.175~192 (2021)
  40. Engelmann, K., "Do self-created metacognitive prompts promote short-and long-term effects in computer-based learning environments?", Research and Practice in Technology Enhanced Learning, 16(1), pp.1~21 (2021)
  41. The effect of learning analytics-based interventions in mobile learning on students' academic achievements, self-regulated learning skills, and motivations, "Ezin, C. C.", Universal Access in the Information Society, 1~16 (2022)
  42. Ge, X., "Scaffolding students’ problem-solving processes in an ill-structured task using question prompts and peer interactions", Educational Technology Research and Development, 51(1), pp.21~38 (2003)
  43. Ge, X., "A conceptual framework for scaffolding III-structured problem-solving processes using question prompts and peer interactions", Educational Technology Research and Development, 52(2), pp.5~22 (2004)
  44. Guo, L., "Using metacognitive prompts to enhance self-regulated learning and learning outcomes : A meta analysis of experimental studies in computer-based learning environments", Journal of Computer Assisted Learning, 38(3), pp.811~832 (2022)
  45. Guo, J., "Measuring and promoting self-regulation for equity and quality of online learning : New evidence from a multi-institutional survey during COVID-19", Education Sciences, 12(7), pp.465~ (2022)[DOI]
  46. Hedges, L. V., "Statistical methods for meta-analysis" (1985), Academic Press
  47. Higgins, J., "Cochrane Handbook for systematic reviews of interventions (version 5.1.0)" (2011), The Cochrane Collaboration
  49. Huh, Y., "Self-regulated learning : The continuous-change conceptual framework and a vision of new paradigm, technology system, and pedagogical support", Journal of Educational Technology Systems, 46(2), pp.191~214 (2017)
  50. Jansen, R. S., "Supporting learners' self-regulated learning in Massive Open Online Courses", Computers & Education, 146, pp.1~17 (2020)
  51. Khiat, H., "A self-regulated learning management system : Enhancing performance, motivation and reflection in learning", Journal of University Teaching & Learning Practice, 19(2), pp.43~59 (2022)
  52. Kim, D., "Learning analytics to support self-regulated learning in asynchronous online courses : A case study at a women's university in South Korea", Computers & Education, 127, pp.233~251 (2018)
  53. 김정현, "Effects of learning analytics dashboard: analyzing the relations among dashboard utilization, satisfaction, and learning achievement", Asia Pacific Education Review, 17(1), pp.13~34 (2016), 교육연구소
  54. Koh, J. H. L., "Project-based learning and student knowledge construction during asynchronous online discussion", The Internet and Higher Education, 13(4), pp.284~291 (2010)
  55. Lara, J. A., "A system for knowledge discovery in e-learning environments within the European Higher Education Area-Application to student data from Open University of Madrid, UDIMA", Computers & Education, 72, pp.23~36 (2014)
  56. Lee, D., "Systematic literature review on self-regulated learning in massive open online courses", Australasian Journal of Educational Technology, 35(1), pp.28~41 (2019)
  57. Lee, H. W., "Improving self-regulation, learning strategy use, and achievement with metacognitive feedback", Educational Technology Research and Development, 58, pp.629~648 (2010)
  58. Lim, L. A., "What changes, and for whom? A study of the impact of learning analytics-based process feedback in a large course", Learning and Instruction, 72, pp.101202~ (2021)
  59. Lim, L., "Effects of real-time analytics-based personalized scaffolds on students’ self-regulated learning", Computers in Human Behavior, 139, pp.107547~ (2023)[DOI]
  60. Lin, X., "Supporting learning of variable control in a computer-based biology environment : Effects of prompting college students to reflect on their own thinking", Journal of Research in Science Teaching, 36(7), pp.837~858 (1999)
  61. Manganello, F., "A dashboard to monitor self-regulated learning behaviours in online professional development", International Journal of Distance Education Technologies, 19(1), pp.18~34 (2021)
  62. Michailidis, N., "Examining the effect of interaction analysis on supporting students’ motivation and learning strategies in online blog-based secondary education programming courses", Interactive Learning Environments, 30(4), pp.665~676 (2019)
  63. Molenaar, I., "Young learners’ regulation of practice behavior in adaptive learning technologies", Frontiers in Psychology, 10, pp.2792~ (2019)
  64. Müller, N. M., "Effects of self-regulation prompts in hypermedia learning on learning performance and self-efficacy", Learning and instruction, 58, pp.1~11 (2018)
  65. Nguyen, L. T., "The effects of ePortfolio-based learning model on student self-regulated learning", Active Learning in Higher Education, 16(3), pp.197~209 (2015)
  66. Panadero, E., "A review of self-regulated learning : Six models and four directions for research", Frontiers in psychology, 422, pp.1~28 (2017)[DOI]
  67. Pekrun, R., "Boredom in achievement settings : Exploring control–value antecedents and performance outcomes of a neglected emotion", Journal of Educational Psychology, 102, pp.531~549 (2010)
  68. Pintrich, P. R., "A conceptual framework for assessing motivation and self-regulated learning in college students", Educational Psychology Review, 16(4), pp.385~407 (2004)
  69. Pintrich, P. R., "Motivational and self-regulated learning components of classroom academic performance", Journal of educational psychology, 82(1), pp.33~40 (1990)
  70. Reid, A. J., "Generative learning strategy use and self-regulatory prompting in digital text", Journal of Information Technology Education : Research, 13(1), pp.49~72 (2014)
  71. Sáiz-Manzanares, M. C., "Does the use of learning management systems with hypermedia mean improved student learning outcomes?", Frontiers in psychology, 10, pp.1~14 (2019)
  72. Saks, K., "The efficiency of prompts when supporting learner use of cognitive and metacognitive strategies", Computer Assisted Language Learning, 32(1-2), pp.1~16 (2019)
  73. Schnaubert, L., "Prompting and visualising monitoring outcomes : Guiding self-regulatory processes with confidence judgments", Learning and Instruction, 49, pp.251~262 (2017)
  74. Schumacher, C., "Investigating prompts for supporting students' self-regulation–A remaining challenge for learning analytics approaches?", The Internet and Higher Education, 49, pp.1~12 (2021)
  75. Schunk, D. H., "Self-regulatory processes during computer skill acquisition : Goal and self-evaluative influences", Journal of educational psychology, 91(2), pp.251~ (1999)
  76. Schwonke, R., "Metacognitive support promotes an effective use of instructional resources in intelligent tutoring", Learning and Instruction, 23, pp.136~150 (2013)
  77. Silva, L., "Regulation of learning interventions in programming education: A systematic literature review and guideline proposition", Proceedings of the 52nd ACM Technical Symposium on Computer Science Education, pp.647~653 (2021)
  78. Sitzmann, T., "Sometimes you need a reminder : The effects of prompting self-regulation on regulatory processes, learning, and attrition", Journal of Applied Psychology, 95(1), pp.132~144 (2010)
  79. Song, D., "Effects of self-regulation scaffolding on online participation and learning outcomes", Journal of Research on Technology in Education, 53(3), pp.249~263 (2021)
  80. Sonnenberg, C., "Using Process Mining to examine the sustainability of instructional support : How stable are the effects of metacognitive prompting on self-regulatory behavior", Computers in Human Behavior, 96, pp.259~272 (2019)
  81. Sterne, J. A., "Publication and related bias in meta-analysis : power of statistical tests and prevalence in the literature", Journal of Clinical Epidemiology, 53(11), pp.1119~1129 (2000)
  82. Su, J. M., "A rule-based self-regulated learning assistance scheme to facilitate personalized learning with adaptive scaffoldings : A case study for learning computer software", Computer Applications in Engineering Education, 28(3), pp.536~555 (2020)
  83. "Wherever you are, learn with the University of Chicago"[URL]
  84. Ustun, A. B., "Learning analytics based feedback and recommendations in flipped classrooms: An experimental study in higher education", Journal of Research on Technology in Education, pp.1~17 (2022)
  85. van Alten, D. C., "Self-regulated learning support in flipped learning videos enhances learning outcomes", Computers & Education, 158, pp.1~13 (2020)
  86. Viberg, O., "Self-regulated learning and learning analytics in online learning environments: A review of empirical research", Proceedings of the tenth international conference on learning analytics & knowledge, pp.524~533 (2020)
  87. Wang, C. H., "Students’ characteristics, self-regulated learning, technology self-efficacy, and course outcomes in online learning", Distance Education, 34(3), pp.302~323 (2013)
  88. Wang, X., "Facilitating English grammar learning by a personalized mobile-assisted system with a self-regulated learning mechanism", Frontiers in Psychology, 12, pp.1~13 (2021)
  89. Wäschle, K., "Effects of visual feedback on medical students’ procrastination within web-based planning and reflection protocols", Computers in Human Behavior, 41, pp.120~136 (2014)
  90. Winne, P. H., "Self-regulated learning and academic achievement", pp.153~189 (2001), Erlbaum
  91. Wirth, J., "Promoting self-regulated learning through prompts", German Journal of Educational Psychology, 23(2), pp.91~94 (2009)
  92. Wolters, C. A., "Self-regulated learning and the 21st century competencies", Department of Educational Psychology, pp.2010
  93. Wong, J., "Supporting self-regulated learning in online learning environments and MOOCs: A systematic review", International Journal of Human–Computer Interaction, 35(4-5), pp.356~373 (2019)
  94. Wong, J., "Examining the use of prompts to facilitate self-regulated learning in Massive Open Online Courses", Computers in Human Behavior, 115, pp.106596~ (2021)
  95. Wong, J., "Facilitating goal setting and planning to enhance online self-regulation of learning", Computers in Human Behavior, 124, pp.106913~ (2021)
  96. Wood, S., "School-based mentoring for adolescents : A systematic review and meta-analysis", Research on Social Work Practice, 22(3), pp.257~269 (2012)
  97. Xu, Z., "A meta-analysis of the efficacy of self-regulated learning interventions on academic achievement in online and blended environments in K-12 and higher education", Behaviour & Information Technology, pp.1~21 (2022)
  98. Yilmaz, F. G. K,, "Learning analytics intervention improves students’engagement in online learning", Technology, Knowledge and Learning, 27(2), pp.449~460 (2022)
  99. Yoon, M., "Designing supports for promoting self-regulated learning in the flipped classroom", Journal of Computing in Higher Education, 33, pp.398~418 (2021)
  100. Lanqin Zheng, "The effectiveness of self-regulated learning scaffolds on academic performance in computer-based learning environments: a meta-analysis", Asia Pacific Education Review, 17(2), pp.187~202 (2016), 교육연구소
  101. Zheng, J., "Emotions in self-regulated learning : A critical literature review and meta-analysis", Frontiers in Psychology, 14, pp.1137010~ (2023)
  102. Ziegler, N. A., "Fostering self-regulated learning through the European language portfolio : An embedded mixed methods study", The Modern Language Journal, 98(4), pp.921~936 (2014)
  103. Zimmermann, B. J., "Self-Regulated Learning and Academic Achievement: Theory, Research and Practice", pp.1~26 (1989)
  104. Zimmerman, B. J., "Self- regulation of learning and performance: Issues and educational applications", pp.3~44 (1994), Erlbaum
  105. Zimmerman, B. J., "Handbook of self-regulation", pp.13~39 (2000), Academic Press
  106. Zimmerman, B. J., "Student differences in self-regulated learning : Relating grade, sex, and giftedness to self-efficacy and strategy use", Journal of educational Psychology, 82(1), pp.51~ (1990)
  107. Zumbach, J., "Cognitive and metacognitive support in learning with a serious game about demographic change", Computers in Human Behavior, 103, pp.120~129 (2020)

관련 논문AI추천

중ㆍ고등학생에 대한 자기조절학습 프로그램 효과의 메타분석신인수, 장봉석한국교육과정평가원 · 교육과정평가연구2011 · 제14권 제3호자기조절학습과 정의적 특성의 관련성에 대한 메타분석양명희, 최영아사범대학부속중등교육연구소 · 중등교육연구2013 · 제61권 제4호자기조절학습 행동데이터에 대한 탐색적 연구: 해외 학습분석 연구를 중심으로박소영, 이성혜, 이유경, 함은혜한국교육공학회 · 교육공학연구2021 · 제37권 제2호생성형 AI 활용 학습에 대한 체계적 문헌 고찰 연구: 자기조절학습을 중심으로유미나, 진성희한국교육정보미디어학회 · 교육정보미디어연구2024 · 제30권 제6호수정계획이 포함된 자기조절학습 초인지 촉진전략이 학습에 미치는 효과김광수, 허소현대한사고개발학회 · 사고개발2011 · 제7권 제2호메타인지 전략이 학업 성취에 미치는 영향에 대한 체계적 문헌고찰 : 2015~2025년 국내 학술지를 중심으로노들교육연구소 · 교육문화연구2025 · 제31권 제6호

이 간행물의 다른 논문 (8건)

가상 시뮬레이션 학습자의 인지부하와 정서를 분석하기 위한 표정 분석 및 뇌전도의 활용류지헌, 임태형, 김국현, 양은별pp. 197-2222022 개정 교육과정 관련 학교교육과정에서 강화될 영역에 대한 요구 분석: 잠재적 디리클레 할당모형 분석을 중심으로김대석, 박우식pp. 223-240중등교육에서 학습전략과 과제수행동기의 산문파지 효과서일보, 홍주영pp. 241-258온라인 프로젝트기반학습 설계와 실행 전략 개발: 긍정탐색을 활용하여장경원pp. 259-294대학생의 성취동기 프로파일과 노력조절 및 인지적 참여에서의 차이정윤경pp. 329-350
원문 보기