본문 바로가기
KERD
논문KCI 등재

CSCL에서 다중양식(multimodal) 데이터 활용 연구 동향:토픽모델링과 의미연결망 분석을 중심으로

Research trends of the use of multimodal data in CSCL: Topic modeling and semantic network analysis approach

박하은|박은주|차수민|임규연
한국교육정보미디어학회 (Korea Association for Educational Information and Media)|2023.12|교육정보미디어연구 (Journal of Korean Association for Educational Information and Media)|제29권 제4호|pp. 1183-1212

0

조회

0

다운로드

1

인용

0

참고문헌

키워드

토픽모델링Topic ModelingSemantic Network Analysis의미연결망분석CSCLMultimodal Data컴퓨터기반 협력학습다중양식 데이터
주제분류교육학

초록

본 연구는 CSCL에서의 다중양식 데이터 활용 관련 연구 동향을 탐색하기 위해 토픽모델링 및 의미연결망 분석을 실시하였으며, 향후 연구 방향과 협력학습 지원을 위한 시사점을 도출하였다. 이를 위해 2012년부터 2023년 6월까지 발행된 CSCL에서 다중양식 데이터를 활용한 국내외 문헌 113편의 초록을 분석한 결과는 다음과 같다. 첫째, LDA 기반 토픽모델링 분석을 통해 “제스처 및 행동 데이터 등을 활용한 온라인상의 협력적 상호작용 탐구”, “비디오 및 생리학적 데이터 등을 활용한 협력적 과제 수행에서의 자기 조절 연구”, “신체 동작, 생리학적 데이터 등을 활용한 디지털 도구 기반 협력적 문제해결 분석”, “협력적 언어학습에서 발화 데이터, 학습 산출물 등을 활용한 의사소통 및 인지적 참여 분석”, “학습 산출물, 행동 및 발화 데이터 등을 활용한 협력적 과제 수행 평가”, “다양한 테크놀로지 기반 협력학습에서 저연령 학습자의 행동 데이터 및 시선 분석”, “생리학적 데이터, 자기보고식 데이터 등을 활용한 협력적 지식 구축과 패턴 분석”의 총 7개 토픽을 도출하였다. 둘째, 의미연결망 분석을 통해 토픽 7에 포함된 주제어를 중심으로 다른 토픽들이 연결되어 있는 구조를 확인하였다. 또한 상호작용, 조절, 지식 구축, 성과 평가를 중심으로 총 4개의 군집이 도출되었다. 이를 바탕으로 향후 CSCL 맥락에서 다중양식 데이터를 활용하여 학습자 중심의 적응적 지원을 하기 위한 시사점을 제공할 수 있을 것으로 기대한다.

Abstract

This study explores research trends related to the use of multimodal data in Computer-supported Collaborative Learning(CSCL) through topic modeling and semantic network analysis. We analyzed the abstracts of 113 domestic and international papers that used multimodal data in CSCL, published between 2012 and June 2023. The findings are as follows. First, seven main topics were identified through LDA-based topic modeling analysis: ‘Utilizing gesture and action data in the exploration of collaborative interaction online’, ‘Utilizing video and physiological data in self-regulation research during collaborative task performance’, ‘Utilizing physical movement and physiological data in the analysis of collaborative problem-solving’, ‘Utilizing speech data and learning outputs in the analysis of communication and cognitive engagement in collaborative language learning’, ‘Utilizing learning outcomes, behavioral, and speech data in the evaluation of collaborative task performance’, ‘Utilizing behavior and gaze data in the analysis of young learners in various technology-based collaborative learning’ and ‘Utilizing physiological data and self-report data in pattern analysis of collaborative knowledge construction.’ Second, the semantic network analysis revealed the structure in which other topics are connected centered around the keywords included in Topic 7. Additionally, four clusters emerged, centered around interaction, regulation, knowledge construction, and performance evaluation. Based on these findings, the study would provide insights into learner-centered adaptive support in CSCL contexts using multimodal data.

참고문헌 (94)

  1. 김용학, "사회 연결망 분석" (2016), 박영사
  2. 백수미, "텍스트마이닝 및 CONCOR 분석을 활용한 환자안전문화 융복합 연구주제 분석", 디지털융복합연구, 19(12), pp.359~367 (2021), 한국디지털정책학회[DOI]
  3. 유주영, "학생인권에 관한 사회적 이슈 분석: 토픽모델링을 활용한 국내 언론 보도기사 분석을 중심으로", 교육학연구, 60(1), pp.205~234 (2022), 한국교육학회
  4. 이현주, "테크놀로지 활용의 화상 기반 원격협력 영어학습과 창의성 계발", 학습자중심교과교육연구, 20(18), pp.879~904 (2020), 학습자중심교과교육학회[DOI]
  5. 임규연, "웹기반 협력적 문제해결학습에서 스캐폴딩 유형에 따른 상호작용 패턴 및 팀 성과 탐색", 학습자중심교과교육연구, 15(8), pp.1~25 (2015), 학습자중심교과교육학회
  6. 조일현, "HRD와 학습분석학" (2023), 박영스토리
  7. 함윤희, "다중양식 학습분석의 연구동향과 발전방안 탐색을 위한 체계적 문헌 고찰", 교육정보미디어연구, 27(2), pp.501~529 (2021), 한국교육정보미디어학회
  8. Andrade, V. D., "Drawing as a space for social-cognitive interaction", Education Sciences, 12(1), pp.45~ (2022)
  9. Aoyama Lawrence, L., "Being in-sync : A multimodal framework on the emotional and cognitive synchronization of collaborative learners", Frontiers in Education, 7, pp.867186~ (2022)
  10. Arun, R., "On finding the natural number of topics with latent dirichlet allocation: Some observations", Proceedings of the 14th Pacific-Asia Conference on Advances in Knowledge Discovery and Data Mining, pp.391~402 (2010)
  11. Aslan, S., "Exploring kid space in the wild : A preliminary study of multimodal and immersive collaborative play-based learning experiences", Educational Technology Research and Development, 70, pp.205~230 (2022)
  12. Blei, D. M., "Latent dirichlet allocation", Journal of Machine Learning Research, 3, pp.993~1022 (2003)
  13. Blikstein, P., "Multimodal learning analytics and education data mining : Using computational technologies to measure complex learning tasks", Journal of Learning Analytics, 3(2), pp.220~238 (2016)
  14. Bridges, S. M., "Dialogic intervisualizing in multimodal inquiry", International Journal of Computer-Supported Collaborative Learning, 15, pp.283~318 (2020)
  15. Cao, J., "A density-based method for adaptive LDA model selection", Neurocomputing, 72(7-9), pp.1775~1781 (2009)
  16. Carroll, A., "Changes in science attitudes, beliefs, knowledge and physiological arousal after implementation of a multimodal, cooperative intervention in primary school science classes", Information and Learning Sciences, 120(7-8), pp.409~425 (2019)
  17. Chejara, P., "Multimodal learning analytics research in the wild: Challenges and their potential solutions", Proceedings of LAK 2023 Workshop: Leveraging Multimodal Data for Generating Meaningful Feedback, pp.1~5 (2023)
  18. Chung, C. Y., "Collaborative programming problem-solving in augmented reality: Multimodal analysis of effectiveness and group collaboration", Australasian Journal of Educational Technology, 37(5), pp.17~31 (2021)
  19. Cornide-Reyes, H., "A multimodal real-time feedback platform based on spoken interactions for remote active learning support", Sensors, 20(21), pp.6337~ (2020)
  20. Damon, W., "Critical distinctions among three approaches to peer education", International Journal of Educational Research, 13(1), pp.9~19 (1989)
  21. D'angelo, S., "Shared gaze visualizations in collaborative interactions : Past, present and future", Interacting with Computers, 33(2), pp.115~133 (2021)
  22. Davidsen, J., "“This is the size of one meter”: Children’s bodily-material collaboration", International Journal of Computer-Supported Collaborative Learning, 12, pp.65~90 (2017)
  23. Deveaud, R., "Accurate and effective latent concept modeling for ad hoc information retrieval", Document Numérique, 17(1), pp.61~84 (2014)
  24. Di Mitri, D., "From signals to knowledge : A conceptual model for multimodal learning analytics", Journal of Computer Assisted Learning, 34(4), pp.338~349 (2018)
  25. Dillenbourg, P, "Collaborative learning: Cognitive and computational approaches", pp.1~19 (1999), Emerald Group Publishing Limited
  26. DiMaggio, P., "Exploiting affinities between topic modeling and the sociological perspective on culture: Application to newspaper coverage of U.S. government arts funding", Poetics, 41(6), pp.570~606 (2013)
  27. Dindar, M., "Detecting shared physiological arousal events in collaborative problem solving", Contemporary Educational Psychology, 69, pp.102050~ (2022)
  28. Doerfel, M. L., "What constitutes semantic network analysis? A comparison of research and methodologies", Connections, 21(2), pp.16~26 (1998)
  29. Elleström, L., "Media borders, multimodality and intermediality" (2010), Springer
  30. Engelmann, K., "Analyzing temporal data for understanding the learning process induced by metacognitive prompts", Learning and Instruction, 72, pp.101205~ (2021)
  31. Gilbert, N. J., "Collaborative knowledge building : A case study", Educational Technology Research and Development, 50(1), pp.59~79 (2002)
  32. Gillies, R. M., "Multimodal representations during an inquiry problem-solving activity in a Year 6 science class : A case study investigating cooperation, physiological arousal and belief states", Australian Journal of Education, 60(2), pp.111~127 (2016)
  33. Goodyear, P., "Handbook of research on educational communications and technology", pp.439~451 (2014), Springer
  34. Griffiths, T. L., "Finding scientific topics", Proceedings of the National Academy of Sciences, 101(suppl 1), pp.5228~5235 (2004)
  35. Hadwin, A., "Self-regulation, coregulation, and socially shared regulation : Exploring perspectives of social in self-regulated learning theory", Teachers College Record, 113(2), pp.240~264 (2011)
  36. Hannula, M. S., "Advancing video research methodology to capture the processes of social interaction and multimodality", ZDM–Mathematics Education, 54(2), pp.433~443 (2022)
  37. Hassani, H., "Text mining in big data analytics", Big Data and Cognitive Computing, 4(1), pp.1~34 (2020)
  38. Järvelä, S., "Capturing the dynamic and cyclical nature of regulation : Methodological progress in understanding socially shared regulation in learning", International Journal of Computer-Supported Collaborative Learning, 14(4), pp.425~441 (2019)
  39. Järvelä, S., "What multimodal data can tell us about the students’ regulation of their learning process?", Learning and Instruction, 72, pp.101203~ (2021)
  40. Järvelä, S., "Human and artificial intelligence collaboration for socially shared regulation in learning", British Journal of Educational Technology, 54, pp.1057~1076 (2023)
  41. Jeong, H., "Ten years of computer-supported collaborative learning : A meta-analysis of CSCL in STEM education during 2005–2014", Educational Research Review, 28, pp.100284~ (2019)
  42. Jiang, S., "Designing discipline-specific roles for interdisciplinary learning : Two comparative cases in an afterschool STEM+L programme", International Journal of Science Education, 41(6), pp.803~826 (2019)
  43. Kajamaa, A., "Students’ multimodal knowledge practices in a makerspace learning environment", International Journal of Computer-Supported Collaborative Learning, 15(4), pp.411~444 (2020)
  44. Kazemitabar, M. A., "A classification of challenges encountered in complex teamwork settings", International Journal of Computer-Supported Collaborative Learning, 17(2), pp.225~247 (2022)
  45. Kesler, T., "Bringing the book to life : Responding to historical fiction using digital storytelling", Journal of Literacy Research, 48(1), pp.39~79 (2016)
  46. Kim, Y., "Peer interaction, writing proficiency, and the quality of collaborative digital multimodal composing task : Comparing guided and unguided planning", System, 106, pp.102722~ (2022)
  47. Kirschner, P. A., "From cognitive load theory to collaborative cognitive load theory", International Journal of Computer-Supported Collaborative Learning, 13(2), pp.213~233 (2018)
  48. Kress, G., "Multimodal discourse: The modes and media of contemporary communication" (2001), Hodder Arnold
  49. Laal, M., "Collaborative learning : What is it?", Procedia-Social and Behavioral Sciences, 31, pp.491~495 (2012)
  50. Lämsä, J., "The focus and timing of gaze matters : Investigating collaborative knowledge construction in a simulation-based environment by combined video and eye tracking", Frontiers in Education, 7, pp.942224~ (2022)
  51. Liang, H., "Exploitation of multiplayer interaction and development of virtual puppetry storytelling using gesture control and stereoscopic devices", Computer Animation and Virtual Worlds, 28(5), pp.e1727~ (2017)
  52. Lin, V., "Supporting dyadic learning of English for tourism purposes with scenery-based virtual reality", Computer Assisted Language Learning, 36(5-6), pp.906~942 (2023)
  53. Lipponen, L, "Computer support for collaborative learning", pp.72~81 (2002), Routledge
  54. Liu, R., "Learning linkages : Integrating data streams of multiple modalities and timescales", Journal of Computer Assisted Learning, 35(1), pp.99~109 (2019)
  55. Malmberg, J., "Going beyond what is visible : What multichannel data can reveal about interaction in the context of collaborative learning?", Computers in Human Behavior, 96, pp.235~245 (2019)
  56. Malmberg, J., "The multimodal learning analytics handbook", pp.79~104 (2022), Springer International Publishing
  57. Martinez-Maldonado, R., "Collocated collaboration analytics : Principles and dilemmas for mining multimodal interaction data", Human-Computer Interaction, 34(1), pp.1~50 (2019)
  58. Miyake, N., "The Cambridge handbook of the learning sciences", pp.418~438 (2014), Cambridge University Press
  59. Mohammadi Zenouzagh, Z., "Student interaction patterns and co-regulation practices in text-based and multimodal computer mediated collaborative writing modalities", Educational Technology Research and Development, 71(2), pp.313~338 (2023)
  60. Mu, S., "Multimodal data fusion in learning analytics : A systematic review", Sensors, 20(23), pp.6856~ (2020)
  61. Nguyen, A., "Examining socially shared regulation and shared physiological arousal events with multimodal learning analytics", British Journal of Educational Technology, 54(1), pp.293~312 (2023)
  62. Noroozi, O., "Multimodal data to design visual learning analytics for understanding regulation of learning", Computers in Human Behavior, 100, pp.298~304 (2019)
  63. Noroozi, O., "Multimodal data indicators for capturing cognitive, motivational, and emotional learning processes : A systematic literature review", Education and Information Technologies, 25(6), pp.5499~5547 (2020)
  64. Olsen, J. K., "Temporal analysis of multimodal data to predict collaborative learning outcomes", British Journal of Educational Technology, 51(5), pp.1527~1547 (2020)
  65. Ouyang, F., "Applying multimodal learning analytics to examine the immediate and delayed effects of instructor scaffoldings on small groups’ collaborative programming", International Journal of STEM Education, 9(1), pp.45~ (2022)
  66. Prain, V., "Theorising learning in science through integrating multimodal representations", Research in Science Education, 52, pp.805~817 (2022)
  67. Roschelle, J., "Computer supported collaborative learning", pp.69~97 (1995), Springer
  68. Safin, S., "Use of graphical modality in a collaborative design distant setting", Work, 41(Supplement 1), pp.3484~3493 (2012)
  69. Schneider, B., "International handbook of computer-supported collaborative learning", pp.625~641 (2021)
  70. Schneider, B., "Unraveling students’ interaction around a tangible interface using multimodal learning analytics", Journal of Educational Data Mining, 7(3), pp.89~116 (2015)
  71. Segev, E, "Semantic network analysis in social sciences" (2021), Routledge
  72. Sharma, D., "Trend analysis in machine learning research using text mining", Proceedings of 2018 International Conference on Advances in Computing, Communication Control and Networking, pp.136~141 (2018)
  73. Sharma, K., "Multimodal data capabilities for learning: What can multimodal data tell us about learning?", British Journal of Educational Technology, 51(5), pp.1450~1484 (2020)
  74. Sharma, K., "Utilizing interactive surfaces to enhance learning, collaboration and engagement : Insights from learners’ gaze and speech", Sensors, 20(7), pp.1964~ (2020)
  75. Silge, J., "Text mining with R: A tidy approach" (2017), O'Reilly Media, Inc
  76. Silseth, K., "Multimodal composition and assessment: A sociocultural perspective", Assessment in Education: Principles, Policy & Practice, 26(1), pp.26~42 (2019)
  77. Sobocinski, M., "Exploring adaptation in socially-shared regulation of learning using video and heart rate data", Technology, Knowledge and Learning, 27(2), pp.385~404 (2022)
  78. Stahl, G, "A model of collaborative knowledge-building", Fourth International Conference of the Learning Sciences, 10, pp.70~77 (2000), Erlbaum
  79. Stahl, G., "International handbook of computer-supported collaborative learning", pp.23~43 (2021), Springer
  80. Stahl, G., "The Cambridge handbook of the learning sciences", pp.479~500 (2014), Cambridge University Press
  81. Stahl, G., "The Cambridge handbook of the learning sciences", pp.406~427 (2022), Cambridge University Press
  82. Strada, F., "Leveraging a collaborative augmented reality serious game to promote sustainability awareness, commitment and adaptive problem-management", International Journal of Human-Computer Studies, 172, pp.102984~ (2023)
  83. Tang, H., "Using multimodal analytics to systemically investigate online collaborative problem-solving", Distance Education, 43(2), pp.290~317 (2022)
  84. Tang, K. S., "Intertextuality and multimodal meanings in high school physics : Written and spoken language in computer-supported collaborative student discourse", Classroom Discourse, 8(1), pp.19~35 (2017)
  85. Törmänen, T., "All for one and one for all–How are students’ affective states and group-level emotion regulation interconnected in collaborative learning?", International Journal of Educational Research, 109, pp.101861~ (2021)
  86. Törmänen, T., "Exploring groups’ affective states during collaborative learning : What triggers activating affect on a group level?", Educational Technology Research and Development, 69(5), pp.2523~2545 (2021)
  87. Törmänen, T., "Affective states and regulation of learning during socio emotional interactions in secondary school collaborative groups", British Journal of Educational Psychology, 93, pp.48~70 (2023)
  88. Trausan-Matu, S., "International handbook of computer-supported collaborative learning", pp.551~567 (2021)
  89. Wigham, C. R., "A study of verbal and nonverbal communication in second life–the ARCHI21 experience", ReCALL, 25(1), pp.63~84 (2013)
  90. Winne, P. H., "Comments on motivation in real-life, dynamic, and interactive learning environments : Theoretical and methodological challenges when researching motivation in context", European Psychologist, 9(4), pp.257~263 (2004)
  91. Wise, A. F., "International handbook of computer-supported collaborative learning", pp.425~443 (2021), Springer
  92. Worsley, M, "Multimodal learning analytics' past, present, and potential futures", Companion Proceedings 8th International Conference on Learning Analytics & Knowledge, pp.1~16 (2018)
  93. Worsley, M, "Towards the development of multimodal action based assessment", Proceedings of the 3rd International Conference on Learning Analytics and Knowledge, pp.94~101 (2013)
  94. Zimmerman, B. J., "Investigating self-regulation and motivation: Historical background, methodological developments, and future prospects", American Educational Research Journal, 45(1), pp.166~183 (2008)

관련 논문AI추천

국내외 협력학습분석학(Collaboarative Learning Analytics) 연구 동향에 대한 체계적 문헌고찰김혜준, 이다혜, 임규연, 정유진, 진명화한국교육공학회 · 교육공학연구2023 · 제39권 제4호협력 역량은 어떻게 측정될 수 있는가?: 멀티모달 데이터 기반 협력 연구 동향 탐색박소영, 이병윤, 이성혜, 장나영한국교육정보미디어학회 · 교육정보미디어연구2025 · 제31권 제3호컴퓨터기반 협력학습(CSCL) 연구에서의 인식연결망분석(ENA) 활용 동향 탐색: 체계적 문헌고찰을 적용하여김재현, 이주원, 임규연, 태지원한국교육정보미디어학회 · 교육정보미디어연구2024 · 제30권 제6호협력학습에서의 자기조절학습 측정을 위한 멀티모달 학습분석(MMLA) 활용: 체계적 문헌고찰김준원, 김창조, 신윤희, 임예린한국교육공학회 · 교육공학연구2025 · 제41권 제3호다중양식 학습분석의 연구동향과 발전방안 탐색을 위한 체계적 문헌 고찰김혜은, 이한솔, 조영환, 함윤희한국교육정보미디어학회 · 교육정보미디어연구2021 · 제27권 제2호학습자 역량 측정 연구 동향 분석: 멀티모달 학습분석을 중심으로박소영, 이성혜, 장나영한국교육공학회 · 교육공학연구2025 · 제41권 제3호

이 간행물의 다른 논문 (17건)

디지털 기술을 활용한 교사의 교육활동지원에 대한 요구분석진성희, 임동관, 유미나, 김성욱pp. 761-789수학, 과학 교육용 저작 도구에 대한 교사들의 사용성 평가 연구: STEAMuP의 사례를 중심으로이송희, 김영인, 박찬희, 이경화pp. 791-819대학교육에서 하이브리드 학습 운영을 위한 개념 모형 및 교수설계전략 개발 연구홍수민, 박성경, 한형종, 임은선, 김한휘, 임철일pp. 821-850잠재집단분석을 활용한 대학생의 디지털 리터러시 유형 분류 및 특성 분석강은하pp. 851-871대학생의 아바타 기반 실시간 온라인 토론 경험에 대한 미디어 생태학적 고찰최진, 임지은pp. 873-901
원문 보기