본문 바로가기
KERD
논문KCI 등재

이러닝 학습참여활동 및 상호작용에 대한 대시보드 설계 연구

Design of a Dashboard for Enhancing e-Learning Participation and Interaction

김태현|유미나|진성희
한국교육공학회 (Korean Society Of Educational Technology)|2015.06|교육공학연구 (Journal of Educational Technology)|제31권 제2호|pp. 191-221|DOI http://dx.doi.org/10.17232/KSET.31.2.191

1

조회

0

다운로드

26

인용

0

참고문헌

키워드

interactionsocial comparison대시보드학습분석learning analytics이러닝 참여도 증진참여도 시각화dashboard designe-Learning participationvisual feedbackparticipation visualization
주제분류교육학

초록

이러닝 참여가 학습성과에 주요한 영향을 미친다는 관점에 기반하여 학습자들에게 참여도를 시각화하여 제공하고자 시도했던 선행 연구들이 있어왔다. 그러나 관련 선행 연구에서는 상이한 연구결과를 제시하였다는 점, 현재의 이러닝 학습환경과는 상이한 환경에서 이루어졌다는 점, 학습자의 참여정보 중 일부만 활용했다는 점에서 일반화하는데 제약이 있었다. 따라서 본 연구의 목적은 이러닝 학습환경에서 참여도 증진을 위해 학습자의 학습활동 참여 수준을 시각화해 제시해주는 대시보드를 설계하고자 하였다. 선행 연구를 기반으로 참여도를 산출할 수 있는 분석 단위, 시각화 기법, 참여수준 등급에 대해 정리하였고 대시보드 개발을 위한 프로토타입을 설계하였다. 이러닝 참여도 대시보드에 대한 타당화는 전문가 타당화, 실제 개발을 통한 타당화, 학습자 대상의 현장적용의 세 가지 과정을 거쳐서 검증되었다. 전문가 타당화는 교육공학 박사 5명이 참여하였고 총 2차에 걸쳐서 이루어졌다. 수정보완된 대시보드 프로토타입에 기반하여 개발자 2명에 의해 이러닝 학습 커뮤니티에 실제 구현하는 과정에서 프로토타입이 재수정되었으며, 전문가 타당화를 통해 타당성을 검증받았다. 최종 개발된 이러닝 참여도 대시보드에 대해 A대학교 ‘창의적 사고’ 수강생 39명을 대상으로 효과평가 및 인식조사를 실시하였다. 이러닝 참여도 대시보드가 학습자들의 이러닝 참여도 증진에 효과가 있는지 동일집단 사전-사후 비교분석 결과 참여도와 상호작용 모두에 유의미한 효과가 있는 것으로 나타났다. 학습자의 인식조사 평가 결과 학습동기 신장 효과가 있었다는 의견이 47%로 가장 많았다. 이러한 연구결과를 기반으로 대시보드의 교육적 활용에 관한 시사점과 향후 연구과제에 대한 논의가 이루어졌다.

Abstract

There have been studies which attempted to provide learners with a visualization tool on learning participation levels in the perspective that participation of e-learning has a major effect on academic achievement. However, there were constraints on generalization since different results of the related researches were suggested, researches were conducted in different e-learning environments from now, and limited information of learners’ participation was used. Accordingly, the purpose of this research is to design a dashboard to provide the visualized learner’s participation level for enhancing e-Learning participation. Unit of analysis to yield participation rates, visualization technique, and grades of participation level were decided through literature review and a prototype was designed to develop the dashboard. The dashboard was verified and modified through two rounds of expert reviews, development of the dashboard, and learner’s usability test. Usability tests of the final e-Learning dashboard were carried out with 39 students who take ‘Creative thinking’ course in a university, Incheon. To investigate the effectiveness of e-Learning dashboard on participation level, one-group pretest-posttest analysis was conducted and the results showed meaningful effects on both participation and interaction levels. In the result of the learners’ usability test, improvement of learning motivation is the highest accounted for 47%. The implications of educational utilization of the dashboard and the future researches were discussed based on these results.

참고문헌 (67)

  1. 학습분석 모델 및 확장 방안 연구. 창조 비타민 L프로젝트 위탁연구 결과보고서, "나일주", 서울특별시교육청, ~ (2015)
  2. 박연정, "학습 분석학 기반 대시보드의 설계와 적용", 교육정보미디어연구, 20(2), pp.191~216 (2014), 한국교육정보미디어학회
  3. 진성희, "특허출원 제 10-2014-0048901", 특허청, ~ (2014)
  4. 조일현, "이러닝에서 학습자의 시간관리 전략이 학업성취도에 미치는 영향: 학습분석학적 접근", 교육정보미디어연구, 19(1), pp.83~107 (2013), 한국교육정보미디어학회
  5. Ali, L., "A qualitative evaluation of evolution of a learning analytics tool", Computers & Education, 58(1), pp.470~489 (2012)
  6. Bakharia, A., "SNAPP: A bird's-eye view of temporal participant interaction", Proceedings of the 1st international conference on learning analytics and knowledge, pp.168~173 (2011), ACM
  7. Bienkowski, M., "Enhancing teaching and learning through educational data mining and learning analytics: An issue brief", pp.1~57 (2012), US Department of Education, Office of Educational Technology
  8. Breslow, L., "Studying learning in the worldwide classroom : Research into edX’s first MOOC", Research & Practice in Assessment, 8(1), pp.13~25 (2013)
  9. Carr, T., "From peripheral to full participation in a blended trade bargaining simulation", British Journal of Educational Technology, 35(2), pp.197~211 (2004)
  10. Caspi, A., "Participation in class and in online discussions : Gender differences", Computers & Education, 50(3), pp.718~724 (2008)
  11. Clow, D., "An overview of learning analytics", Teaching in Higher Education, 18(6), pp.683~695 (2013)
  12. Davidson-Shivers, G. V., "How do students participate in synchronous and asynchronous online discussions?", Journal of Educational Computing Research, 25(4), pp.351~366 (2001)
  13. Davies, J., "Performance in e-learning : Online participation and student grades", British Journal of Educational Technology, 36(4), pp.657~663 (2005)
  14. Dawson, S., "‘Seeing’ the learning community : An exploration of the development of a resource for monitoring online student networking", British Journal of Educational Technology, 41(5), pp.736~752 (2010)
  15. De Laat, M., "Investigating patterns of interaction in networked learning and computer-supported collaborative learning : A role for Social Network Analysis", International Journal of Computer-Supported Collaborative Learning, 2(1), pp.87~103 (2007)
  16. De Liddo, A., "Discourse-centric learning analytics", Proceedings of the 1st International Conference on Learning Analytics and Knowledge, pp.23~33 (2011), ACM
  17. Eckerson, W. W., "Performance dashboards: Measuring, monitoring, and managing your business" (2006), John Wiley & Sons
  18. Elias, T., "Learning analytics : Definitions, processes and potential", Learning, 23, pp.134~148 (2011)
  19. Ellis, A., "Personality type and participation in networked learning environments", Educational Media International, 40(1-2), pp.101~114 (2003)
  20. Erickson, T., "Designing information spaces: The social navigation approach", pp.17~41 (2003), Springer London
  21. Ferguson, R., "Learning analytics : Drivers, developments and challenges", International Journal of Technology Enhanced Learning, 4(5), pp.304~317 (2012)
  22. Ferguson, R., "Learning analytics to identify exploratory dialogue within synchronous text chat", Proceedings of the 1st International Conference on Learning Analytics and Knowledge, pp.99~103 (2011), ACM
  23. Ferguson, R., "Social learning analytics: Fve approaches", Proceedings of the 2nd International Conference on Learning Analytics and Knowledge, pp.23~33 (2012), ACM
  24. Festinger, L., "A theory of social comparison processes", Human relations, 7(2), pp.117~140 (1954)
  25. Few, S., "Information dashboard design" (2006), O'Reilly
  26. Fredericksen, E., "Student satisfaction and perceived learning with on-line courses : Principles and examples from the SUNY learning network", Journal of Asynchronous Learning Networks, 4(2), pp.7~41 (2000)
  27. Hakkarainen, K., "Patterns of female and male students’ participation in peer interaction in computer-supported learning", Computers & Education, 40(4), pp.327~342 (2003)
  28. Hrastinski, S., "What is online learner participation? A literature review", Computers & Education, 51(4), pp.1755~1765 (2008)
  29. Hrastinski, S., "A theory of online learning as online participation", Computers & Education, 52(1), pp.78~82 (2009)
  30. Huang, W., "Effects of sociogram drawing conventions and edge crossings in social network visualization", Journal of Graph Algorithms Applications, 11(2), pp.397~429 (2007)
  31. Janssen, J., "Visualizing participation to facilitate argumentation", Proceedings of the 7th international conference on learning Sciences Bloomington (2006)
  32. Janssen, J., "Visualization of participation: Does it contribute to successful computer-supported collaborative learning?", Computers & Education, 49(4), pp.1037~1065 (2007)
  33. Jin, S. H., "Visual design guidelines for improving learning from dynamic and interactive digital text", Computers & Education, 63, pp.248~258 (2013)
  34. Johnson, D. W., "Cooperative learning returns to college what evidence is there that it works?", Change: The Magazine of Higher Learning, 30(4), pp.26~35 (1998)
  35. Johnson, L., "The 2011 horizon report" (2011), The New Media Consortium
  36. Koper, R., "Educational modelling language: Modelling reusable, interoperable, rich and personalised units of learning", British Journal of Educational Technology, 35(5), pp.537~551 (2004)
  37. Krippendorff, K., "Reliability in content analysis", Human Communication Research, 30(3), pp.411~433 (2004)
  38. Kuboni, O., "An assessment of support strategies used to facilitate distance students' participation in a web‐based learning environment in the University of the West Indies", Distance Education, 25(1), pp.7~29 (2004)
  39. Lamme, V. A., "Why visual attention and awareness are different", Trends in cognitive sciences, 7(1), pp.12~18 (2003)
  40. Lee, Y. T., "Rolling discussion technique for facilitating collaborative engineering design activities", International Journal of Engineering Education, 30(2), pp.449~457 (2014)
  41. Leony, D., "GLASS: A learning analytics visualization tool", Proceedings of the 2nd international conference on learning analytics and knowledge, pp.162~163 (2012), ACM
  42. Lipponen, L., "Effective participation and discourse through a computer network : Investigating elementary students’ computer supported interaction", Journal of Educational Computing Research, 27(4), pp.355~384 (2002)
  43. Lipponen, L., "Patterns of participation and discourse in elementary students’ computer-supported collaborative learning", Learning and Instruction, 13(5), pp.487~509 (2003)
  44. Lockyer, L., "Learning designs and learning analytics", Proceedings of the 1st international conference on learning analytics and knowledge (2011)
  45. McLinden, M., "Participation in online problem based learning : Insights from postgraduate teachers studying through open and distance education", Distance Education, 27(3), pp.331~353 (2006)
  46. Masters, K., "Encouraging equitable online participation through curriculum articulation", Computers & Education, 42(4), pp.319~332 (2004)
  47. Mazza, R., "MOCLog–Monitoring online courses with log data", Proceedings of the 1st Moodle Research Conference, pp.14~15 (2012)
  48. Morris, L. V., "Tracking student behavior, persistence, and achievement in online courses", The Internet and Higher Education, 8(3), pp.221~231 (2005)
  49. Park, Y., "Development of the learning analytics dashboard to support students' learning performance", Journal of Universal Computer Science, 21(1), pp.110~133 (2015)
  50. Pistilli, M. D., "In practice : Purdue signals : Mining real‐time academic data to enhance student success", About Campus, 15(3), pp.22~24 (2010)
  51. Poole, D. M., "Student participation in a discussion-oriented online course : A case study", Journal of Research on Computing in Education, 33(2), pp.162~167 (2000)
  52. Prinsen, F., "The influence of learner characteristics on degree and type of participation in a CSCL environment", British Journal of Educational Technology, 38(6), pp.1037~1055 (2007)
  53. Richey, R. C., "Design and development research: Methods, strategies, and issues" (2007), Routledge
  54. Ross, J. A., "The influence of computer communication skills on participation in a computer conferencing course", Journal of Educational Computing Research, 15(1), pp.37~52 (1996)
  55. Ross, J. A., "Differential participation of males and females in a computer-mediated communication course", Canadian Journal of University Continuing Education, 24(1), pp.83~100 (1998)
  56. Rubio, D. M., "Objectifying content validity : Conducting a content validity study in social work research", Social Work Research, 27(2), pp.94~104 (2003)
  57. Saltz, J. S., "Student social graphs: Visualizing a student's online social network", Proceedings of the 2004 ACM conference on Computer supported cooperative work (2004)
  58. Scheuer, O., "How did the e-learning session go? The student inspector", Frontiers in Artificial Intelligence and Applications, 158, pp.487~494 (2007)
  59. Scott, J., "Social network analysis" (1991), Sage
  60. Policy brief - Learning analytics, "Shum, S. B.", UNESCO Institute for Information Technologies in Education, ~ (2012)
  61. Sun, L., "Groupware: Design, implementation, and use", pp.349~363 (2006), Springer Berlin Heidelberg
  62. Van Harmelen, M., "Analytics for learning and teaching", CETIS Analytics Series, 1(3) (2012)
  63. Williams, S., "Student attitudes toward and participation in electronic discussion", International Journal of Educational Technology, 3(1) (2002)
  64. Wimmer, R., "Mass media research" (2013), Cengage learning
  65. Woods, R., "The effect of instructor’s use of audio e-mail messages on student participation in and perceptions of online learning: A preliminary case study", Open Learning, 16(3), pp.263~278 (2001)
  66. "What is a likert scale? and how do you pronounce ‘Likert?’" (2005)[URL]
  67. Zhang, H., "Moodog: Tracking students' Online Learning Activities", Proceedings of World Conference on Educational Media and Technology 2007, pp.4415~4422 (2007), Association for the Advancement of Computing in Education (AACE)

관련 논문AI추천

온라인 토론활동의 참여를 촉진하기 위한 대시보드 개발 및 적용유미나, 진성희한국교육정보미디어학회 · 교육정보미디어연구2018 · 제24권 제3호학습자 대시보드의 사용성 평가: 상호작용 정보의 시각화에 대한 학습자 인식 탐색김윤진, 김혜준, 임규연, 최지수한국교육정보미디어학회 · 교육정보미디어연구2020 · 제26권 제2호온라인 토론활동에 대한 학습분석기반 대시보드 사례 분석 연구유미나, 진성희한국교육정보미디어학회 · 교육정보미디어연구2017 · 제23권 제3호이러닝 학습환경에서 학습분석기반 대시보드 연구동향 분석유미나, 진성희한국교육정보미디어학회 · 교육정보미디어연구2015 · 제21권 제2호팀기반 온라인 토론의 내용분석을 지원하는 대시보드 개발 및 사용성 평가유미나, 진성희한국교육공학회 · 교육공학연구2018 · 제34권 제3호학습 분석학 기반 대시보드의 설계와 적용박연정, 조일현한국교육정보미디어학회 · 교육정보미디어연구2014 · 제20권 제2호

이 간행물의 다른 논문 (6건)

온라인 학습 환경에서 고성취 집단의 학습과정에서 나타난 상호작용 분석이은철pp. 159-190대학교육에서 학습분석 적용에 관한 탐색적 연구: 교수자의 관점을 중심으로최재원, 고욱, 신종호pp. 223-252창의인재 양성을 위한 학교경영자의 창의적 리더십 모형 및 교육 프로그램 개발장경원, 고수일, 장선영pp. 253-283교육공학에서의 테크놀로지: 의미 탐색과 연구 동향 분석김현진pp. 287-310학교교육에서의 교육공학 실천에 관한 연구동향: 1985년~2014년을 중심으로임정훈pp. 311-339
원문 보기