본문 바로가기
KERD
논문KCI 등재

학습분석 기반 온라인 토론활동의 시각화 원리 개발

Development of Visualization Principles for Online Discussion Activities based on Learning Analysis

2

조회

0

다운로드

11

인용

0

참고문헌

키워드

주제분류교육학

초록

본 연구는 학습분석 기반 온라인 토론활동의 시각화 원리를 개발하는 것을 목적으로 수행되었다. 연구 목적을 달성하기 위해 설계․개발 연구 방법을 적용하였으며, 온라인 토론활동의 시각화와 관련된 선행문헌을 고찰하여 시각화 원리들을 도출하였다. 개발된 시각화 원리의 초안에 대한 타당성을 검증하기 위해 관련 분야의 전문가 7인을 대상으로 3차에 걸쳐 타당화를 받았다. 연구결과 학습분석 기반의 온라인 토론활동의 시각화 대상은 1) 참여도, 2) 학습자 간 상호작용, 3) 토론내용-중심단어, 4) 토론내용-메시지유형, 5) 토론내용-찬반의견분포의 다섯 가지로 구성되며, 시각화 원리는 1) 추적성(traceability)의 원리, 2) 비교성(comparability)의 원리, 3) 축약성(implicity)의 원리, 4) 전체-세부성(overview+detail)의 원리의 네 가지로 구성된다. 이상의 연구결과에 기초하여 본 연구에서의 한계점을 논하였고, 추후 연구로 온라인 토론활동에 대한 학습분석을 하기 위한 모델 개발 연구, 학습자 특성을 고려한 시각적 표상물 설계 연구, 온라인 토론활동을 자동으로 분석하여 시각화해주는 시스템 설계 및 개발 연구를 제안하였다.

Abstract

The purpose of this study is to develop the visualization principles for online discussion activities based on learning analysis. The research question is “What are visualization targets?” and “What are the visualization principles and detailed visualization guidelines for online discussion activities based on learning analysis?”. In this study, the type Ⅱ research method of the design and development research was applied and the draft of the visualization principles based on the literature was derived. The visualization principles were validated three times by 7 experts. The results of this study were as follows. First, the visualization targets for online discussion activities were 1) participation, 2) interactions among learners, 3) discussion contents­key words, 4) discussion contents­message types, and 5) discussion contents­distribution of pros and cons. Second, the visualization principles for online discussion activities included 1) the principle of traceability, 2) the principle of comparability, 3) the principle of implicity, and 4) the principle of overview+detail. Some issues for future studies include the development of a learning analysis model to visualize online discussion activities, the study of visual representation development considering the characteristics of the learners, and designing a system that automatically analyzes and visualizes big data based on learning analytics.

참고문헌 (113)

  1. 권성연, "e-Learning 환경에서 성인학습자의 학습시간 계획 실천 수준에 따른 학습참여, 학습지연, 학습시간, 학업 성취 차이 분석", 학습자중심교과교육연구, 9(3), pp.61~86 (2009), 학습자중심교과교육학회
  2. 권숙진, "컴퓨터 기반 협력학습 환경에서 인식정보 제공을 위한 학습분석 기법 설계 연구", 예술인문사회 융합 멀티미디어 논문지, 5(5), pp.351~359 (2015), 사단법인 인문사회과학기술융합학회[DOI]
  3. "지능정보사회에 대응한 중장기 교육정책의 방향과 전략" (2016)[URL]
  4. 김태웅, "실시간 온라인 토론 수업에서 참여도와 만족도에 영향을 주는 변인 탐색", 교육방법연구, 20(2), pp.1~20 (2008), 한국교육방법학회
  5. 나리리, "웹 기반 토론 학습에서 시각적 피드백에 대한 학습자의 인식", 석사, pp.2015
  6. 나일주, "온라인 학습공동체의 학습게시판에 나타난 메시지 유형별 정서적 표현의 내용요인 분석", 평생학습사회, 1(1), pp.49~70 (2005), 원격교육연구소
  7. 박연정, "학습 분석학 기반 대시보드의 설계와 적용", 교육정보미디어연구, 20(2), pp.191~216 (2014), 한국교육정보미디어학회
  8. 박은실, "온라인 토론학습에서 사회연결망 중심도가 지식구성에 미치는 영향", 교육정보미디어연구, 17(3), pp.353~377 (2011), 한국교육정보미디어학회
  9. 성은모, "학습분석학 관점에서 학습자의 자기주도학습 지원을 위한 학습 데이터 탐색 연구", 교육공학연구, 32(3), pp.487~533 (2016), 한국교육공학회[DOI]
  10. 오병근, "사용자 경험중심의 정보디자인체계 연구", 박사, 디자인, pp.2007
  11. 오병근, "정보디자인 교과서" (2008), 안그라픽스
  12. 이지연, "대형 온라인 강좌에서의 학습자간 상호작용과 협력적 지식형성 분석", Andragogy Today: Interdisciplinary Journal of Adult & Continuing Education (IJACE), 14(2), pp.51~80 (2011), 한국성인교육학회
  13. 임규연, "온라인 토론학습에서 사회연결망분석 기반 피드백이 상호작용 및 성취도에 미치는 영향", 교육공학연구, 30(3), pp.443~466 (2014), 한국교육공학회
  14. 장은영, "비교 대상의 선택에서 환류유형, 비교속성 및 통제감의 효과", 한국심리학회지: 사회 및 성격, 13(2), pp.201~217 (1999)
  15. 정영숙, "웹 기반 강좌에서 학습자의 온라인 토론 참여도에 영향을 미치는 요인", 교육정보미디어연구, 12(4), pp.51~75 (2006), 한국교육정보미디어학회
  16. 조영환, "온라인 토론 촉진을 위한 피드백의 역할 탐색", 아시아교육연구, 16(2), pp.289~313 (2015), 교육연구소
  17. 조일현, "협동학습팀 내 사회연결망 지수가 학습 성과에 미치는 영향", 교육공학연구, 24(4), pp.295~317 (2008), 한국교육공학회
  18. 진성희, "구조 이해 및 내용 이해 증진을 위한 디지털텍스트의 시각적 변형 연구", 박사, 교육공학, pp.2009
  19. 진성희, "이러닝 학습참여활동 및 상호작용에 대한 대시보드 설계 연구", 교육공학연구, 31(2), pp.191~221 (2015), 한국교육공학회[DOI]
  20. Aguilar, D. A. G., "Semantic spiral timelines used as support for e-learning", Journal of Universal Computer Science, 15(7), pp.1526~1545 (2009)
  21. Ali, L., "A qualitative evaluation of evolution of a learning analytics tool", Computers and Education, 58(1), pp.470~489 (2012)
  22. "A quantitative evaluation of LOCO-Analyst: A tool for raising educators’ awareness in online learning environments" (2011)[URL]
  23. Bajzek, D., "Inventing the Digital Dashboard for Learning", Proceedings of World Conference on Educational Multimedia, Hypermedia and Telecommunications, pp.1084~1092 (2007)
  24. Bakharia, A., "A conceptual framework linking learning design with learning analytics", Proceedings of the Sixth International Conference on Learning Analytics and Knowledge, pp.329~338 (2016), ACM
  25. Bakharia, A., "SNAPP: A bird’s-eye view of temporal participant interaction", Proceedings of the First International Conference on Learning Analytics and Knowledge, pp.168~173 (2011), ACM
  26. Barlas, Y., "Model validation in system dynamics", Proceedings of the 1994 International System Dynamics Conference (1994)
  27. Barlas, Y., "Formal aspects of model validity and validation in system dynamics", System Dynamics Review, 12(3), pp.183~210 (1996)
  28. Beheshitha, S. S., "The role of achievement goal orientations when studying effect of learning analytics visualizations", Proceedings of the Sixth International Conference on Learning Analytics and Knowledge, pp.54~63 (2016), ACM
  29. "Using a search protocol to identify sources of information: the COSI model" (2004)[URL]
  30. Bueckle, M. G. N. S. A., "Empowering Instructors in Learning Management Systems: Interactive Heat Map Analytics Dashboard", Proceedings of the Seventh International Learning Analytics and Knowledge (2017)
  31. Buunk, B. P., "The affective consequences of social comparison: Either direction has its ups and downs", Journal of Personality and Social Psychology, 59(6), pp.1238~1249 (1990)
  32. Davis, L. L., "Instrument review: Getting the most from a panel of experts", Applied Nursing Research, 5(4), pp.194~197 (1992)
  33. Dawson, S, "SNAPP: Realising the affordances of real-time SNA within networked learning environments", Proceedings of the Seventh International Conference on Networked Learning 2010 (2010)
  34. De Liddo, A., "Discourse-centric learning analytics", Proceedings of the First International Conference on Learning Analytics and Knowledge (2011)
  35. Dennen, V. P., "Looking for evidence of learning: Assessment and analysis methods for online discourse", Computers in Human Behavior, 24(2), pp.205~219 (2008)
  36. Dollár, A., "Web-based statics course with learning dashboard for instructors", Proceedings of Computers and Advanced Technology in Education (2012)
  37. Donath, J., "The chat circles series: explorations in designing abstract graphical communication interfaces", Proceedings of the Fourth Conference on Designing Interactive Systems: Processes, Practices, Methods, and Techniques, pp.359~369 (2002), ACM
  38. Donath, J., "Visualizing conversation", Journal of Computer-Mediated Communication, 4(4) (1999)[DOI]
  39. Duval, E., "Attention please!: Learning analytics for visualization and recommendation", Proceedings of the First International Conference on Learning Analytics and Knowledge (2011)
  40. Dyckhoff, A. L., "Design and implementation of a learning analytics toolkit for teachers", Educational Technology and Society, 15(3), pp.58~76 (2012)
  41. El-Bishouty, M. M., "Social knowledge awareness map for computer supported ubiquitous learning environment", Educational Technology and Society, 13(4), pp.27~37 (2010)
  42. "Learning analytics: Definitions, processes and potential" (2011)[URL]
  43. "Social translucence: using minimalist visualisations of social activity to support collective interaction" (2003)[URL]
  44. Ericsson, K. A., "Expert performance: Its structure and acquisition", American Psychologist, 49(8), pp.725~474 (1994)
  45. Erkens, G., "Automatic coding of dialogue acts in collaboration protocols", International Journal of Computer-Supported Collaborative Learning, 3(4), pp.447~470 (2008)
  46. Ferguson, R., "Social learning analytics: Five approaches", Proceedings of the Second International Conference on Learning Analytics and Knowledge (2012)
  47. Festinger, L., "A theory of social comparison processes", Human relations, 7(2), pp.117~140 (1954)
  48. Few, S., "Show me the numbers: Designing tables and graphs to enlighten" (2004), Analytics Press
  49. Few, S., "Information dashboard design: The effective visual communication of data" (2006), O'Reilly Media, Inc
  50. Fidalgo-Blanco, Á., "Using Learning Analytics to improve teamwork assessment", Computers in Human Behavior, 47, pp.149~156 (2015)
  51. Fulantelli, G., "A semantic approach to mobile learning analytics", Proceedings of the First International Conference on Technological Ecosystem for Enhancing Multiculturality, pp.287~292 (2013), ACM
  52. Garrison, D. R., "Critical thinking and computer conferencing: A model and tool to assess cognitive presence", American Journal of Distance Education, 15(1), pp.7~23 (2001)
  53. Govaerts, S., "The student activity meter for awareness and self-reflection", Proceedings of the CHI'12 Extended Abstracts on Human Factors in Computing Systems, pp.869~884 (2012), ACM
  54. Greller, W., "Translating learning into numbers: A generic framework for learning analytics", Journal of Educational Technology and Society, 15(3), pp.42~57 (2012)
  55. Gunawardena, L., "Interaction analysis of a global on-line debate and the development of a constructivist interaction analysis model for computer conferencing", Journal of Educational Computing Research, 17(4), pp.395~429 (1997)
  56. Hara, N., "Content analysis of online discussion in an applied educational psychology course", Instructional Science, 28(2), pp.115~152 (2000)
  57. Harasim, L., "Computer networking, scholarly communication in the twenty-first century university" (1996), State University of New York Press
  58. Hart, C., "Doing a literature search: A guide for the social sciences" (2001), Sage Publications, Inc
  59. Henri, F., "Collaborative learning through computer conferencing", pp.117~136 (1992), Springer Berlin Heidelberg
  60. Hrastinski, S., "The potential of synchronous communication to enhance participation in online discussions: A case study of two e-learning courses", Information and Management, 45(7), pp.499~506 (2008)
  61. Iandoli, L., "A debate dashboard to enhance online knowledge sharing", VINE Journal of Information and Knowledge Management Systems, 42(1), pp.67~93 (2012)
  62. Janssen, J., "Visualization of participation: Does it contribute to successful computer-supported collaborative learning?", Computers and Education, 49(4), pp.1037~1065 (2007)
  63. Ji, M., "Open learning and teaching in educational communities", pp.440~445 (2014), Springer International Publishing
  64. Jovanović, J., "Using semantic web technologies to analyze learning content", Internet Computing, 11(5), pp.45~53 (2007)
  65. Kim, D., "Toward evidence-based learning analytics: Using proxy variables to improve asynchronous online discussion environments", The Internet and Higher Education, 30, pp.30~43 (2016)
  66. Kirschner, P. A., "Visualizing argumentation: Software tools for collaborative and educational sense-making" (2003), Springer
  67. Klee, P., "Pedagogical sketchbook" (1960), Praeger, Inc
  68. Klerkx, J., "Handbook of research on educational communications and technology", pp.791~807 (2014), Springer
  69. Kosslyn, S. M., "Understanding charts and graphs", Applied Cognitive Psychology, 3(3), pp.185~225 (1989)
  70. Lambropoulos, N., "Supporting social awareness in collaborative e‐learning", British Journal of Educational Technology, 43(2), pp.295~306 (2012)
  71. Levine, J. M., "Acquisition of relative performance information: The roles of intrapersonal and interpersonal comparison", Personality and Social Psychology Bulletin, 10(3), pp.385~393 (1984)
  72. Lockyer, L., "Learning designs and learning analytics", Proceedings of the First International Conference on Learning Analytics and Knowledge (2011)
  73. Lohr, L. L., "Creating graphics for learning and performance: Lessons in visual literacy" (2007), Prentice Hall Press
  74. Lynn, M. R., "Determination and quantification of content validity", Nursing Research, 35(6), pp.382~386 (1986)
  75. Malheiro, S., "Computers and education: Towards educational change and innovation", pp.33~43 (2008), Springer
  76. Marra, R. M., "Content analysis of online discussion forums: A comparative analysis of protocols", Educational Technology Research and Development, 52(2), pp.23~40 (2004)
  77. Mason, R. B., "Student engagement with, and participation in, an e-forum", Journal of Educational Technology and Society, 14(2), pp.258~268 (2011)
  78. Mazza, R., "Using information visualisation to facilitate instructors in web-based distance learning", doctor, pp.2004
  79. Mazza, R, "Exploring usage analysis in learning systems: Gaining insights from visualisations", Proceedings of the Twelfth International Conference on Artificial Intelligence in Education (2005)
  80. McMillan, J. H., "Research in education: Evidence-based inquiry" (2014), Pearson Higher Ed
  81. Mochizuki, T., "User-centered design of online learning communities", pp.365~397 (2007), Information Science Publishing
  82. Murray, T, "Supporting deeper deliberative dialogue through awareness tools", proceedings of Build Peace 2014 Conference (2014)
  83. Murray, T, "A dashboard for visualizing deliberative dialogue in online learning", Proceedings of Artificial Intelligence in Education 2013 (2013)
  84. Nakayama, M., "Visualization analysis of student’s notes taken in a fully online learning environment", Proceedings of Information Visualisation (IV), 2012 Sixteenth International Conference, pp.434~439 (2012), IEEE
  85. Nandi, D., "Evaluating the quality of interaction in asynchronous discussion forums in fully online courses", Distance Education, 33(1), pp.5~30 (2012)
  86. Preparing 21st century students for a global society: An educator’s guide to the 'four Cs', "National Education Association", National Education Association, ~ (2012)
  87. Newman, D. R., "A content analysis method to measure critical thinking in face-to-face and computer supported group learning", Interpersonal Computing and Technology, 3(2), pp.56~77 (1995)
  88. Pallotta, V., "Automatic argumentative analysis for interaction mining", Argument and Computation, 2(2-3), pp.77~106 (2011)
  89. Park, Y., "Using log variables in a learning management system to evaluate learning activity using the lens of activity theory", Assessment and Evaluation in Higher Education, 42(4), pp.531~547 (2017)
  90. Richardson, J. C., "Investigating students level of critical thinking across instructional strategies in online discussions", The Internet and Higher Education, 13(1), pp.52~59 (2010)
  91. Richey, R. C., "Design and development research: Methods, strategies, and issues" (2007), Routledge
  92. Rubio, D. M., "Objectifying content validity: Conducting a content validity study in social work research", Social Work Research, 27(2), pp.94~104 (2003)
  93. Santos, J. L., "Scaling up Learning for Sustained Impact", pp.314~327 (2013), Springer Berlin Heidelberg
  94. Santos, J. L., "Goal-oriented visualizations of activity tracking: A case study with engineering students", Proceedings of the Second International Conference on Learning Analytics and Knowledge, pp.143~152 (2012), ACM
  95. Scott, J., "A matter of record: Documentary sources in social research" (1990), Polity Press
  96. Shirvani Boroujeni, M., "Dynamics of MOOC Discussion Forums", Proceedings of the Seventh International Learning Analytics and Knowledge (2017)
  97. "What are learning analytics" (2010)[URL]
  98. Siemens, G, "Learning analytics and educational data mining: towards communication and collaboration", Proceedings of the Second International Conference on Learning Analytics and Knowledge (2012)
  99. Siemens, G., "Open learning analytics: An integrated and modularized platform" (2011), Open University Press
  100. Simsek, D., "Learning analytics beyond learning management systems: Proposing a learner dashboard which collects, analyzes and reports learner-generated data from social networking sites", master, pp.2012
  101. Smith, V. C., "Predictive modeling to forecast student outcomes and drive effective interventions in online community college courses", Journal of Asynchronous Learning Networks, 16(3), pp.51~61 (2012)
  102. Sun, L., "Social visualization encouraging participation in online communities", Proceedings of International Conference on Collaboration and Technology, pp.349~363 (2006), Springer Berlin Heidelberg
  103. Suthers, D., "Learning analytics as a middle space", Proceedings of the Third International Conference on Learning Analytics and Knowledge, pp.1~4 (2013), ACM
  104. "Visual analysis best practices: Simple techniques for making every data visualization useful and beautiful whitepaper" (2014)[URL]
  105. Teplovs, C, "The Knowledge Space Visualizer: A tool for visualizing online discourse", Proceedings of the International Conference of the Learning Sciences, pp.1~12 (2008)
  106. Viégas, F. B., "Chat circles", Proceedings of the SIGCHI conference on Human Factors in Computing Systems, pp.9~16 (1999), ACM
  107. Wang, Y., "Big data analytics: Understanding its capabilities and potential benefits for healthcare organizations", Technological Forecasting and Social Change, 126, pp.3~13 (2018)
  108. Wills, T. A., "Downward comparison principles in social psychology", Psychological Bulletin, 90(2), pp.245~271 (1981)
  109. Wise, A. F., "Learning analytics for online discussions: a pedagogical model for intervention with embedded and extracted analytics", Proceedings of the Third International Conference on Learning Analytics and Knowledge, pp.48~56 (2013), ACM
  110. Yau, N., "Visualize this: The flowing data guide to design, visualization, and statistics" (2011), John Wiley & Sons
  111. Yau, N., "Data points: Visualization that means something" (2013), John Wiley & Sons
  112. Yi, J. S., "Toward a deeper understanding of the role of interaction in information visualization", Visualization and Computer Graphics, 13(6), pp.1224~1231 (2007)
  113. Yu, T., "Educational technology approach toward learning analytics: Relationship between student online behavior and learning performance in higher education", Proceedings of the Fourth International Conference on Learning Analytics and Knowledge, pp.269~270 (2014), ACM

이 간행물의 다른 논문 (6건)