초‧중학생 대상 웹기반 진단평가관리시스템 사용성 개선을 위한 휴리스틱스 개발 연구
A study on the development of heuristics for usability improvements on web-based diagnostic assessment management system for primary-middle schoolers
0
조회
0
다운로드
10
인용
0
참고문헌
키워드
초록
4차 산업혁명 시대를 맞이하여 증거기반의 교육정책을 위해, 전국단위의 진단평가 데이터를 수집하기 위한 시스템을 구축·활용하고 있다. 본 연구는 이러한 전국 단위 초·중생이 활용하고 있는 진단평가관리시스템의 사용성 개선을 도울 수 있는 휴리스틱스 개발을 목적으로 하였다. 이를 위해 Nielsen의 기본 휴리스틱스를 비롯하여 교육적 목적에 종속적으로 개발된 휴리스틱스에 대한 선행연구를 기반으로 유사시스템인 진단·보정학습시스템의 사용성 문제를 분석함으로써 휴리스틱스 초안을 개발하였다. 이는 델파이 방법을 통해 15명의 전문가에 의해 2회의 타당화 과정을 수행함으로써 수정·보완되었고 최종안이 도출되었다. 본 연구는 교육 맥락에서 사용성 평가 도구를 제공함으로써 전국단위의 관계자(교사 등)와 학생들이 활용하는 시스템의 사용성 개선을 위한 기반을 마련하였다는데 의의가 있다.
Abstract
Preparing the 4th industrial revolution age, a diagnostic assessment management system which can collect nationwide data has been implemented and utilized for the development of the evidence-based educational policy. This study aims to develop heuristics to help to improve usability of such systems, which are utilized by primary and middle school community including teachers and students in the nationwide. To achieve the objective, previous studies related to the development of heuristics in the educational contexts as well as basic heuristics from Nielsen were reviewed, and usability problems of the web-based diagnostic-supplement system being currently utilized, as a sample system, were analyzed. Then, the first version of heuristics was developed. The deveoped heuristics were validated and revised through 2 rounds of the delphi methods with 15 experts. This study has an implication with preparing foundations on improving usability of such diagnostic assessment management system utilized by school community at the nationwide in educational contexts.
참고문헌 (34)
- NMC Horizon Report: 2017 Higher Education Edition, "Adams Becker, S.", The New Media Consortium, ~ (2017)
- Research paper of Web accessibility, "Ahn, M.L", ~ (2009)
- Albion, P. R., "Heuristic evaluation of educational multimedia: From theory to practice", 16th Annual Conference of the Australasian Society for Computers in Learning in Tertiary Education, ASCILITE, pp.9~15 (1999)
- Alsumait, A. a., "Usability heuristics evaluation for child e-learning applications", Journal of Software, 5(6) (2010)
- Baker, K., "Empirical Development of a Heuristic Evaluation Methodology for Shared Workspace Groupware", CSCW’02 (2002)
- Blecken, A., "Usability Evaluation of a Learning Management System", Proceedings of the 43rd Hawaii International Conference on System Science (2010)
- Bonham, S. W., "Education Research using Web-based Assessment Systems", Journal of Research on Computing in Education (2000)
- Cha, H. J., "Cyber Home Learning system diagnosis-prescription system usability evaluation and improvements on learning experience", HCI Conference 2009, pp.876~883 (2009)
- "Teaching every student in the digital age:Universal Design for Learning"[URL]
- Ericsson, K. A., "Expert performance:Its structure and acquisition", American psychologist, 49(8), pp.725~747 (1994)
- Fluck, A., "Case study of a computer based examination system", Australasian Journal of Educational Technology, 25(4), pp.509~523 (2009)
- Grant, J. S., "Selection and use of content experts for instrument development", Research in Nursing & Health, 20(3), pp.269~274 (1997)
- 전수진, "웹 기반 기초학력 진단-보정 시스템의 개선 방안 도출", 정보교육학회논문지, 20(5), pp.487~498 (2016), 한국정보교육학회
- Jeong, Y. S., "Digital textbook usability principle development", Journal of Computer Science Education, 11(30), pp.13~20 (2008)
- The educational use of IT-Convergent technology in 4th industrial revolution era, "Korea Education & Research Information Service", KERIS, ~, pp.Research Report RR 2016-7 (2017)
- Whitepaper 2016, "Korea Education & Research Information Service", ~ (2016)
- Development of Agendas by using educational big data: Focused on analysis of SNS, "Kwon, K. S.", KERIS, ~, pp.Research report KR 2014-10 (2014)
- Lim, C.L,, "A study on the developing and applying digital textbook platform usability evaluation tools", Educational Technology Research, 25(4), pp.125~155 (2009)
- Mtebe, J. S., "Heuristics for Evaluating Usability of Learning Management Systems in Africa", IST-Africa Conference 2015, pp.1~13 (2015), IEEE
- Heuristics for Evaluating usability of learning management systems in Africa, "Mtebe, J. S.", IIMC International Information Management Corporation, ~ (2015)
- Nielsen, J., "Usability Engineering" (1993), Academic Press Limited
- "10 Usability Heuristics for User Interface Design" (1995)[URL]
- Nokelainen, P., "An empirical assessment of pedagogical usability criteria for digital learning material with elementary school students", Educational Technology & Society, 9(2), pp.178~197 (2006)
- A study on analysis of online basic academic skills improvement system status and development of policy plans, "Park, C. H.", KERIS, ~, pp.Research report KR 2014-6 (2014)
- "P21(Paternership for 21st century learning), Framework for 21st century learning" (2017)[URL]
- Preece, J., "Interaction Design: beyound human-computer interaction" (2015), John Wiley & Sons Ltd
- Seo, Y. S., "Development of usability evaluation tools for web-based learning site", PhD, pp.2007
- Silius, K., "The Usefulness of Web-based Learning Environments. The Evaluation tool into the Portal of Finnish Virtual University", International Conference on Network Universities and E-Learning. Proceedings of mENU (2003)
- Sim, G., "Using computer-assisted assessment heuristics for usability evaluations", British journal of educational technology, 47(4) (2015)
- Sim, G., "Evidence based Design of Heuristics for Computer Assisted Assessment", IFIP Conference on Human-Computer Interaction, pp.204~216 (2009)
- 송해덕, "어포던스 관점에서 디지털 교과서 사용편의성에 영향을 미치는 요인분석 연구", 교육공학연구, 25(3), pp.135~155 (2009), 한국교육공학회
- Squires, D., "Predicting quality in educational software: Evaluating for learning, usability and the synergy between them", Interacting with Computers, 11, pp.467~483 (1999)
- "Web Content Accessibility Guidelines, 2017(WCAG) 2.0"[URL]
- Zhenming, Y., "A Novel Web-based Online Examinations System for Computer Science Education", 33rd ASEE, 2003, ~