Evaluation of usefulness of smart device-based testing: a survey study of Korean medical students
2
조회
0
다운로드
0
인용
0
참고문헌
키워드
초록
Purpose: This study aims to understand the characteristics of smart device-based testing (SBT) by comparing the typical characteristics of students’ satisfaction with SBT, its usefulness, advantages, and disadvantages when compared with existing testing methods. Methods: A total of 250 students from the first to third year were selected as the final targets of the study and the questionnaire was developed by faculty members who participated in the survey from the start of the SBT. The total number of questions is 12, and the questionnaire used a 4-point scale. The data obtained were analyzed using the IBM SPSS ver. 23.0 (IBM Corp., Armonk, USA). Results: Answers to the “satisfaction with SBT” were generally negative, while answers to the “usefulness of SBT” were generally positive. There was no difference in satisfaction across gender and smart device ownership, whereas there were significant differences across years. With reference to the usefulness of SBT, students responded positively, while about the overall configuration and completeness of SBT, students responded negatively. Students also seemed to show a greater preference toward the pencil-paper test. Conclusion: On the other hand, students generally thought that SBT helped to assess medical knowledge better and was a more objective method of knowledge assessment than a pencil-paper test. We believe that students preferred the traditional paper-pencil test due to their unfamiliarity with SBT. We believe that an appropriate and careful remedy for drawbacks of the SBT will have a significant impact in the accumulation of actual clinical knowledge and in the improvement of practical skills for medical students.
Abstract
Purpose: This study aims to understand the characteristics of smart device-based testing (SBT) by comparing the typical characteristics of students’ satisfaction with SBT, its usefulness, advantages, and disadvantages when compared with existing testing methods. Methods: A total of 250 students from the first to third year were selected as the final targets of the study and the questionnaire was developed by faculty members who participated in the survey from the start of the SBT. The total number of questions is 12, and the questionnaire used a 4-point scale. The data obtained were analyzed using the IBM SPSS ver. 23.0 (IBM Corp., Armonk, USA). Results: Answers to the “satisfaction with SBT” were generally negative, while answers to the “usefulness of SBT” were generally positive. There was no difference in satisfaction across gender and smart device ownership, whereas there were significant differences across years. With reference to the usefulness of SBT, students responded positively, while about the overall configuration and completeness of SBT, students responded negatively. Students also seemed to show a greater preference toward the pencil-paper test. Conclusion: On the other hand, students generally thought that SBT helped to assess medical knowledge better and was a more objective method of knowledge assessment than a pencil-paper test. We believe that students preferred the traditional paper-pencil test due to their unfamiliarity with SBT. We believe that an appropriate and careful remedy for drawbacks of the SBT will have a significant impact in the accumulation of actual clinical knowledge and in the improvement of practical skills for medical students.
참고문헌 (16)
- 허선, "의사국가시험을 컴퓨터시험으로 치를 수 있을까?", 대한의사협회지, 55(2), pp.124~130 (2012), 대한의사협회
- Kim CH, "Presidential address: introduction of smart device-based testing and item exposure policy for Korea Health Personnel Licensing Examination", J Educ Eval Health Prof, 14, pp.5~ (2017)
- Roh H, "Ubiquitous-based testing in medical education", Med Teach, 37(3), pp.302~303 (2015)
- 채유미, "The relationship between classical item characteristics and item response time on computer-based testing", Korean Journal of Medical Education, 31(1), pp.1~9 (2019), 한국의학교육학회
- 박주현, "의학교육에서 e-러닝의 활용 및 효과성에 대한 고찰", Korean Journal of Medical Education, 22(2), pp.91~100 (2010), 한국의학교육학회
- 박주현, "의과대학에서 학습관리시스템과 컴퓨터 기반 평가시스템의 구축 및 운영 경험", Korean Journal of Medical Education, 24(3), pp.213~222 (2012), 한국의학교육학회[DOI]
- Patel S, "The value of mobile tablet computers(iPads)in the undergraduate medical curriculum", Adv Med Educ Pract, 9, pp.567~570 (2018)
- Calimag JN, "Ubquitous learning environment using android mobile application", Int J Res Eng Technol, 2(2), pp.119~128 (2014)
- Oluwatosin OT, "Computer-based test : security and result integrity", Int J Comput Inf Technol, 2(2), pp.324~329 (2013)
- Shanmugapriya M, "Developing a mobile adaptive test(MAT)in an m-learning environment for Android based 3G mobile devices", Int J Comput Sci Eng, 4(2), pp.153~161 (2012)
- 권오영, "의학교육 평가도구로서의 유비쿼터스바탕검사의 유용성", Korean Journal of Medical Education, 27(1), pp.3~10 (2015), 한국의학교육학회[DOI]
- 김경지, "Ubiquitous testing using tablets: its impact on medical student perceptions of and engagement in learning", Korean Journal of Medical Education, 28(1), pp.56~66 (2016), 한국의학교육학회
- Lim EY, "Smart device-based testing for medical students in Korea : satisfaction, convenience, and advantages", J Educ Eval Health Prof, 14, pp.7~ (2017)
- Lazarus L, "Tablet technology in medical education in South Africa : a mixed methods study", BMJ Open, 7(7), pp.e013871~ (2017)
- Witt RE, "The role of tablets in accessing information throughout undergraduate medical education in Botswana", Int J Med Inform, 88, pp.71~77 (2016)
- Baumgart DC, "Tablet computer enhanced training improves internal medicine exam performance", PLoS One, 12(4), pp.e0172827~ (2017)