Ubiquitous testing using tablets: its impact on medical student perceptions of and engagement in learning
2
조회
0
다운로드
1
인용
0
참고문헌
키워드
초록
Purpose: Ubiquitous testing has the potential to affect medical education by enhancing the authenticity of the assessment using multimedia items. This study explored medical students’ experience with ubiquitous testing and its impact on student learning. Methods: A cohort (n=48) of third-year students at a medical school in South Korea participated in this study. The students were divided into two groups and were given different versions of 10 content-matched items: one in text version (the text group) and the other in multimedia version (the multimedia group). Multimedia items were delivered using tablets. Item response analyses were performed to compare item characteristics between the two versions. Additionally, focus group interviews were held to investigate the students’ experiences of ubiquitous testing. Results: The mean test score was significantly higher in the text group. Item difficulty and discrimination did not differ between text and multimedia items. The participants generally showed positive responses on ubiquitous testing. Still, they felt that the lectures that they had taken in preclinical years did not prepare them enough for this type of assessment and clinical encounters during clerkships were more helpful. To be better prepared, the participants felt that they needed to engage more actively in learning in clinical clerkships and have more access to multimedia learning resources. Conclusion: Ubiquitous testing can positively affect student learning by reinforcing the importance of being able to understand and apply knowledge in clinical contexts, which drives students to engage more actively in learning in clinical settings.
Abstract
Purpose: Ubiquitous testing has the potential to affect medical education by enhancing the authenticity of the assessment using multimedia items. This study explored medical students’ experience with ubiquitous testing and its impact on student learning. Methods: A cohort (n=48) of third-year students at a medical school in South Korea participated in this study. The students were divided into two groups and were given different versions of 10 content-matched items: one in text version (the text group) and the other in multimedia version (the multimedia group). Multimedia items were delivered using tablets. Item response analyses were performed to compare item characteristics between the two versions. Additionally, focus group interviews were held to investigate the students’ experiences of ubiquitous testing. Results: The mean test score was significantly higher in the text group. Item difficulty and discrimination did not differ between text and multimedia items. The participants generally showed positive responses on ubiquitous testing. Still, they felt that the lectures that they had taken in preclinical years did not prepare them enough for this type of assessment and clinical encounters during clerkships were more helpful. To be better prepared, the participants felt that they needed to engage more actively in learning in clinical clerkships and have more access to multimedia learning resources. Conclusion: Ubiquitous testing can positively affect student learning by reinforcing the importance of being able to understand and apply knowledge in clinical contexts, which drives students to engage more actively in learning in clinical settings.
참고문헌 (12)
- Peterson MW, "Computerbased testing: initial report of extensive use in a medical school curriculum", Teach Learn Med, 16, pp.51~59 (2004)
- Shen L, "The promise and challenge of including multimedia items in medical licensure examinations: some insights from an empirical trial", Acad Med, 85(10 Suppl), pp.S56~S59 (2010)
- Holtzman KZ, "Use of multimedia on the step 1 and step 2 clinical knowledge components of USMLE: a controlled trial of the impact on item characteristics", Acad Med, 84(10Suppl), pp.S90~S93 (2009)
- Roh H, "Ubiquitous-based testing in medical education", Med Teach, 37, pp.302~303 (2015)
- Wood T, "Assessment not only drives learning, it may also help learning", Med Educ, 43, pp.5~6 (2009)
- Larsen DP, "Test-enhanced learning in medical education", Med Educ, 42, pp.959~966 (2008)
- 허선, "의사국가시험을 컴퓨터시험으로 치를 수 있을까?", 대한의사협회지, 55(2), pp.124~130 (2012), 대한의사협회
- Downing SM, "Validity: on meaningful interpretation of assessment data", Med Educ, 37, pp.830~837 (2003)
- Stalmeijer RE, "Using focus groups in medical education research: AMEE Guide No. 91", Med Teach, 36, pp.923~939 (2014)
- Barbour RS, "Making sense of focus groups", Med Educ, 39, pp.742~750 (2005)
- Pekrun R, "The control-value theory of achievement emotions: assumptions, corollaries, and implications for educational research and practice", Educ Psychol Rev, 18, pp.315~341 (2006)
- Miller GE, "The assessment of clinical skills", competence, Acad Med, pp.1990, 65(9Suppl)[DOI]