The efficacy of peer assessment in objective structured clinical examinations for formative feedback: a preliminary study
1
조회
0
다운로드
2
인용
0
참고문헌
키워드
초록
Purpose: We sought to determine the impact of medical students’ prior experience of assessing peers in the objective structured clinical examination (OSCE) on their clinical performance. Methods: Forty-two year 4 medical students participated in an OSCE comprised of three 10-minute stations (syncope, hemoptysis, and back pain). Each student took part in two iterations of the three‐station OSCE as either the examiner or examinee, and student performance was assessed using a checklist by a medical faculty member and a student simultaneously. Students were randomly assigned to two groups and their OSCE scores were compared. Students in the control group were tested at a station first and then participated at the same station as a peer examiner, and those in the intervention group participated as a peer examiner first and then as an examinee. Moreover, student OSCE scores rated by peer examiners were compared with those awarded by faculty to evaluate the accuracy of peer assessment. Following the test, students completed surveys on their perceptions of the usefulness of this formative OSCE. Results: Student overall OSCE scores did not differ between groups. Students in the study group performed better at the hemoptysis station (p<0.001), but poorer at the syncope station (p<0.01). Student performances at the back-pain station were similar in these two groups (p=0.48). OSCE scores rated by faculty and peer examiners were moderately negatively associated at the hemoptysis station (p<0.05), but no such association was observed at the other two stations. This trend was similar in peer examiners who were high-achievers and low-achievers in OSCEs. Students showed positive perceptions of their experience with this OSCE. Conclusion: Student experience as peer assessor offers a feasible means of providing them greater access to OSCEs without consuming more resources, although its impact on enhancing performance in the OSCE is likely to differ across stations.
Abstract
Purpose: We sought to determine the impact of medical students’ prior experience of assessing peers in the objective structured clinical examination (OSCE) on their clinical performance. Methods: Forty-two year 4 medical students participated in an OSCE comprised of three 10-minute stations (syncope, hemoptysis, and back pain). Each student took part in two iterations of the three‐station OSCE as either the examiner or examinee, and student performance was assessed using a checklist by a medical faculty member and a student simultaneously. Students were randomly assigned to two groups and their OSCE scores were compared. Students in the control group were tested at a station first and then participated at the same station as a peer examiner, and those in the intervention group participated as a peer examiner first and then as an examinee. Moreover, student OSCE scores rated by peer examiners were compared with those awarded by faculty to evaluate the accuracy of peer assessment. Following the test, students completed surveys on their perceptions of the usefulness of this formative OSCE. Results: Student overall OSCE scores did not differ between groups. Students in the study group performed better at the hemoptysis station (p<0.001), but poorer at the syncope station (p<0.01). Student performances at the back-pain station were similar in these two groups (p=0.48). OSCE scores rated by faculty and peer examiners were moderately negatively associated at the hemoptysis station (p<0.05), but no such association was observed at the other two stations. This trend was similar in peer examiners who were high-achievers and low-achievers in OSCEs. Students showed positive perceptions of their experience with this OSCE. Conclusion: Student experience as peer assessor offers a feasible means of providing them greater access to OSCEs without consuming more resources, although its impact on enhancing performance in the OSCE is likely to differ across stations.
참고문헌 (17)
- Khan KZ, "The objective structured clinical examination (OSCE): AMEE guide no. 81. Part I: an historical and theoretical perspective", Med Teach, 35(9), pp.e1437~e1446 (2013)
- Patrício MF, "Is the OSCE a feasible tool to assess competencies in undergraduate medical education", Med Teach, 35(6), pp.503~514 (2013)
- Brannick MT, "A systematic review of the reliability of objective structured clinical examination scores", Med Educ, 45(12), pp.1181~1189 (2011)
- Khan R, "Peer assessment in the objective structured clinical examination : a scoping review", Med Teach, 39(7), pp.745~756 (2017)
- Bernard AW, "Medical students review of formative OSCE scores, checklists, and videos improves with student-faculty debriefing meetings", Med Educ Online, 22(1), pp.1324718~ (2017)
- Daniels VJ, "Impact of tabletscoring and immediate score sheet review on validity and educational impact in an internal medicine residency objective structured clinical exam(OSCE)", Med Teach, 41(9), pp.1039~1044 (2019)
- Chisnall B, "Evaluation of outcomes of a formative objective structured clinical examination for second-year UK medical students", Int J Med Educ, 6, pp.76~83 (2015)
- Young I, "The benefits of a peer-assisted mock OSCE", Clin Teach, 11(3), pp.214~218 (2014)
- 채수진, "Can disclosure of scoring rubric for basic clinical skills improve objective structured clinical examination?", Korean Journal of Medical Education, 28(2), pp.179~183 (2016), 한국의학교육학회
- Madrazo L, "Selfassessment differences between genders in a low-stakes objective structured clinical examination(OSCE)", BMC Res Notes, 11(1), pp.393~ (2018)
- Blanch-Hartigan D, "Medical students’ self-assessment of performance : results from three meta-analyses", Patient Educ Couns, 84(1), pp.3~9 (2011)
- Fitzgerald JT, "A longitudinal study of self-assessment accuracy", Med Educ, 37(7), pp.645~649 (2003)
- Burgess A, "Senior medical students as peer examiners in an OSCE", Med Teach, 35(1), pp.58~62 (2013)
- Chenot JF, "Can student tutors act as examiners in an objective structured clinical examination", Med Educ, 41(11), pp.1032~1038 (2007)
- Lee CB, "A student-initiated objective structured clinical examination as a sustainable cost-effective learning experience", Med Educ Online, 23(1), pp.1440111~ (2018)
- Basehore PM, "Reliability and benefits of medical student peers in rating complex clinical skills", Med Teach, 36(5), pp.409~414 (2014)
- Moineau G, "Comparison of student examiner to faculty examiner scoring and feedback in an OSCE", Med Educ, 45(2), pp.183~191 (2011)