Assessing clinical reasoning abilities of medical students using clinical performance examination
2
조회
0
다운로드
4
인용
0
참고문헌
키워드
초록
Purpose: The purpose of this study is to investigate the reliability and validity of new clinical performance examination (CPX) for assessing clinical reasoning skills and evaluating clinical reasoning ability of the students. Methods: Third-year medical school students (n=313) in Busan-Gyeongnam consortium in 2014 were included in the study. One of 12 stations was developed to assess clinical reasoning abilities. The scenario and checklists of the station were revised by six experts. Chief complaint of the case was rhinorrhea, accompanied by fever, headache, and vomiting. Checklists focused on identifying of the main problem and systematic approach to the problem. Students interviewed the patient and recorded subjective and objective findings, assessments, plans (SOAP) note for 15 minutes. Two professors assessed students simultaneously. We performed statistical analysis on their scores and survey. Results: The Cronbach α of subject station was 0.878 and Cohen κ coefficient between graders was 0.785. Students agreed on CPX as an adequate tool to evaluate students’ performance, but some graders argued that the CPX failed to secure its validity due to their lack of understanding the case. One hundred eight students (34.5%) identified essential problem early and only 58 (18.5%) performed systematic history taking and physical examination. One hundred seventy-three of them (55.3%) communicated correct diagnosis with the patient. Most of them had trouble in writing SOAP notes. Conclusion: To gain reliability and validity, interrater agreement should be secured. Students' clinical reasoning skills were not enough. Students need to be trained on problem identification, reasoning skills and accurate record-keeping.
Abstract
Purpose: The purpose of this study is to investigate the reliability and validity of new clinical performance examination (CPX) for assessing clinical reasoning skills and evaluating clinical reasoning ability of the students. Methods: Third-year medical school students (n=313) in Busan-Gyeongnam consortium in 2014 were included in the study. One of 12 stations was developed to assess clinical reasoning abilities. The scenario and checklists of the station were revised by six experts. Chief complaint of the case was rhinorrhea, accompanied by fever, headache, and vomiting. Checklists focused on identifying of the main problem and systematic approach to the problem. Students interviewed the patient and recorded subjective and objective findings, assessments, plans (SOAP) note for 15 minutes. Two professors assessed students simultaneously. We performed statistical analysis on their scores and survey. Results: The Cronbach α of subject station was 0.878 and Cohen κ coefficient between graders was 0.785. Students agreed on CPX as an adequate tool to evaluate students’ performance, but some graders argued that the CPX failed to secure its validity due to their lack of understanding the case. One hundred eight students (34.5%) identified essential problem early and only 58 (18.5%) performed systematic history taking and physical examination. One hundred seventy-three of them (55.3%) communicated correct diagnosis with the patient. Most of them had trouble in writing SOAP notes. Conclusion: To gain reliability and validity, interrater agreement should be secured. Students' clinical reasoning skills were not enough. Students need to be trained on problem identification, reasoning skills and accurate record-keeping.
참고문헌 (21)
- Hrynchak P, "Key-feature questions for assessment of clinical reasoning: a literature review", Med Educ, 48, pp.870~883 (2014)
- Groves M, "Clinical reasoning: the relative contribution of identification, interpretation and hypothesis errors to misdiagnosis", Med Teach, 25, pp.621~625 (2003)
- Mauksch LB, "Relationship, communication, and efficiency in the medical encounter: creating a clinical model from a literature review", Arch Intern Med, 168, pp.1387~1395 (2008)
- Beasley JW, "How many problems do family physicians manage at each encounter? A WReN study", Ann Fam Med, 2, pp.405~410 (2004)
- Baker LH, ""What else?" Setting the agenda for the clinical interview", Ann Intern Med, 143, pp.766~770 (2005)
- Beckman HB, "The effect of physician behavior on the collection of data", Ann Intern Med, 101, pp.692~696 (1984)
- Mandin H, "Helping students learn to think like experts when solving clinical problems", Acad Med, 72, pp.173~179 (1997)
- Harasym PH, "Current trends in developing medical students' critical thinking abilities", Kaohsiung J Med Sci, 24, pp.341~355 (2008)
- 박훈기, "의사국가시험에서 실기시험의 도입이 의학교육에 미친 영향", 대한의사협회지, 55(2), pp.116~123 (2012), 대한의사협회
- 김종훈, "의사면허 실기시험 제도의 성과와 과제", 의학교육논단, 15(3), pp.136~143 (2013), 연세대학교 의과대학
- Coulehan JL, "The medical interview: mastering skills for clinical practice", pp.45~139 (2006), F.A. Davis
- Brannick MT, "A systematic review of the reliability of objective structured clinical examination scores", Med Educ, 45, pp.1181~1189 (2011)
- Pell G, "International Association for Medical Education. How to measure the quality of the OSCE: a review of metrics – AMEE guide no. 49", Med Teach, 32, pp.802~811 (2010)
- 노혜린, "Medical students’ agenda-setting abilities during medical interviews", Korean Journal of Medical Education, 27(2), pp.77~86 (2015), 한국의학교육학회[DOI]
- Mavis BE, "Documenting clinical performance problems among medical students: feedback for learner remediation and curriculum enhancement", Med Educ Online, 18, pp.20598~ (2013)
- Woloschuk W, "Use of scheme-based problem solving: an evaluation of the implementation and utilization of schemes in a clinical presentation curriculum", Med Educ, 34, pp.437~442 (2000)
- Blissett S, "Should we teach using schemas? Evidence from a randomised trial", Med Educ, 46, pp.815~822 (2012)
- Hauer KE, "Student performance problems in medical school clinical skills assessments", Acad Med, 82(10Suppl), pp.S69~S72 (2007)
- Yudkowsky R, "A hypothesis-driven physical examination learning and assessment procedure for medical students : initial validity evidence", Med Educ, 43, pp.729~740 (2009)
- Wilkerson L, "Assessing physical examination skills of senior medical students: knowing how versus knowing when", Acad Med, 78, pp.S30~S32 (2003)
- Maguire P, "Consultation skills of young doctors: II--Most young doctors are bad at giving information", Br Med J, 292, pp.1576~1578 (1986)