의료윤리 능력 평가로서의 객관구조화 구술시험 개발 경험
Experience of Implementation of Objective Structured Oral Examination for Ethical Competence Assessment
0
조회
0
다운로드
4
인용
0
참고문헌
키워드
초록
Purpose: We developed an objective structured oral examination (OSOE) case to assess the medical ethics of students. The aim of this study was to assess the reliability of OSOE with generalizability theory. Methods: One 10-minute OSOE that contained key questions was developed. The evaluation sheet consisted of 4 domains: moral sensitivity, moral reasoning, decision making, and attitude. The total number of items was 13. The numbers of checklist items and global rating items were 11 and 2, respectively. Items and key questions were validated by 6 professionals. Standardization of the raters and the pilot study was performed before the OSOE. Fifty-four third-year medical students participated in the OSOE. The OSOE was duplicated, and 2 professors assessed 1 student independently. Each station lasted 8 minutes and was followed by a 2-minute interval,during which raters completed the checklist forms. We analyzed the reliability of the OSOE with the GENOVA program. Results: The reliability (generalizability coefficient) was 0.945, and the interrater agreement was 0.867. The type of item, checklist or global rating, was the largest variance component. The reliability of the checklist alone was 0.668 and that of the global rating alone was 0.363. Conclusion: The OSOE is reliable and can be used to assess ethics. More research should focus on achieving validity.
Abstract
Purpose: We developed an objective structured oral examination (OSOE) case to assess the medical ethics of students. The aim of this study was to assess the reliability of OSOE with generalizability theory. Methods: One 10-minute OSOE that contained key questions was developed. The evaluation sheet consisted of 4 domains: moral sensitivity, moral reasoning, decision making, and attitude. The total number of items was 13. The numbers of checklist items and global rating items were 11 and 2, respectively. Items and key questions were validated by 6 professionals. Standardization of the raters and the pilot study was performed before the OSOE. Fifty-four third-year medical students participated in the OSOE. The OSOE was duplicated, and 2 professors assessed 1 student independently. Each station lasted 8 minutes and was followed by a 2-minute interval,during which raters completed the checklist forms. We analyzed the reliability of the OSOE with the GENOVA program. Results: The reliability (generalizability coefficient) was 0.945, and the interrater agreement was 0.867. The type of item, checklist or global rating, was the largest variance component. The reliability of the checklist alone was 0.668 and that of the global rating alone was 0.363. Conclusion: The OSOE is reliable and can be used to assess ethics. More research should focus on achieving validity.
참고문헌 (36)
- Self DJ, "Evaluation of teaching medical ethics by an assessment of moral reasoning", Med Educ, 26, pp.178~184 (1992)
- 김익중, "DIT검사로 평가한 의료윤리 교육의 효과-D대학 의과대학생을 중심으로", 한국의료윤리학회지, 8(2), pp.95~104 (2005), 한국의료윤리학회
- Siegler M, "Using simulated case studies to evaluate a clinical ethics course for junior students", J Med Educ, 57, pp.380~385 (1982)
- Levitt C, "Developing an ethics curriculum for a family practice residency", Acad Med, 69, pp.907~914 (1994)
- Sulmasy DP, "Knowledge, confidence, and attitudes regarding medical ethics: how do faculty and housestaff compare?", Acad Med, 70, pp.1038~1040 (1995)
- Savulescu J, "Evalua ting ethics competence in medical education", J Med Ethics, 25, pp.367~374 (1999)
- Spike N, "Are orals worth talking about?", Med Educ, 37, pp.92~93 (2003)
- Davis MH, "The place of the oral examination in today's assessment systems", Med Teach, 27, pp.294~297 (2005)
- Van Wart AD, "A problem-solving oral examination for family medicine", J Med Educ, 49, pp.673~680 (1974)
- Vu NV, "Oral examination: a model for its use within a clinical clerkship", J Med Educ, 56, pp.665~667 (1981)
- Butzin DW, "A study of the reliability of the grading process used in the American Board of Pediatrics oral examination", J Med Educ, 57, pp.944~946 (1982)
- Solomon DJ, "An assessment of an oral examination format for evaluating clinical competence in emergency medicine", Acad Med, 65, pp.S43~S44 (1990)
- Hardy KJ, "Undergraduate surgical examinations: an appraisal of the clinical orals", Med Educ, 32, pp.582~589 (1998)
- Sierles FS, "Psychometric properties of ABPN-Style Oral Examinations administered jointly by two psychiatry residency programs", Acad Psychiatry, 25, pp.214~222 (2001)
- Lee YM, "An experience of OSCE for introducing clinical performance assessment to Korean Medical Licensure Examination", Korean J Med Educ, 13, pp.47~57 (2001)
- Hodges B, "Analytic global OSCE ratings are sensitive to level of training", Med Educ, 37, pp.1012~1016 (2003)
- Kim OJ, "Experiences of medical ethics education with case-based learning", Korean J Med Educ, 12, pp.175~183 (2002)
- Turnbull J, "Content specificity and oral certification exams", Med Educ, 30, pp.56~59 (1996)
- McGuire CH, "The oral examination as a measure of professional competence", J Med Educ, 41, pp.267~274 (1966)
- Evans LR, "The reliability, validity, and taxonomic structure of the oral examination", J Med Educ, 41, pp.651~657 (1966)
- "1996"[URL]
- Brown MH, "The effect of early performance on examiners' marking patterns during an oral examination", Acad Med, 71, pp.S73~S75 (1996)
- Yang JC, "Improvement of reliability of an oral examination by a structured evaluation instrument", J Med Educ, 58, pp.864~872 (1983)
- Kearney RA, "The inter-rater and intra-rater reliability of an new Canadian oral examination format in anesthesia is fair to good", Can J Anaesth, 49, pp.232~236 (2002)
- Amiel GE, "Increasing examiner involvement in an objective structured clinical examination by integrating a structured oral examination", Am J Surg, 173, pp.546~549 (1997)
- Anastakis DJ, "The structured oral examination as a method for assessing surgical residents", Am J Surg, 162, pp.67~70 (1991)
- Wakeford R, "Improving oral examinations: selecting, training, and monitoring examiners for the MRCGP", BMJ, 311, pp.931~935 (1995)
- Swing S, "Toolbox of assessment methods, version 1.1", pp.2000, Accreditation Council for Graduate Medical Education
- Colton T, "An assay of medical students' abilities by oral examination", J Med Educ, 42, pp.1005~1014 (1967)
- Foster JT, "Analysis of an oral examination used in specialty board certification", J Med Educ, 44, pp.951~954 (1969)
- Weingarten MA, "Variations among examiners in family medicine residency board oral examinations", Med Educ, 34, pp.13~17 (2000)
- Rowland-Morin PA, "Influence of effective communication by surgery students on their oral examination scores", Acad Med, 66, pp.169~171 (1991)
- Roberts C, "Oral examinations-equal opportunities, ethnicity, and fairness in the MRCGP", BMJ, 320, pp.370~375 (2000)
- Yaphe J, "How do examiners decide?: a qualitative study of the process of decision making in the oral examination component of the MRCGP examination", Med Educ, 37, pp.764~771 (2003)
- Wass V, "Achieving acceptable reliability in oral examinations: an analysis of the Royal College of General Practitioners membership examination's oral component", Med Educ, 37, pp.126~131 (2003)
- Norman G, "How specific is case specificity?", Med Educ, 40, pp.618~623 (2006)