일개 의과대학 교육프로그램 평가체제에 대한 연구
Educational Program Evaluation System in a Medical School
1
조회
0
다운로드
6
인용
0
참고문헌
키워드
초록
A systematic educational program evaluation system for continuous quality improvement in undergraduate medical education is essential. Monitoring and evaluation (M&E) are two distinct but complementary processes referred to in an evaluation system that emphasizes formative purpose. Monitoring involves regular data collection for tracking process and results, while evaluation requires periodic judgment for improvement. We have recently completed implementing an educational evaluation using the M&E concept in a medical school. The evaluation system consists of two loops, one at the lesson/course level and the other at the phase/graduation level. We conducted evaluation activities in four stages: planning, monitoring, evaluation, and improvement. In the planning phase, we clarified the purpose of evaluation, formulated a plan to engage stakeholders, determined evaluation criteria and indicators, and developed an evaluation plan. Next, during the monitoring phase, we developed evaluation instruments and methods and then collected data. In the evaluation phase, we analyzed results and evaluated the criteria of the two loops. Finally, we reviewed the evaluation results with stakeholders to make improvements. We have recognized several problems including excessive burden, lack of expertise, insufficient consideration of stakeholders’ evaluation questions, and inefficient data collection. We need to share the value of evaluation and build a system gradually.
Abstract
A systematic educational program evaluation system for continuous quality improvement in undergraduate medical education is essential. Monitoring and evaluation (M&E) are two distinct but complementary processes referred to in an evaluation system that emphasizes formative purpose. Monitoring involves regular data collection for tracking process and results, while evaluation requires periodic judgment for improvement. We have recently completed implementing an educational evaluation using the M&E concept in a medical school. The evaluation system consists of two loops, one at the lesson/course level and the other at the phase/graduation level. We conducted evaluation activities in four stages: planning, monitoring, evaluation, and improvement. In the planning phase, we clarified the purpose of evaluation, formulated a plan to engage stakeholders, determined evaluation criteria and indicators, and developed an evaluation plan. Next, during the monitoring phase, we developed evaluation instruments and methods and then collected data. In the evaluation phase, we analyzed results and evaluated the criteria of the two loops. Finally, we reviewed the evaluation results with stakeholders to make improvements. We have recognized several problems including excessive burden, lack of expertise, insufficient consideration of stakeholders’ evaluation questions, and inefficient data collection. We need to share the value of evaluation and build a system gradually.
참고문헌 (15)
- Scriven M, "Evaluation thesaurus", pp.53~ (1991), Sage
- Goldie J, "AMEE education guide no. 29: evaluating educational programmes", Med Teach, 28(3), pp.210~224 (2006)
- Bae HS, "Theory-driven educational program evaluation" (2008), Wonmisa
- Rossi PH, "Evaluation: a systemic approach", pp.171~ (2004), Sage
- Chen HT, "Practical program evaluation: assessing and improving planning, implementation and effectiveness", pp.181~188 (2005), Sage
- "Accreditation Standards of Korean Institute of Medical Education and Evaluation 2019" (2020)[URL]
- Scriven M, "Evaluation thesaurus", pp.228~ (1991), Sage
- Chelimsky E, "Evaluation for the 21st century: a handbook" (1997), Sage
- Kirkpatrick D, "Revisiting Kirkpatrick's four-level model", Train Dev, 50(1), pp.54~57 (1996)
- Frechtling J, "Logic modeling methods in program evaluation" (2007), John Wiley & Sons
- Stufflebeam D, "Evaluation theory, models, & applications", pp.2007, Jossey Bass
- Frye AW, "Program evaluation models and related theories:AMEE guide no. 67", Med Teach, 34(5), pp.e288~e299 (2012)
- Stake RE, "Evaluating educational programmes: the need and the response" (1976), Organization for Economic Cooperation and Development
- "Evaluation criteria" (1991)[URL]
- Cook DA, "Twelve tips for evaluating educational programs", Med Teach, 32(4), pp.296~301 (2010)
