Predictive Value of the Korean Academy of Family Medicine In-Training Examination for Certifying Examination
2
조회
0
다운로드
0
인용
0
참고문헌
키워드
초록
Background: In-training examination (ITE) is a cognitive examination similar to the written test, but it is different from the Clinical Practice Examination of the Korean Academy of Family Medicine (KAFM) Certifi cation Examination (CE). The objective of this is to estimate the positive predictive value of the KAFM-ITE for identifying residents at risk for poor performance on the three types of KAFM-CE. Methods: 372 residents who completed the KAFM-CE in 2011 were included. We compared the mean KAFM-CE scores with ITE experience. We evaluated the correlation and the positive predictive value (PPV) of ITE for the multiple choice question (MCQ) scores of 1st written test & 2nd slide examination, the total clinical practice examination scores, and the total sum of 2nd test. Results: 275 out of 372 residents completed ITE. Those who completed ITE had signifi cantly higher MCQ scores of 1st written test than those who did not. The correlation of ITE scores with 1st written MCQ (0.627) was found to be the highest among the other kinds of CE. The PPV of the ITE score for 1st written MCQ scores was 0.672. The PPV of the ITE score ranged from 0.376 to 0.502. Conclusion: The score of the KAFM ITE has acceptable positive predictive value that could be used as a part of comprehensive evaluation system for residents in cognitive field.
Abstract
Background: In-training examination (ITE) is a cognitive examination similar to the written test, but it is different from the Clinical Practice Examination of the Korean Academy of Family Medicine (KAFM) Certifi cation Examination (CE). The objective of this is to estimate the positive predictive value of the KAFM-ITE for identifying residents at risk for poor performance on the three types of KAFM-CE. Methods: 372 residents who completed the KAFM-CE in 2011 were included. We compared the mean KAFM-CE scores with ITE experience. We evaluated the correlation and the positive predictive value (PPV) of ITE for the multiple choice question (MCQ) scores of 1st written test & 2nd slide examination, the total clinical practice examination scores, and the total sum of 2nd test. Results: 275 out of 372 residents completed ITE. Those who completed ITE had signifi cantly higher MCQ scores of 1st written test than those who did not. The correlation of ITE scores with 1st written MCQ (0.627) was found to be the highest among the other kinds of CE. The PPV of the ITE score for 1st written MCQ scores was 0.672. The PPV of the ITE score ranged from 0.376 to 0.502. Conclusion: The score of the KAFM ITE has acceptable positive predictive value that could be used as a part of comprehensive evaluation system for residents in cognitive field.
참고문헌 (15)
- Bloom BS, "Handbook on formative and summative evaluation of student learning" (1971), McGraw-Hill
- Seong TJ, "Current education evalution" (2005), Hakjisa
- Althouse LA, "The in-training examination: an analysis of its predictive value on performance on the general pediatrics certification examination", J Pediatr, 153, pp.425~428 (2008)
- Babbott SF, "The predictive validity of the internal medicine in-training examination", Am J Med, 120, pp.735~740 (2007)
- Klein GR, "Passing the Boards: can USMLE and Orthopaedic in-Training Examination scores predict passage of the ABOS Part-I examination", J Bone Joint Surg Am, 86, pp.1092~1095 (2004)
- Replogle WH, "Assessing the predictive value of the American Board of Family Practice In-training Examination", Fam Med, 36, pp.185~188 (2004)
- Kearney RA, "Performance on ABAASA in-training examination predicts success for RCPSC certification. American Board of Anesthesiology-American Society of Anesthesiologists. Royal College of Physicians and Surgeons of Canada", Can J Anaesth, 47, pp.914~918 (2000)
- Grossman RS, "Validity of the in-training examination for predicting American Board of Internal Medicine certifying examination scores", J Gen Intern Med, 7, pp.63~67 (1992)
- Leigh TM, "Predictive validity of the American Board of Family Practice In-Training Examination", Acad Med, 65, pp.454~457 (1990)
- Miller GE, "The assessment of clinical skills", competence, Acad Med, pp.1990, 65(9)[DOI]
- Glaser AN, "High-yield TM biostatistics" (2001), Lippincott Williamd & Wilkins
- 허정원, "수련 기간 중 시행되는 진단검사의학과 전공의 평가 시험 성적과 수련 환경 및전문의 고시 성적과의 상관관계", Annals of Laboratory Medicine, 26(3), pp.227~231 (2006), 대한진단검사의학회
- 김석화, "성형외과 전문의 자격시험에서 객관구조화진료시험(OSCE) 도입", 한국의학교육, 18(2), pp.153~160 (2006), 한국의학교육학회
- 김범준, "전문의 고시에서 표준화 환자를 이용한 진료 수행 시험의 경험: 3개 연도 신경과 전문의 시험 결과 분석을 바탕으로", 한국의학교육, 23(2), pp.127~135 (2011), 한국의학교육학회
- Jeon SY, "Validity of the intraining examinations and the board examinations: an experience in the Korean Society of Otolaryngology", Korean J Med Educ, 9, pp.151~157 (1997)