Comparison of Patient-Physician Interaction Scores of Clinical Practice Examination between Checklists and Rating Scale
2
조회
0
다운로드
0
인용
0
참고문헌
키워드
초록
Background: The clinical practice examination (CPX) was introduced in 2010, and the Seoul-Gyeonggi CPX Con-sortium developed the patient-physician interaction (PPI) assessment tool in 2004. Both institutions use rating scales on classified sections of PPI but differ in their scoring of key components. This study investigated the accura-cy of standardized patient scores across rating scales by comparing checklist methods and verified the concurrent validity of two comparable PPI rating tools.Methods: An educational CPX module dyspepsia case was administered to 116 fourth-year medical students at Hanyang University College of Medicine. One experienced standardized patient rated exams using two different PPI scales. She scored checklists composed of 43 items related to the two original PPI scales through video clips of the same students. From these checklists, we calculated Pearson’s correlation coefficient.Results: The correlations of total PPI score between the checklist and rating scale methods were 0.29 for the Korean Medical Licensing Examination (KMLE) tool and 0.30 for the consortium tool. The correlations between the KMLE and consortium tools were 0.74 for checklists and 0.83 for rating scales. In terms of section scores, the consortium tool showed only three significant correlations between the two methods out of seven sections and the KMLE tool showed only two statistically significant correlations out of five sections.Conclusion: The rating scale and checklist methods exhibited a weak relationship in the PPI assessment, but a high correlation between assessment tools using the same method. However, the current rating scale requires modifica-tion by reorganizing key scoring components through factor analysis.
Abstract
Background: The clinical practice examination (CPX) was introduced in 2010, and the Seoul-Gyeonggi CPX Con-sortium developed the patient-physician interaction (PPI) assessment tool in 2004. Both institutions use rating scales on classified sections of PPI but differ in their scoring of key components. This study investigated the accura-cy of standardized patient scores across rating scales by comparing checklist methods and verified the concurrent validity of two comparable PPI rating tools.Methods: An educational CPX module dyspepsia case was administered to 116 fourth-year medical students at Hanyang University College of Medicine. One experienced standardized patient rated exams using two different PPI scales. She scored checklists composed of 43 items related to the two original PPI scales through video clips of the same students. From these checklists, we calculated Pearson’s correlation coefficient.Results: The correlations of total PPI score between the checklist and rating scale methods were 0.29 for the Korean Medical Licensing Examination (KMLE) tool and 0.30 for the consortium tool. The correlations between the KMLE and consortium tools were 0.74 for checklists and 0.83 for rating scales. In terms of section scores, the consortium tool showed only three significant correlations between the two methods out of seven sections and the KMLE tool showed only two statistically significant correlations out of five sections.Conclusion: The rating scale and checklist methods exhibited a weak relationship in the PPI assessment, but a high correlation between assessment tools using the same method. However, the current rating scale requires modifica-tion by reorganizing key scoring components through factor analysis.
참고문헌 (18)
- Miller GE, "The assessment of clinical skills", competence, Acad Med, pp.1990, 65(9 Suppl)[DOI]
- Wass V, "Assessment of clinical competence", Lancet, 357, pp.945~949 (2001)[DOI]
- Makoul G, "Communication teaching and assessment in medical education: an international consensus statement. Netherlands Institute of Primary Health Care", Patient Educ Couns, 37, pp.191~195 (1999)[DOI]
- Barrows HS, "The programmed patient: a technique for appraising student performance in clinical neurology", J Med Educ, 39, pp.802~805 (1964)
- Howley LD, "Performance assessment in medical education: where we've been and where we're going", Eval Health Prof, 27, pp.285~303 (2004)[DOI]
- Barrows HS, "An overview of the uses of standardized patients for teaching and evaluating clinical skills", Acad Med, 68, pp.443~451 (1993)[DOI]
- Kaplan SH, "Assessing the effects of physicianpatient interactions on the outcomes of chronic disease", Med Care, 27(3 Suppl), pp.S110~S127 (1989)[DOI]
- Stewart MA, "Effective physician-patient communication and health outcomes: a review", CMAJ, 152, pp.1423~1433 (1995)
- Bartlett EE, "The effects of physician communications skills on patient satisfaction; recall, and adherence", J Chronic Dis, 37, pp.755~764 (1984)[DOI]
- Comstock LM, "Physician behaviors that correlate with patient satisfaction", J Med Educ, 57, pp.105~112 (1982)
- Boon H, "Patient-physician communication assessment instruments: 1986 to 1996 in review", Patient Educ Couns, 35, pp.161~176 (1998)[DOI]
- Epstein RM, "Measuring patient-centered communication in patient-physician consultations: theoretical and practical issues", Soc Sci Med, 61, pp.1516~1528 (2005)[DOI]
- Gallagher TJ, "Further analysis of a doctor-patient nonverbal communication instrument", Patient Educ Couns, 57, pp.262~271 (2005)[DOI]
- Wasserman RC, "Systematic analysis of clinician-patient interactions: a critique of recent approaches with suggestions for future research", Med Care, 21, pp.279~293 (1983)[DOI]
- Cohen DS, "Psychometric properties of a standardized-patient checklist and rating-scale form used to assess interpersonal and communication skills", Acad Med, 71(1 Suppl), pp.S87~S89 (1996)[DOI]
- Cohen DS, "A large-scale study of the reliabilities of checklist scores and ratings of interpersonal and communication skills evaluated on a standardized-patient examination", Adv Health Sci Educ Theory Pract, 1, pp.209~213 (1996)[DOI]
- Dawson B, "Basic & clinical biostatistics", pp.2004, Lange Medical Books
- 이윤희, "CPX 반복 시행에 따른 영역별 성적의 변화", Korean Journal of Medical Education, 23(3), pp.193~202 (2011), 한국의학교육학회