The development of an evaluation tool to assess professional behavior and clinical competencies from the graduates’ perspective
1
조회
0
다운로드
1
인용
0
참고문헌
키워드
초록
Purpose: This study was designed to develop an evaluation tool for assessing professional behavior and clinical competencies from the graduates’ perspective. Methods: This study employed mixed method in a sequential exploratory design. The semi-structured interviews were conducted with three graduates from different cohorts. The qualitative analysis of the interviews found six emerging themes for professional behavior and clinical competencies development. These themes were then developed into a 55-item questionnaire. The questionnaire was then distributed to 84 medical graduates for exploratory factor analysis (EFA) from February to April 2019. The quantitative data were analyzed using IBM SPSS ver. 21.0 (IBM Corp., Armonk, USA) for principal axis factoring. After conducting EFA, we proceeded with confirmatory factor analysis (CFA) with another 120 graduates to validate the tool. Results: Eighty-four graduates completed the questionnaire for EFA. Upon completion of EFA, 35 out of 55 items of the questionnaire were found to be valid and reliable. The most appropriate fit was seven factors, which explained 58.18% of variance between them after 15 iterations with Cronbach’s α of 0.916. The personal satisfaction factor was noted to be weak. It was therefore added to patient management factor due to its similar intention. The final EFA factor after the modification was six. The CFA found that 34 out of 35 items was valid and reliable that representation of the latent variables. Conclusion: The questionnaire has achieved the desired construct validity score and can be used as an evaluation tool to assess professional behavior and clinical competencies from the graduates’ perspective.
Abstract
Purpose: This study was designed to develop an evaluation tool for assessing professional behavior and clinical competencies from the graduates’ perspective. Methods: This study employed mixed method in a sequential exploratory design. The semi-structured interviews were conducted with three graduates from different cohorts. The qualitative analysis of the interviews found six emerging themes for professional behavior and clinical competencies development. These themes were then developed into a 55-item questionnaire. The questionnaire was then distributed to 84 medical graduates for exploratory factor analysis (EFA) from February to April 2019. The quantitative data were analyzed using IBM SPSS ver. 21.0 (IBM Corp., Armonk, USA) for principal axis factoring. After conducting EFA, we proceeded with confirmatory factor analysis (CFA) with another 120 graduates to validate the tool. Results: Eighty-four graduates completed the questionnaire for EFA. Upon completion of EFA, 35 out of 55 items of the questionnaire were found to be valid and reliable. The most appropriate fit was seven factors, which explained 58.18% of variance between them after 15 iterations with Cronbach’s α of 0.916. The personal satisfaction factor was noted to be weak. It was therefore added to patient management factor due to its similar intention. The final EFA factor after the modification was six. The CFA found that 34 out of 35 items was valid and reliable that representation of the latent variables. Conclusion: The questionnaire has achieved the desired construct validity score and can be used as an evaluation tool to assess professional behavior and clinical competencies from the graduates’ perspective.
참고문헌 (33)
- Arnold L, "Assessing professional behavior : yesterday, today, and tomorrow", Acad Med, 77(6), pp.502~515 (2002)
- Hodges BD, "Assessment of professionalism : recommendations from the Ottawa 2010 Conference", Med Teach, 33(5), pp.354~363 (2011)
- Adam J, "Can personal qualities of medical students predict in-course examination success and professional behaviour? : an exploratory prospective cohort study", BMC Med Educ, 12, pp.69~ (2012)
- Lynch DC, "Assessing professionalism : a review of the literature", Med Teach, 26(4), pp.366~373 (2004)
- Mueller PS, "Incorporating professionalism into medical education : the Mayo Clinic experience", Keio J Med, 58(3), pp.133~143 (2009)
- Cruess R, "The professionalism mini-evaluation exercise: a preliminary investigation", Acad Med, 81(10 Suppl), pp.S74~S78 (2006)
- Tsugawa Y, "Professionalism mini-evaluation exercise for medical residents in Japan : a pilot study", Med Educ, 43(10), pp.968~978 (2009)
- Ruhe V, "The 2011 Program Evaluation Standards : a framework for quality in medical education programme evaluations", J Eval Clin Pract, 19(5), pp.925~932 (2013)
- Dilmore TC, "Psychometric properties of the mentor role instrument when used in an academic medicine setting", Clin Transl Sci, 3(3), pp.104~108 (2010)
- 여상희, "Students’ self-assessment of achievement of terminal competency and 4-year trend of student evaluation on outcome-based education", Korean Journal of Medical Education, 31(1), pp.39~50 (2019), 한국의학교육학회
- Kusmiati M, "Development of an instrument for preceptor evaluation of medical graduates’ performance : the psychometric properties", Med Sci Educ, 29(4), pp.935~940 (2019)
- Kusmiati M, "Validation of patient perception instruments for junior doctor performance : a factor analysis", Glob Med Health Commun, 7(1), pp.71~80 (2019)
- Stalmeijer RE, "The development of an instrument for evaluating clinical teachers : involving stakeholders to determine content validity", Med Teach, 30(8), pp.e272~e277 (2008)
- Boerebach BC, "Confirmatory factor analysis of the system for evaluation of teaching qualities(SETQ)in graduate medical training", Eval Health Prof, 39(1), pp.21~32 (2016)
- Anthoine E, "Sample size used to validate a scale : a review of publications on newly-developed patient reported outcomes measures", Health Qual Life Outcomes, 12, pp.176~ (2014)
- Stenfors-Hayes T, "What does it mean to be a good teacher and clinical supervisor in medical education", Adv Health Sci Educ Theory Pract, 16(2), pp.197~210 (2011)
- Pluye P, "Combining the power of stories and the power of numbers : mixed methods research and mixed studies reviews", Annu Rev Public Health, 35, pp.29~45 (2014)
- Lesser CS, "A behavioral and systems view of professionalism", JAMA, 304(24), pp.2732~2737 (2010)
- Kasule OH, "Medical professionalism and professional organizations", J Taibah Univ Med Sci, 8(3), pp.137~141 (2013)
- Epstein RM, "Defining and assessing professional competence", JAMA, 287(2), pp.226~235 (2002)
- Campbell EG, "Professionalism in medicine : results of a national survey of physicians", Ann Intern Med, 147(11), pp.795~802 (2007)
- Haque M, "Professionalism perspectives among medical students of a novel medical graduate school in Malaysia", Adv Med Educ Pract, 7, pp.407~422 (2016)
- Bahaziq W, "Physician professional behaviour affects outcomes : a framework for teaching professionalism during anesthesia residency", Can J Anaesth, 58(11), pp.1039~1050 (2011)
- Worthington RL, "Scale development research : a content analysis and recommendations for best practices", Couns Psychol, 34(6), pp.806~838 (2006)
- Guilford JP, "Fundamental statistics in psychology and education" (1978), McGraw-Hill
- Sweet LR, "Application of Kern’s six-step approach to curriculum development by global health residents", Educ Health(Abingdon), 28(2), pp.138~141 (2015)
- Gholamabbas Shirali, "Assessing Reliability and Validity of an Instrument for Measuring Resilience Safety Culture in Sociotechnical Systems", Safety and Health at Work, 9(3), pp.296~307 (2018), 한국산업안전보건공단 산업안전보건연구원[DOI]
- Frank JR, "The CanMEDS 2005 Physician Competency Framework: better standards, better physicians, better care" (2005), Royal College of Physicians and Surgeons of Canada
- Frank JR, "CanMEDS 2015 Physician Competency Framework" (2015), Royal College of Physicians and Surgeons of Canada
- Swing SR, "The ACGME outcome project : retrospective and prospective", Med Teach, 29(7), pp.648~654 (2007)
- Malik MU, "Barriers to implementing the ACGME outcome project : a systematic review of program director surveys", J Grad Med Educ, 4(4), pp.425~433 (2012)
- Costello AB, "Best practices in exploratory factor analysis : four recommendations for getting the most from your analysis", Pract Assess Res Eval, 10(1), pp.7~ (2005)
- Claramita M, "Doctor-patient communication in Southeast Asia : a different culture", Adv Health Sci Educ Theory Pract, 18(1), pp.15~31 (2013)
