Effectiveness of ChatGPT-4o in developing continuing professional development plans for graduate radiographers: a descriptive study
0
조회
0
다운로드
0
인용
0
참고문헌
키워드
초록
Purpose This study evaluates the use of ChatGPT-4o in creating tailored continuing professional development (CPD) plans for radiography students, addressing the challenge of aligning CPD with Medical Radiation Practice Board of Australia (MRPBA) requirements. We hypothesized that ChatGPT-4o could support students in CPD planning while meeting regulatory standards. Methods A descriptive, experimental design was used to generate 3 unique CPD plans using ChatGPT-4o, each tailored to hypothetical graduate radiographers in varied clinical settings. Each plan followed MRPBA guidelines, focusing on computed tomography specialization by the second year. Three MRPBA-registered academics assessed the plans using criteria of appropriateness, timeliness, relevance, reflection, and completeness from October 2024 to November 2024. Ratings underwent analysis using the Friedman test and intraclass correlation coefficient (ICC) to measure consistency among evaluators. Results ChatGPT-4o generated CPD plans generally adhered to regulatory standards across scenarios. The Friedman test indicated no significant differences among raters (P=0.420, 0.761, and 0.807 for each scenario), suggesting consistent scores within scenarios. However, ICC values were low (–0.96, 0.41, and 0.058 for scenarios 1, 2, and 3), revealing variability among raters, particularly in timeliness and completeness criteria, suggesting limitations in the ChatGPT-4o’s ability to address individualized and context-specific needs. Conclusion ChatGPT-4o demonstrates the potential to ease the cognitive demands of CPD planning, offering structured support in CPD development. However, human oversight remains essential to ensure plans are contextually relevant and deeply reflective. Future research should focus on enhancing artificial intelligence’s personalization for CPD evaluation, highlighting ChatGPT-4o’s potential and limitations as a tool in professional education.
Abstract
Purpose This study evaluates the use of ChatGPT-4o in creating tailored continuing professional development (CPD) plans for radiography students, addressing the challenge of aligning CPD with Medical Radiation Practice Board of Australia (MRPBA) requirements. We hypothesized that ChatGPT-4o could support students in CPD planning while meeting regulatory standards. Methods A descriptive, experimental design was used to generate 3 unique CPD plans using ChatGPT-4o, each tailored to hypothetical graduate radiographers in varied clinical settings. Each plan followed MRPBA guidelines, focusing on computed tomography specialization by the second year. Three MRPBA-registered academics assessed the plans using criteria of appropriateness, timeliness, relevance, reflection, and completeness from October 2024 to November 2024. Ratings underwent analysis using the Friedman test and intraclass correlation coefficient (ICC) to measure consistency among evaluators. Results ChatGPT-4o generated CPD plans generally adhered to regulatory standards across scenarios. The Friedman test indicated no significant differences among raters (P=0.420, 0.761, and 0.807 for each scenario), suggesting consistent scores within scenarios. However, ICC values were low (–0.96, 0.41, and 0.058 for scenarios 1, 2, and 3), revealing variability among raters, particularly in timeliness and completeness criteria, suggesting limitations in the ChatGPT-4o’s ability to address individualized and context-specific needs. Conclusion ChatGPT-4o demonstrates the potential to ease the cognitive demands of CPD planning, offering structured support in CPD development. However, human oversight remains essential to ensure plans are contextually relevant and deeply reflective. Future research should focus on enhancing artificial intelligence’s personalization for CPD evaluation, highlighting ChatGPT-4o’s potential and limitations as a tool in professional education.
참고문헌 (15)
- Medical Radiation Practice Board of Australia, "Continuing professional development guidelines", Medical Radiation Practice Board of Australia, ~ (2015)
- Medical Radiation Practice Board of Australia, "Professional capabilities for medical radiation practice", Medical Radiation Practice Board of Australia, ~ (2019)
- Karas M, "Continuing professional development requirements for UK health professionals : a scoping review", BMJ Open, 10, pp.e032781~ (2020)[DOI]
- Ramani S, "Continuing professional development to foster behaviour change : from principles to practice in health professions education", Med Teach, 41, pp.1045~1052 (2019)[DOI]
- Chang CC, "ChatGPT-facilitated professional development: evidence from professional trainers’ learning achievements, self-worth, and self-confidence", Interact Learn Environ (2024)[DOI]
- Koo TK, "A guideline of selecting and reporting intraclass correlation coefficients for reliability research", J Chiropr Med, 15, pp.155~163 (2016)[DOI]
- Rowe L, "The reflective practitioner : the challenges of supporting public sector senior leaders as they engage in reflective practice", High Educ Skills Work Based Learn, 10, pp.783~798 (2020)[DOI]
- Arruzza ES, "The performance of ChatGPT-4.0o in medical imaging evaluation: a preliminary investigation", J Educ Eval Health Prof, 21, pp.29~ (2024)[DOI]
- Baig MI, "ChatGPT in the higher education : a systematic literature review and research challenges", Int J Educ Res, 127, pp.102411~ (2024)[DOI]
- Almasri F, "Exploring the impact of artificial intelligence in teaching and learning of science : a systematic review of empirical research", Res Sci Educ, 54, pp.977~997 (2024)[DOI]
- Mohamed A, "Factors influencing final year radiography students’ intention to pursue postgraduate education in medical imaging", Radiography(Lond), 30, pp.388~393 (2024)[DOI]
- Fidalgo P, "The future of lifelong learning : the role of artificial intelligence and distance education" (2024), IntechOpen
- Alam A., "Should robots replace teachers?: mobilisation of AI and learning analytics in education", Proceedings of the 2021 International Conference on Advances in Computing, Communication, and Control (ICAC3) (2021), IEEE
- Breaking down barriers to career development, "Irwin J", Blueprint Future Skills Centre, ~ (2021)
- George AS, "The potential of generative AI to reform graduate education", Partn Univ Int Res J, 2, pp.36~50 (2023)[DOI]