Medical students’ patterns of using ChatGPT as a feedback tool and perceptions of ChatGPT in a Leadership and Communication course in Korea: a cross-sectional study
2
조회
0
다운로드
2
인용
0
참고문헌
키워드
초록
Purpose This study aimed to analyze patterns of using ChatGPT before and after group activities and to explore medical students’ perceptions of ChatGPT as a feedback tool in the classroom. Methods The study included 99 2nd-year pre-medical students who participated in a “Leadership and Communication” course from March to June 2023. Students engaged in both individual and group activities related to negotiation strategies. ChatGPT was used to provide feedback on their solutions. A survey was administered to assess students’ perceptions of ChatGPT’s feedback, its use in the classroom, and the strengths and challenges of ChatGPT from May 17 to 19, 2023. Results The students responded by indicating that ChatGPT’s feedback was helpful, and revised and resubmitted their group answers in various ways after receiving feedback. The majority of respondents expressed agreement with the use of ChatGPT during class. The most common response concerning the appropriate context of using ChatGPT’s feedback was “after the first round of discussion, for revisions.” There was a significant difference in satisfaction with ChatGPT’s feedback, including correctness, usefulness, and ethics, depending on whether or not ChatGPT was used during class, but there was no significant difference according to gender or whether students had previous experience with ChatGPT. The strongest advantages were “providing answers to questions” and “summarizing information,” and the worst disadvantage was “producing information without supporting evidence.”Conclusion The students were aware of the advantages and disadvantages of ChatGPT, and they had a positive attitude toward using ChatGPT in the classroom.
Abstract
Purpose This study aimed to analyze patterns of using ChatGPT before and after group activities and to explore medical students’ perceptions of ChatGPT as a feedback tool in the classroom. Methods The study included 99 2nd-year pre-medical students who participated in a “Leadership and Communication” course from March to June 2023. Students engaged in both individual and group activities related to negotiation strategies. ChatGPT was used to provide feedback on their solutions. A survey was administered to assess students’ perceptions of ChatGPT’s feedback, its use in the classroom, and the strengths and challenges of ChatGPT from May 17 to 19, 2023. Results The students responded by indicating that ChatGPT’s feedback was helpful, and revised and resubmitted their group answers in various ways after receiving feedback. The majority of respondents expressed agreement with the use of ChatGPT during class. The most common response concerning the appropriate context of using ChatGPT’s feedback was “after the first round of discussion, for revisions.” There was a significant difference in satisfaction with ChatGPT’s feedback, including correctness, usefulness, and ethics, depending on whether or not ChatGPT was used during class, but there was no significant difference according to gender or whether students had previous experience with ChatGPT. The strongest advantages were “providing answers to questions” and “summarizing information,” and the worst disadvantage was “producing information without supporting evidence.”Conclusion The students were aware of the advantages and disadvantages of ChatGPT, and they had a positive attitude toward using ChatGPT in the classroom.
참고문헌 (14)
- Temsah O, "Overview of early ChatGPT’s presence in medical literature : insights from a hybrid literature review by ChatGPT and human experts", Cureus, 15, pp.e37281~ (2023)[DOI]
- Sallam M, "ChatGPT utility in healthcare education, research, and practice: systematic review on the promising perspectives and valid concerns", Healthcare(Basel), 11, pp.887~ (2023)[DOI]
- Celik I, "The promises and challenges of artificial intelligence for teachers : a systematic review of research", TechTrends, 66, pp.616~630 (2022)[DOI]
- Lee GB, "Assessment and feedback methods in competency-based medical education", Ann Allergy Asthma Immunol, 128, pp.256~262 (2022)[DOI]
- Ramesh D, "An automated essay scoring systems : a systematic literature review", Artif Intell Rev, 55, pp.2495~2527 (2022)[DOI]
- Cahan P, "A conversation with ChatGPT on the role of computational systems biology in stem cell research", Stem Cell Reports, 18, pp.1~2 (2023)[DOI]
- Karabacak M, "The advent of generative language models in medical education", JMIR Med Educ, 9, pp.e48163~ (2023)[DOI]
- Borchert RJ, "Performance of ChatGPT on the situational judgement test : a professional dilemmas-based examination for doctors in the United Kingdom", JMIR Med Educ, 9, pp.e48978~ (2023)[DOI]
- Kung TH, "Performance of ChatGPT on USMLE : potential for AI-assisted medical education using large language models", PLOS Digit Health, 2, pp.e0000198~ (2023)[DOI]
- 허선, "Are ChatGPT’s knowledge and interpretation ability comparable to those of medical students in Korea for taking a parasitology examination?: a descriptive study", Journal of Educational Evaluation for Health Professions, 20, pp.1~ (2023), 한국보건의료인국가시험원
- Mbakwe AB, "ChatGPT passing USMLE shines a spotlight on the flaws of medical education", PLOS Digit Health, 2, pp.e0000205~ (2023)[DOI]
- Currie G, "ChatGPT in medical imaging higher education", Radiography(Lond), 29, pp.792~799 (2023)[DOI]
- Webb JJ, "Proof of concept : using ChatGPT to teach emergency physicians how to break bad news", Cureus, 15, pp.e38755~ (2023)[DOI]
- Eysenbach G, "The role of ChatGPT, generative language models, and artificial intelligence in medical education : a conversation with ChatGPT and a call for papers", JMIR Med Educ, 9, pp.e46885~ (2023)[DOI]