본문 바로가기
KERD
논문KCI 등재

Opportunities, challenges, and future directions of large language models, including ChatGPT in medical education: a systematic scoping review

3

조회

0

다운로드

1

인용

0

참고문헌

키워드

초록

Background: ChatGPT is a large language model (LLM) based on artificial intelligence (AI) capable of responding in multiple languages and generating nuanced and highly complex responses. While ChatGPT holds promising applications in medical education, its limitations and potential risks cannot be ignored. Methods: A scoping review was conducted for English articles discussing ChatGPT in the context of medical education published after 2022. A literaturesearch was performed using PubMed/MEDLINE, Embase, and Web of Science databases, and information was extracted from the relevant studies that were ultimately included. Results: ChatGPT exhibits various potential applications in medical education, such as providing personalized learning plans and materials, creating clinicalpractice simulation scenarios, and assisting in writing articles. However, challenges associated with academic integrity, data accuracy, and potential harm tolearning were also highlighted in the literature. The paper emphasizes certain recommendations for using ChatGPT, including the establishment of guidelines. Based on the review, 3 key research areas were proposed: cultivating the ability of medical students to use ChatGPT correctly, integrating ChatGPT into teaching activities and processes, and proposing standards for the use of AI by medical students. Conclusion: ChatGPT has the potential to transform medical education, but careful consideration is required for its full integration. To harness the full potential of ChatGPT in medical education, attention should not only be given to the capabilities of AI but also to its impact on students and teachers.

Abstract

Background: ChatGPT is a large language model (LLM) based on artificial intelligence (AI) capable of responding in multiple languages and generating nuanced and highly complex responses. While ChatGPT holds promising applications in medical education, its limitations and potential risks cannot be ignored. Methods: A scoping review was conducted for English articles discussing ChatGPT in the context of medical education published after 2022. A literaturesearch was performed using PubMed/MEDLINE, Embase, and Web of Science databases, and information was extracted from the relevant studies that were ultimately included. Results: ChatGPT exhibits various potential applications in medical education, such as providing personalized learning plans and materials, creating clinicalpractice simulation scenarios, and assisting in writing articles. However, challenges associated with academic integrity, data accuracy, and potential harm tolearning were also highlighted in the literature. The paper emphasizes certain recommendations for using ChatGPT, including the establishment of guidelines. Based on the review, 3 key research areas were proposed: cultivating the ability of medical students to use ChatGPT correctly, integrating ChatGPT into teaching activities and processes, and proposing standards for the use of AI by medical students. Conclusion: ChatGPT has the potential to transform medical education, but careful consideration is required for its full integration. To harness the full potential of ChatGPT in medical education, attention should not only be given to the capabilities of AI but also to its impact on students and teachers.

참고문헌 (55)

  1. Ghassemi M, "ChatGPT one year on: who is using it, how and why?", Nature, 624, pp.39~41 (2023)[DOI]
  2. Deng J, "The benefits and challenges of ChatGPT : an overview", Front Comput Intell Syst, 2, pp.81~83 (2022)[DOI]
  3. Kim TW, "Application of artificial intelligence chatbots, including ChatGPT, in education, scholarly work, programming, and content generation and its prospects : a narrative review", J Educ Eval Health Prof, 20, pp.38~ (2023)[DOI]
  4. Hultgren C, "5)as an assistant tool in microbial pathogenesis studies in Sweden : a cross-sectional comparative study", J Educ Eval Health Prof, 20, pp.32~ (2023)[DOI]
  5. Alam F, "Integrating AI in medical education: embracing ethical usage and critical understanding", Front Med(Lausanne), 10, pp.1279707~ (2023)[DOI]
  6. Ignjatovic A, "Efficacy and limitations of ChatGPT as a biostatistical problem-solving tool in medical education in Serbia : a descriptive study", J Educ Eval Health Prof, 20, pp.28~ (2023)[DOI]
  7. Huh S, "Are ChatGPT’s knowledge and interpretation ability comparable to those of medical students in Korea for taking a parasitology examination? : a descriptive study", J Educ Eval Health Prof, 20, pp.1~ (2023)[DOI]
  8. Lee H, "Information amount, accuracy, and relevance of generative artificial intelligence platforms’ answers regarding learning objectives of medical arthropodology evaluated in En glish and Korean queries in December 2023 : a descriptive study", J Educ Eval Health Prof, 20, pp.39~ (2023)[DOI]
  9. Dave T, "ChatGPT in medicine : an overview of its applications, advantages, limitations, future prospects, and ethical considerations", Front Artif Intell, 6, pp.1169595~ (2023)[DOI]
  10. Torres-Zegarra BC, "Performance of ChatGPT, Bard, Claude, and Bing on the Peruvian National Licensing Medical Examination : a cross-sectional study", J Educ Eval Health Prof, 20, pp.30~ (2023)[DOI]
  11. Tricco AC, "PRISMA Extension for Scoping Reviews(PRISMA-ScR) : checklist and explanation", Ann Intern Med, 169, pp.467~473 (2018)[DOI]
  12. Gilson A, "How does ChatGPT perform on the United States Medical Licensing Examination(USMLE)? : the implications of large language models for medical education and knowledge assessment", JMIR Med Educ, 9, pp.e45312~ (2023)[DOI]
  13. Ho WL, "ChatGPT : friend or foe in medical writing? : an example of how ChatGPT can be utilized in writing case reports", Surg Pract Sci, 14, pp.100185~ (2023)[DOI]
  14. Dhanvijay AK, "Performance of large language models(ChatGPT, Bing Search, and Google Bard)in solving case vignettes in physiology", Cureus, 15, pp.e42972~ (2023)[DOI]
  15. Valiente Fernandez M, "Teaching tools in critical care: chatGPT", Med Intensiva(Engl Ed), 47, pp.480~481 (2023)[DOI]
  16. Vignesh R, "A tete-a-tete with ChatGPT on the impact of artificial intelligence in medical education", Med J Malaysia, 78, pp.547~549 (2023)
  17. Jeyaraman M, "ChatGPT in medical education and research: a Boon or a Bane?", Cureus, 15, pp.e44316~ (2023)[DOI]
  18. Corsello A, "May artificial intelligence influence future pediatric research?: the case of ChatGPT", Children(Basel), 10, pp.757~ (2023)[DOI]
  19. Wang X, "ChatGPT performs on the Chinese National Medical Licensing Examination", J Med Syst, 47, pp.86~ (2023)[DOI]
  20. Sallam M, "ChatGPT utility in healthcare education, research, and practice: systematic review on the promising perspectives and valid concerns", Healthcare(Basel), 11, pp.887~ (2023)[DOI]
  21. "An exploratory survey about using ChatGPT in education, healthcare, and research" (2023)[URL]
  22. Tsang R, "Practical applications of ChatGPT in undergraduate medical education", J Med Educ Curric Dev, 10 (2023)[DOI]
  23. Arachchige ASPM, "Early applications of ChatGPT in medical practice, education and research", Clin Med(Lond), 23, pp.429~430 (2023)[DOI]
  24. Scherr R, "ChatGPT interactive medical simulations for early clinical education : case study", JMIR Med Educ, 9, pp.e49877~ (2023)[DOI]
  25. Liu X, "ChatGPT : when the artificial intelligence meets standardized patients in clinical training", J Transl Med, 21, pp.447~ (2023)[DOI]
  26. "The utility of ChatGPT as an example of large language models in healthcare education, research and practice: systematic review on the future perspectives and potential limitations" (2023)[URL]
  27. Ilgaz HB, "The significance of artificial intelligence platforms in anatomy education : an experience with ChatGPT and Google Bard", Cureus, 15, pp.e45301~ (2023)[DOI]
  28. Sahu PK, "ChatGPT in research and health professions education : challenges, opportunities, and future directions", Postgrad Med J, 100, pp.50~55 (2023)[DOI]
  29. Calleja-Lopez JR, "Impact of ChatGPT and artificial intelligence in the contemporary medical landscape", Arch Med Res, 54, pp.102835~ (2023)[DOI]
  30. "Generative Methods for Pediatric Genetics Education" (2023)[URL]
  31. Kung TH, "Performance of ChatGPT on USMLE : potential for AI-assisted medical education using large language models", PLOS Digit Health, 2, pp.e0000198~ (2023)[DOI]
  32. Ali R, "Performance of ChatGPT, GPT-4, and Google Bard on a neurosurgery oral boards preparation question bank", Neurosurgery, 93, pp.1090~1098 (2023)[DOI]
  33. Jiao C, "Evaluating the artificial intelligence performance growth in ophthalmic knowledge", Cureus, 15, pp.e45700~ (2023)[DOI]
  34. Shay D, "Assessment of ChatGPT success with specialty medical knowledge using anaesthesiology board examination practice questions", Br J Anaesth, 131, pp.e31~e34 (2023)[DOI]
  35. Cuthbert R, "Artificial intelligence in orthopaedics : can Chat Generative Pre-trained Transformer(ChatGPT)pass Section 1 of the Fellowship of the Royal College of Surgeons(Trauma & Orthopaedics)examination", Postgrad Med J, 99, pp.1110~1114 (2023)[DOI]
  36. Perera Molligoda Arachchige AS, "Large language models (LLM) and ChatGPT: a medical student perspective", Eur J Nucl Med Mol Imaging, 50, pp.2248~2249 (2023)[DOI]
  37. Ahn S, "A use case of ChatGPT in a flipped medical terminology course", Korean J Med Educ, 35, pp.303~307 (2023)[DOI]
  38. Preiksaitis C, "Opportunities, challenges, and future directions of generative artificial intelligence in medical education : scoping review", JMIR Med Educ, 9, pp.e48785~ (2023)[DOI]
  39. Karabacak M, "The advent of generative language models in medical education", JMIR Med Educ, 9, pp.e48163~ (2023)[DOI]
  40. Davies NP, "ChatGPT sits the DFPH exam : large language model performance and potential to support public health learning", BMC Med Educ, 24, pp.57~ (2024)[DOI]
  41. Fang C, "How does ChatGPT-4 preform on non-English national medical licensing examination?: an evaluation in Chinese language", PLOS Digit Health, 2, pp.e0000397~ (2023)[DOI]
  42. Wang H, "Performance and exploration of ChatGPT in medical examination, records and education in Chinese : pave the way for medical AI", Int J Med Inform, 177, pp.105173~ (2023)[DOI]
  43. Currie GM, "GPT-4 in nuclear medicine education: does it outperform GPT-3.5?", J Nucl Med Technol, 51, pp.314~317 (2023)[DOI]
  44. Clusmann J, "The future landscape of large language models in medicine", Commun Med(Lond), 3, pp.141~ (2023)[DOI]
  45. Liaw W, "The hazards of using ChatGPT : a call to action for medical education researchers", PRiMER, 7, pp.27~ (2023)[DOI]
  46. Feng S, "ChatGPT and the future of medical education", Acad Med, 98, pp.867~868 (2023)[DOI]
  47. Lenihan D, "Three effective, efficient, and easily implementable ways to integrate A.I. into medical education", Cureus, 15, pp.e47204~ (2023)[DOI]
  48. Abd-Alrazaq A, "Large language models in medical education : opportunities, challenges, and future directions", JMIR Med Educ, 9, pp.e48291~ (2023)[DOI]
  49. Webb JJ, "Proof of concept : using ChatGPT to teach emergency physicians how to break bad news", Cureus, 15, pp.e38755~ (2023)[DOI]
  50. Tez M, "How reliable are medical textbooks", J Grad Med Educ, 9, pp.550~ (2017)[DOI]
  51. Jager LR, "An estimate of the science-wise false discovery rate and application to the top medical literature", Biostatistics, 15, pp.1~12 (2014)[DOI]
  52. Park J, "Medical students’ patterns of using ChatGPT as a feedback tool and perceptions of ChatGPT in a Leadership and Communication course in Korea : a cross-sectional study", J Educ Eval Health Prof, 20, pp.29~ (2023)[DOI]
  53. Gao CA, "Comparing scientific abstracts generated by ChatGPT to real abstracts with detectors and blinded human reviewers", NPJ Digit Med, 6, pp.75~ (2023)[DOI]
  54. Stokel-Walker C, "ChatGPT listed as author on research papers : many scientists disapprove", Nature, 613, pp.620~621 (2023)[DOI]
  55. Busch F, "Biomedical ethical aspects towards the implementation of artificial intelligence in medical education", Med Sci Educ, 33, pp.1007~1012 (2023)[DOI]

관련 논문AI추천

이 간행물의 다른 논문 (40건)