본문 바로가기
KERD
논문KCI 등재

생성형 거대언어모델의 의학 적용 현황과 방향 - 동아시아 의학을 중심으로 -

Current Status and Direction of Generative Large Language Model Applications in Medicine - Focusing on East Asian Medicine -

이상연|배효진|김창업|강봉수
한의병리학회 (The Society of Pathology in Korean Medicine)|2024.04|동의생리병리학회지 (Journal of Physiology & Pathology in Korean Medicine)|제38권 제2호|pp. 49-58|DOI http://dx.doi.org/10.15188/kjopp.2024.04.38.2.49

2

조회

0

다운로드

2

인용

0

참고문헌

키워드

East Asian medicineGenerative large language model
주제분류한의학

초록

The rapid advancement of generative large language models has revolutionized various real-life domains, emphasizing the importance of exploring their applications in healthcare. This study aims to examine how generative large language models are implemented in the medical domain, with the specific objective of searching for the possibility and potential of integration between generative large language models and East Asian medicine. Through a comprehensive current state analysis, we identified limitations in the deployment of generative large language models within East Asian medicine and proposed directions for future research. Our findings highlight the essential need for accumulating and generating structured data to improve the capabilities of generative large language models in East Asian medicine. Additionally, we tackle the issue of hallucination and the necessity for a robust model evaluation framework. Despite these challenges, the application of generative large language models in East Asian medicine has demonstrated promising results. Techniques such as model augmentation, multimodal structures, and knowledge distillation have the potential to significantly enhance accuracy, efficiency, and accessibility. In conclusion, we expect generative large language models to play a pivotal role in facilitating precise diagnostics, personalized treatment in clinical fields, and fostering innovation in education and research within East Asian medicine.

Abstract

The rapid advancement of generative large language models has revolutionized various real-life domains, emphasizing the importance of exploring their applications in healthcare. This study aims to examine how generative large language models are implemented in the medical domain, with the specific objective of searching for the possibility and potential of integration between generative large language models and East Asian medicine. Through a comprehensive current state analysis, we identified limitations in the deployment of generative large language models within East Asian medicine and proposed directions for future research. Our findings highlight the essential need for accumulating and generating structured data to improve the capabilities of generative large language models in East Asian medicine. Additionally, we tackle the issue of hallucination and the necessity for a robust model evaluation framework. Despite these challenges, the application of generative large language models in East Asian medicine has demonstrated promising results. Techniques such as model augmentation, multimodal structures, and knowledge distillation have the potential to significantly enhance accuracy, efficiency, and accessibility. In conclusion, we expect generative large language models to play a pivotal role in facilitating precise diagnostics, personalized treatment in clinical fields, and fostering innovation in education and research within East Asian medicine.

참고문헌 (79)

  1. Min B, "Recent Advances in Natural Language Processing via Large Pre-trained Language Models: A Survey", ACM Comput Surv (2023)
  3. Vaswani A, "Attention is all you need", Advances in neural information processing systems, 30 (2017)
  6. Gómez Cano CA, "Unveiling the Thematic Landscape of Generative Pre-trained Transformer(GPT)Through Bibliometric Analysis", Metaverse Basic and Applied Research, 2, pp.33~ (2023)
  7. Li J, "ChatGPT in healthcare : A taxonomy and systematic review", Computer Methods and Programs in Biomedicine, 245, pp.108013~ (2024)
  8. Kasneci E, "ChatGPT for good? On opportunities and challenges of large language models for education", Learning and Individual Differences, 103, pp.102274~ (2023)
  9. Brynjolfsson E, "Generative AI at work", National Bureau of Economic Research; (2023)
  11. Guo Y, "Spottune: transfer learning through adaptive fine-tuning", Proceedings of the IEEE, 2019, ~
  12. Lewis P, "Retrieval-augmented generation for knowledge-intensive nlp tasks", Advances in Neural Information Processing Systems, 33, pp.9459~9474 (2020)
  13. Lee J, "BioBERT : a pre-trained biomedical language representation model for biomedical text mining", Bioinformatics, 36(4), pp.1234~1240 (2019)
  14. Roy A, "Incorporating medical knowledge in BERT for clinical relation extraction", Proceedings of the 2021 conference on empirical methods in natural language processing (2021)
  15. Chen Y-P, "Disease Concept-Embedding Based on the Self-Supervised Method for Medical Information Extraction from Electronic Health Records and Disease Retrieval : Algorithm Development and Validation Study", J Med Internet Res, 23(1), pp.e25113~ (2021)
  16. Kottlors J, "Feasibility of Differential Diagnosis Based on Imaging Patterns Using a Large Language Model", Radiology, 308(1), pp.e231167~ (2023)
  17. Kuckelman IJ, "Assessing AI-Powered Patient Education : A Case Study in Radiology", Academic Radiology, 31(1), pp.338~342 (2024)
  18. ChatGPT passing USMLE shines a spotlight on the flaws of medical education, "Mbakwe AB", Public Library of Science San Francisco, e0000205~ (2023)
  19. Wang H, "Performance and exploration of ChatGPT in medical examination, records and education in Chinese : Pave the way for medical AI", International Journal of Medical Informatics, 177, pp.105173~ (2023)
  21. Ferdush J, "ChatGPT and Clinical Decision Support : Scope, Application, and Limitations", Annals of Biomedical Engineering (2023)
  22. Holderried F, "A Generative Pretrained Transformer(GPT)–Powered Chatbot as a Simulated Patient to Practice History Taking : Prospective, Mixed Methods Study", JMIR Medical Education, 10(1), pp.e53961~ (2024)
  23. Zhang M, "Traditional Chinese medicine knowledge service based on semi-supervised BERT-BiLSTM-CRF model", 2020International Conference on Service Science (ICSS) (2020), IEEE
  24. TCM-SD: A Benchmark for Probing Syndrome Differentiation via Natural Language Processing2022 October; Nanchang, "Mucheng R", Chinese Information Processing Society of China, ~ (2022)
  25. Oh J, "A Strategy for Disassembling the Traditional East Asian Medicine Herbal Formulas With Machine Learning", Journal of Oriental Medical Classics, 36(2), pp.23~34 (2023)
  26. Oh J, "Comparison of Word Extraction Methods Based on Unsupervised Learning for Analyzing East Asian Traditional Medicine Texts", Journal of Oriental Medical Classics, 32(3), pp.47~57 (2019)
  28. Guo E, "neuroGPT-X: toward a clinic-ready large language model", Journal of Neurosurgery, pp.1~13 (2023)
  30. Kartchner D, "Zero-Shot Information Extraction for Clinical Meta-Analysis using Large Language Models2023" (2023), Association for Computational Linguistics
  33. Krusche M, "Diagnostic accuracy of a large language model in rheumatology : comparison of physician and ChatGPT-4", Rheumatology International, 44(2), pp.303~306 (2024)
  40. Zakka C, "Almanac-Retrieval-Augmented Language Models for Clinical Medicine", NEJM AI, 1(2), pp.AIoa2300068~ (2024)
  41. Singhal K, "Large language models encode clinical knowledge", Nature, 620(7972), pp.172~180 (2023)
  44. Niu S, "EHR-KnowGen : Knowledge-enhanced multimodal learning for disease diagnosis generation", Information Fusion, 102, pp.102069~ (2024)
  45. Yang J, "Enhancing phenotype recognition in clinical notes using large language models : PhenoBCBERT and PhenoGPT", Patterns, 5(1), pp.100887~ (2024)
  47. Wang H, "DRG-LLaMA : tuning LLaMA model to predict diagnosis-related group for hospitalized patients", npj Digital Medicine, 7(1), pp.16~ (2024)
  53. Hsu H-Y, "Examining Real-World Medication Consultations and Drug-Herb Interactions : ChatGPT Performance Evaluation", JMIR Med Educ, 9, pp.e48433~ (2023)
  54. Lee H, "Using ChatGPT as a Learning Tool in Acupuncture Education : Comparative Study", JMIR Med Educ, 9, pp.e47427~ (2023)
  55. Chen Q, "Generation of traditional Chinese medicine prescription driven by generative artificial intelligence GPT-4", China Pharmacy, 34(23), pp.2825~2828 (2023)
  56. Jang D, "GPT-4can pass the Korean National Licensing Examination for Korean Medicine Doctors", PLOS Digital Health, 2(12), pp.e0000416~ (2023)
  57. Kim T-H, "AI Chat bot-ChatGPT-4 : A new opportunity and challenges in complementary and alternative medicine", Integrative Medicine Research, 12(3), pp.100977~ (2023)
  58. Liu J, "Benchmarking Large Language Models on CMExam-A Comprehensive Chinese Medical Exam Dataset", Advances in Neural Information Processing Systems, 36 (2024)
  59. Zhu L, "Language and cultural bias in AI : comparing the performance of large language models developed in different countries on Traditional Chinese Medicine highlights the need for localized models", Journal of Translational Medicine, 22(1), pp.319~ (2024)
  60. Zhang Y, "Traditional Chinese Medicine Knowledge Graph Construction Based on Large Language Models", Electronics, 13(7), pp.1395~ (2024)
  61. Park S-Y, "Enhancing Korean Medicine Education with Large Language Models : Focusing on the Development of Educational Artificial Intelligence", Journal of Physiology & Pathology in Korean Medicine, 37(5), pp.134~138 (2023)
  62. Li M, "Identification of Ancient Chinese Medical Prescriptions and Case Data Analysis Under Artificial Intelligence GPT Algorithm : A Case Study of Song Dynasty Medical Literature", IEEE Access, 11, pp.131453~131464 (2023)
  63. Zhu J, "A Locally Deployed Large Language Model for Traditional Chinese Medicine and Corresponding Evaluation Methodology: A Large Language Model for data fine-tuning in the field of Traditional Chinese Medicine, and a new evaluation method called TCMEval are proposed", Proceedings of the 2023 4th International Symposium on Artificial Intelligence for Medicine Science, pp.1036~1042 (2024)
  67. Tan Y, "MedChatZH : A tuning LLM for traditional Chinese medicine consultations", Computers in Biology and Medicine, 172, pp.108290~ (2024)
  68. Yang T, "Research Ideas and Methods of Intelligent Diagnosis and Treatment of Traditional Chinese Medicine Driven by Large Language Model", Journal of Nanjing University of Traditional Chinese Medicine, 39(10), pp.967~971 (2023)
  69. Pu H, "RoKEPG: RoBERTa and Knowledge Enhancement for Prescription Generation of Traditional Chinese Medicine", 2023 IEEE International Conference on Bioinformatics and Biomedicine (BIBM) (2023), IEEE
  70. Wang X, "Research on personalized prescription recommendation of traditional Chinese medicine based on large language pre-training model", Chinese Archives of Traditional Chinese Medicine, 1~14
  72. Zhou Z, "Traditional Chinese Medicine Epidemic Prevention and Treatment Question-Answering Model Based on LLMs", 2023 IEEE International Conference on Bioinformatics and Biomedicine(BIBM) (2023)
  73. Liu C, "CPMI-ChatGLM : parameter-efficient fine-tuning ChatGLM with Chinese patent medicine instructions", Scientific Reports, 14(1), pp.6403~ (2024)
  74. Wang Z, "Traditional Chinese Medicine Formula Classification Using Large Language Models", 2023 IEEE International Conference on Bioinformatics and Biomedicine (BIBM) (2023)
  75. Zhang J, "AIGC Empowering the Revitalization of Traditional Chinese Medicine Ancient Books: A Study on the Construction of the Huang-Di Large Language Model", Library Tribune, 1~13
  78. Gou J, "Knowledge distillation : A survey", International Journal of Computer Vision, 129, pp.1789~1819 (2021)
  79. Elbadawi M, "The role of artificial intelligence in generating original scientific research", International Journal of Pharmaceutics, 652, pp.123741~ (2024)

이 간행물의 다른 논문 (1건)

직장 탈출증에 대한 보중익기탕과 수술 치료 병용요법의 임상 연구 고찰 - 무작위 대조군 연구를 중심으로공경환, 김도현pp. 59-65
원문 보기