Are ChatGPT’s knowledge and interpretation ability comparable to those of medical students in Korea for taking a parasitology examination?: a descriptive study
1
조회
0
다운로드
22
인용
0
참고문헌
키워드
초록
This study aimed to compare the knowledge and interpretation ability of ChatGPT, a language model of artificial general intelligence, with those of medical students in Korea by administering a parasitology examination to both ChatGPT and medical students. The examination consisted of 79 items and was administered to ChatGPT on January 1, 2023. The examination results were analyzed in terms of ChatGPT’s overall performance score, its correct answer rate by the items’ knowledge level, and the acceptability of its explanations of the items. ChatGPT’s performance was lower than that of the medical students, and ChatGPT’s correct answer rate was not related to the items’ knowledge level. However, there was a relationship between acceptable explanations and correct answers. In conclusion, ChatGPT’s knowledge and interpretation ability for this parasitology examination were not yet comparable to those of medical students in Korea.
Abstract
This study aimed to compare the knowledge and interpretation ability of ChatGPT, a language model of artificial general intelligence, with those of medical students in Korea by administering a parasitology examination to both ChatGPT and medical students. The examination consisted of 79 items and was administered to ChatGPT on January 1, 2023. The examination results were analyzed in terms of ChatGPT’s overall performance score, its correct answer rate by the items’ knowledge level, and the acceptability of its explanations of the items. ChatGPT’s performance was lower than that of the medical students, and ChatGPT’s correct answer rate was not related to the items’ knowledge level. However, there was a relationship between acceptable explanations and correct answers. In conclusion, ChatGPT’s knowledge and interpretation ability for this parasitology examination were not yet comparable to those of medical students in Korea.
참고문헌 (6)
- O’Connor S, "Open artificial intelligence platforms in nursing education: tools for academic progress or abuse?", Nurse Educ Pract, 66, pp.103537~ (2022)[DOI]
- "ChatGPT Dec 15 version" (2022)[URL]
- Stokel-Walker C, "AI bot ChatGPT writes smart essays: should professors worry?", Nature (2022)[DOI]
- 박성호, "What should medical students know about artificial intelligence in medicine?", Journal of Educational Evaluation for Health Professions, 16, pp.1~6 (2019), 한국보건의료인국가시험원[DOI]
- Silver D, "Mastering the game of Go with deep neural networks and tree search", Nature, 529, pp.484~489 (2016)[DOI]
- Hu R, "Insights from teaching artificial intelligence to medical students in Canada", Commun Med(Lond), 2, pp.63~ (2022)[DOI]