내시경 촬영 가이드를 위한 CNN기반의 위내시경 이미지 해부학적 분류 모델
Automatic Anatomical Classification Model of Esophagogastroduodenoscopy Images Using Deep Convolutional Neural Networks for Guiding Endoscopic Photodocumentation
0
조회
0
다운로드
2
인용
0
참고문헌
키워드
초록
위내시경 촬영은 조기에 위 병변을 진단하기 위해서 주로 사용한다. 하지만 위내시경을 했음에도불구하고 위 내부를 자세히 관찰하지 못해서 10~20% 위 병변을 놓치는 경우가 생기는 것으로 보고되고 있다. 미국, 영국, 일본 등의 일부 국가와 세계내시경협회(Wold Endoscopy Organization)에서는위내시경 시에 맹점 없는 관찰을 위해서 반드시 촬영해야 할 부위에 대한 촬영지침을 제안한 바 있다. 이에 본 논문에서는 수련의가 내시경을 하는 데 있어 위 내부를 자동으로 맹점 없이 관찰하는데필요한 딥러닝 기술인 해부학적 분류모델을 제안한다. 제안한 모델은 위내시경 이미지에 적합한 전처리 모듈과 데이터 증강 기술들을 사용한다. 실험결과를 통해 최대 F1 점수 99.6% 분류 성능을 확인하였다. 또한, 실제 데이터를 통한 실험결과에서도 에러율이 4% 미만을 보였다. 이러한 성능을 바탕으로 설명 가능한 모델임을 보여 임상에서의 사용 가능성을 확인하였다.
Abstract
Esophagogastroduodenoscopy is a method commonly used for early diagnosis of upper gastrointestinal lesions. However, 10-20 percent of the gastric lesions are reported to be missed, due to human error. And countries including the US, the UK, and Japan, the World Endoscopy Organization (WEO) suggested guidelines about essential gastrointestinal parts to take pictures of so that all gastric lesions are observed. In this paper, we propose deep learning techniques for classification of anatomical sites, aiming for the system that informs practitioners whether they successfully did the gastroscopy without blind spots. The proposed model uses pre-processing modules and data augmentation techniques suitable for gastroscopy images. Not only does the experiment result with a maximum F1 score of 99.6%, but it also shows a error rate of less than 4% based on the actual data. Given the performance results, we found the model to be explainable with the potential to be utilized in the clinical area.
참고문헌 (22)
- Masashi Misawa, "Characterization of Colorectal Lesions Using a Computer-Aided Diagnostic System for Narrow-Band Imaging Endocytoscopy", Gastroenterology, 150(7), pp.1531~1532.e3 (2016), Elsevier BV[DOI]
- Gregor Urban, "Deep Learning Localizes and Identifies Polyps in Real Time With 96% Accuracy in Screening Colonoscopy", Gastroenterology, 155(4), pp.1069~1078.e8 (2018), Elsevier BV[DOI]
- Thomas K.L. Lui, "Accuracy of artificial intelligence–assisted detection of upper GI lesions: a systematic review and meta-analysis", Gastrointestinal Endoscopy, 92(4), pp.821~830.e9 (2020), Elsevier BV[DOI]
- Huiyan Luo, "Real-time artificial intelligence for detection of upper gastrointestinal cancer by endoscopy: a multicentre, case-control, diagnostic study", The Lancet Oncology, 20(12), pp.1645~1654 (2019), Elsevier BV[DOI]
- Georgina Chadwick, "Gastric Cancers Missed During Endoscopy in England", Clinical Gastroenterology and Hepatology, 13(7), pp.1264~1270.e1 (2015), Elsevier BV[DOI]
- Yize R. Wang, "Rate and Predictors of Interval Esophageal and Gastric Cancers after Esophagogastroduodenoscopy in the United States", Digestion, 94(3), pp.176~180 (2016), S. Karger AG[DOI]
- S. Yalamarthi, "Missed Diagnoses in Patients with Upper Gastrointestinal Cancers", Endoscopy, 36(10), pp.874~879 (2004), Georg Thieme Verlag KG[DOI]
- Yao, Kenshi, "The endoscopic diagnosis of early gastric cancer", Annals of Gastroenterology: Quarterly Publication of the Hellenic Society of Gastroenterology, 26(1), pp.11~ (2013)
- Raf Bisschops, "Performance measures for upper gastrointestinal endoscopy: a European Society of Gastrointestinal Endoscopy (ESGE) Quality Improvement Initiative", Endoscopy, 48(09), pp.843~864 (2016), Georg Thieme Verlag KG[DOI]
- Fabian Emura, "Principles and practice to facilitate complete photodocumentation of the upper gastrointestinal tract: World Endoscopy Organization position statement", Digestive Endoscopy, 32(2), pp.168~179 (2019), Wiley[DOI]
- Qi He, "Deep learning-based anatomical site classification for upper gastrointestinal endoscopy", International Journal of Computer Assisted Radiology and Surgery, 15(7), pp.1085~1094 (2020), Springer Science and Business Media LLC[DOI]
- Hirotoshi Takiyama, "Automatic anatomical classification of esophagogastroduodenoscopy images using deep convolutional neural networks", Scientific Reports, 8(1) (2018), Springer Science and Business Media LLC[DOI]
- Lianlian Wu, "Randomised controlled trial of WISENSE, a real-time quality improving system for monitoring blind spots during esophagogastroduodenoscopy", Gut, 68(12), pp.2161~2169 (2019), BMJ[DOI]
- Shohei Igarashi, "Anatomical classification of upper gastrointestinal organs under various image capture conditions using AlexNet", Computers in Biology and Medicine, 124, pp.103950~ (2020), Elsevier BV[DOI]
- Wladyslaw Januszewicz, "Quality indicators in diagnostic upper gastrointestinal endoscopy", Therapeutic Advances in Gastroenterology, 13, pp.175628482091669~ (2020), SAGE Publications[DOI]
- Hu, Jie, "Squeeze-and-excitation networks", Proceedings of the IEEE conference on computer vision and pattern recognition, pp.7132~7141 (2018)
- Woo, Sanghyun, "Cbam: Convolutional block attention module", Proceedings of the European conference on computer vision (ECCV), pp.3~19 (2018)
- Tan, Mingxing, "Efficientnet: Rethinking model scaling for convolutional neural networks", arXiv preprint arXiv:1905.11946, ~ (2019)
- Cubuk, Ekin D., "Autoaugment: Learning augmentation policies from data", arXiv preprint arXiv:1805.09501, ~ (2018)
- He, Tong, "Bag of tricks for image classification with convolutional neural networks", Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp.558~567 (2019)
- 이신애, "데이터 증대를 활용한 딥러닝 기반 위 병변 분류 시스템", 전기학회논문지, 69(7), pp.1033~1039 (2020), 대한전기학회
- Selvaraju, "Grad-cam: Visual explanations from deep networks via gradient-based localization", Proceedings of the IEEE international conference on computer vision, pp.618~626 (2017)