Impact of User’s Background Knowledge and Polyp Characteristics in Colonoscopy with Computer-Aided Detection
0
조회
0
다운로드
1
인용
0
참고문헌
키워드
초록
Background/Aims: We investigated how interactions between humans and computer-aided detection (CADe) systems are influenced by the user’s experience and polyp characteristics. Methods: We developed a CADe system using YOLOv4, trained on 16,996 polyp images from 1,914 patients and 1,800 synthesized sessile serrated lesion (SSL) images. The performance of polyp detection with CADe assistance was evaluated using a computerized test module. Eighteen participants were grouped by colonoscopy experience (nurses, fellows, and experts). The value added by CADe based on the histopathology and detection difficulty of polyps were analyzed. Results: The area under the curve for CADe was 0.87 (95% confidence interval [CI], 0.83 to 0.91). CADe assistance increased overall polyp detection accuracy from 69.7% to 77.7% (odds ratio [OR], 1.88; 95% CI, 1.69 to 2.09). However, accuracy decreased when CADe inaccurately detected a polyp (OR, 0.72; 95% CI, 0.58 to 0.87). The impact of CADe assistance was most and least prominent in the nurses (OR, 1.97; 95% CI, 1.71 to 2.27) and the experts (OR, 1.42; 95% CI, 1.15 to 1.74), respectively. Participants demonstrated better sensitivity with CADe assistance, achieving 81.7% for adenomas and 92.4% for easy-to-detect polyps, surpassing the standalone CADe performance of 79.7% and 89.8%, respectively. For SSLs and difficult-to-detect polyps, participants' sensitivities with CADe assistance (66.5% and 71.5%, respectively) were below those of standalone CADe (81.1% and 74.4%). Compared to the other two groups (56.1% and 61.7%), the expert group showed sensitivity closest to that of standalone CADe in detecting SSLs (79.7% vs 81.1%, respectively). Conclusions: CADe assistance boosts polyp detection significantly, but its effectiveness depends on the user’s experience, particularly for challenging lesions.
Abstract
Background/Aims: We investigated how interactions between humans and computer-aided detection (CADe) systems are influenced by the user’s experience and polyp characteristics. Methods: We developed a CADe system using YOLOv4, trained on 16,996 polyp images from 1,914 patients and 1,800 synthesized sessile serrated lesion (SSL) images. The performance of polyp detection with CADe assistance was evaluated using a computerized test module. Eighteen participants were grouped by colonoscopy experience (nurses, fellows, and experts). The value added by CADe based on the histopathology and detection difficulty of polyps were analyzed. Results: The area under the curve for CADe was 0.87 (95% confidence interval [CI], 0.83 to 0.91). CADe assistance increased overall polyp detection accuracy from 69.7% to 77.7% (odds ratio [OR], 1.88; 95% CI, 1.69 to 2.09). However, accuracy decreased when CADe inaccurately detected a polyp (OR, 0.72; 95% CI, 0.58 to 0.87). The impact of CADe assistance was most and least prominent in the nurses (OR, 1.97; 95% CI, 1.71 to 2.27) and the experts (OR, 1.42; 95% CI, 1.15 to 1.74), respectively. Participants demonstrated better sensitivity with CADe assistance, achieving 81.7% for adenomas and 92.4% for easy-to-detect polyps, surpassing the standalone CADe performance of 79.7% and 89.8%, respectively. For SSLs and difficult-to-detect polyps, participants' sensitivities with CADe assistance (66.5% and 71.5%, respectively) were below those of standalone CADe (81.1% and 74.4%). Compared to the other two groups (56.1% and 61.7%), the expert group showed sensitivity closest to that of standalone CADe in detecting SSLs (79.7% vs 81.1%, respectively). Conclusions: CADe assistance boosts polyp detection significantly, but its effectiveness depends on the user’s experience, particularly for challenging lesions.
참고문헌 (25)
- Kamitani Y, "Current status and future perspectives of artificial intelligence in colonoscopy", J Clin Med, 11, pp.2923~ (2022)
- Gong D, "Detection of colorectal adenomas with a real-time computer-aided system(ENDOANGEL) : a randomised controlled study", Lancet Gastroenterol Hepatol, 5, pp.352~361 (2020)
- Hassan C, "Performance of artificial intelligence in colonoscopy for adenoma and polyp detection : a systematic review and meta-analysis", Gastrointest Endosc, 93, pp.77~85 (2021)
- Repici A, "Efficacy of realtime computer-aided detection of colorectal neoplasia in a randomized trial", Gastroenterology, 159, pp.512~520 (2020)
- Wang P, "Real-time automatic detection system increases colonoscopic polyp and adenoma detection rates : a prospective randomised controlled study", Gut, 68, pp.1813~1819 (2019)
- Wang P, "Lower adenoma miss rate of computer-aided detection-assisted colonoscopy vs routine white-light colonoscopy in a prospective tandem study", Gastroenterology, 159, pp.1252~1261 (2020)
- Wang P, "Effect of a deep-learning computer-aided detection system on adenoma detection during colonoscopy(CADe-DB trial) : a double-blind randomised study", Lancet Gastroenterol Hepatol, 5, pp.343~351 (2020)
- Shiha MG, "Artificial intelligence–assisted colonoscopy for adenoma and polyp detection : an updated systematic review and meta-analysis", iGIE, 2, pp.333~343 (2023)
- Levy I, "Artificial intelligence-aided colonoscopy does not increase adenoma detection rate in routine clinical practice", Am J Gastroenterol, 117, pp.1871~1873 (2022)
- Quan SY, "Clinical evaluation of a realtime artificial intelligence-based polyp detection system : a US multi-center pilot study", Sci Rep, 12, pp.6598~ (2022)
- Ladabaum U, "Computer-aided detection of polyps does not improve colonoscopist performance in a pragmatic implementation trial", Gastroenterology, 164, pp.481~483 (2023)
- Nehme F, "Performance and attitudes toward real-time computer-aided polyp detection during colonoscopy in a large tertiary referral center in the United States", Gastrointest Endosc, 98, pp.100~109 (2023)
- Spadaccini M, "Comparing the number and relevance of false activations between 2 artificial intelligence computer-aided detection systems : the NOISE study", Gastrointest Endosc, 95, pp.975~981 (2022)
- Hassan C, "New artificial intelligence system : first validation study versus experienced endoscopists for colorectal polyp detection", Gut, 69, pp.799~800 (2020)
- Bae JH, "Improved real-time optical diagnosis of colorectal polyps following a comprehensive training program", Clin Gastroenterol Hepatol, 17, pp.2479~2488 (2019)
- Yoon D, "Colonoscopic image synthesis with generative adversarial network for enhanced detection of sessile serrated lesions using convolutional neural network", Sci Rep, 12, pp.261~ (2022)
- Shah S, "Effect of computeraided colonoscopy on adenoma miss rates and polyp detection : a systematic review and meta-analysis", J Gastroenterol Hepatol, 38, pp.162~176 (2023)
- Zhai H, "Radiation oncologists’ perceptions of adopting an artificial intelligence-assisted contouring technology : model development and questionnaire study", J Med Internet Res, 23, pp.e27122~ (2021)
- Bleijenberg AGC, "Substantial and sustained improvement of serrated polyp detection after a simple educational intervention : results from a prospective controlled trial", Gut, 69, pp.2150~2158 (2020)
- Lee J, "Impact of comprehensive optical diagnosis training using Workgroup serrAted polypS and Polyposis classification on detection of adenoma and sessile serrated lesion", Dig Endosc, 34, pp.180~190 (2022)
- Li D, "Diagnosis and predictors of sessile serrated adenoma after educational training in a large, community-based, integrated healthcare setting", Gastrointest Endosc, 87, pp.755~765 (2018)
- Shum NF, "A comprehensive training programme for nurse endoscopist performing flexible sigmoidoscopy in Hong Kong", J Clin Nurs, 19, pp.1891~1896 (2010)
- van Putten PG, "Nurse endoscopists perform colonoscopies according to the international standard and with high patient satisfaction", Endoscopy, 44, pp.1127~1132 (2012)
- Verschuur EM, "Nurses working in GI and endoscopic practice : a review", Gastrointest Endosc, 65, pp.469~479 (2007)
- Troya J, "Direct comparison of multiple computer-aided polyp detection systems", Endoscopy, 56, pp.63~69 (2024)