Deep learning improves implant classification by dental professionals: a multi-center evaluation of accuracy and efficiency
1
조회
0
다운로드
3
인용
0
참고문헌
키워드
초록
Purpose: The aim of this study was to evaluate and compare the accuracy performance of dental professionals in the classification of different types of dental implant systems (DISs) using panoramic radiographic images with and without the assistance of a deep learning (DL) algorithm. Methods: Using a self-reported questionnaire, the classification accuracy of dental professionals (including 5 board-certified periodontists, 8 periodontology residents, and 31 dentists not specialized in implantology working at 3 dental hospitals) with and without the assistance of an automated DL algorithm were determined and compared. The accuracy, sensitivity, specificity, confusion matrix, receiver operating characteristic (ROC) curves, and area under the ROC curves were calculated to evaluate the classification performance of the DL algorithm and dental professionals. Results: Using the DL algorithm led to a statistically significant improvement in the average classification accuracy of DISs (mean accuracy: 78.88%) compared to that without the assistance of the DL algorithm (mean accuracy: 63.13%, P<0.05). In particular, when assisted by the DL algorithm, board-certified periodontists (mean accuracy: 88.56%) showed higher average accuracy than did the DL algorithm, and dentists not specialized in implantology (mean accuracy: 77.83%) showed the largest improvement, reaching an average accuracy similar to that of the algorithm (mean accuracy: 80.56%). Conclusions: The automated DL algorithm classified DISs with accuracy and performance comparable to those of board-certified periodontists, and it may be useful for dental professionals for the classification of various types of DISs encountered in clinical practice.
Abstract
Purpose: The aim of this study was to evaluate and compare the accuracy performance of dental professionals in the classification of different types of dental implant systems (DISs) using panoramic radiographic images with and without the assistance of a deep learning (DL) algorithm. Methods: Using a self-reported questionnaire, the classification accuracy of dental professionals (including 5 board-certified periodontists, 8 periodontology residents, and 31 dentists not specialized in implantology working at 3 dental hospitals) with and without the assistance of an automated DL algorithm were determined and compared. The accuracy, sensitivity, specificity, confusion matrix, receiver operating characteristic (ROC) curves, and area under the ROC curves were calculated to evaluate the classification performance of the DL algorithm and dental professionals. Results: Using the DL algorithm led to a statistically significant improvement in the average classification accuracy of DISs (mean accuracy: 78.88%) compared to that without the assistance of the DL algorithm (mean accuracy: 63.13%, P<0.05). In particular, when assisted by the DL algorithm, board-certified periodontists (mean accuracy: 88.56%) showed higher average accuracy than did the DL algorithm, and dentists not specialized in implantology (mean accuracy: 77.83%) showed the largest improvement, reaching an average accuracy similar to that of the algorithm (mean accuracy: 80.56%). Conclusions: The automated DL algorithm classified DISs with accuracy and performance comparable to those of board-certified periodontists, and it may be useful for dental professionals for the classification of various types of DISs encountered in clinical practice.
참고문헌 (24)
- Howe MS, "Long-term (10-year) dental implant survival: a systematic review and sensitivity meta-analysis", J Dent, 84, pp.9~21 (2019)
- Jokstad A, "Quality of dental implants", Int Dent J, 53, pp.409~443 (2003)
- Esposito M, "Interventions for replacing missing teeth : different types of dental implants", Cochrane Database Syst Rev, pp.CD003815~ (2014)
- Srinivasan M, "Dental implants in the elderly population : a systematic review and meta-analysis", Clin Oral Implants Res, 28, pp.920~930 (2017)
- Lee JH, "Incidence and pattern of implant fractures : a long-term follow-up multicenter study", Clin Implant Dent Relat Res, 20, pp.463~469 (2018)
- Lee DW, "Implant fracture failure rate and potential associated risk indicators: an up to 12-year retrospective study of implants in 5,124 patients", Clin Oral Implants Res, 30, pp.206~217 (2019)
- Simonis P, "Long-term implant survival and success : a 10-16-year follow-up of non-submerged dental implants", Clin Oral Implants Res, 21, pp.772~777 (2010)
- Jaarda MJ, "Geometric comparison of five interchangeable implant prosthetic retaining screws", J Prosthet Dent, 74, pp.373~379 (1995)
- Al-Wahadni A, "Dentists' most common practices when selecting an implant system", J Prosthodont, 27, pp.250~259 (2018)
- Jae-Hong Lee, "Diagnosis and prediction of periodontally compromised teeth using a deep learning-based convolutional neural network algorithm", Journal of Periodontal & Implant Science, 48(2), pp.114~123 (2018), 대한치주과학회
- Lee JH, "Detection and diagnosis of dental caries using a deep learning-based convolutional neural network algorithm", J Dent, 77, pp.106~111 (2018)
- Lee JH, "Diagnosis of cystic lesions using panoramic and cone beam computed tomographic images based on deep learning neural network", Oral Dis, 26, pp.152~158 (2020)
- Sukegawa S, "Deep neural networks for dental implant system classification", Biomolecules, 10, pp.984~ (2020)
- Takahashi T, "Identification of dental implants using deep learning-pilot study", Int J Implant Dent, 6, pp.53~ (2020)
- Hadj Saïd M, "Development of an artificial intelligence model to identify a dental implant from a radiograph", Int J Oral Maxillofac Implants, 36, pp.1077~1082 (2020)
- Kim JE, "Transfer learning via deep neural networks for implant fixture system classification using periapical radiographs", J Clin Med, 9, pp.1117~ (2020)
- Lee JH, "Efficacy of deep convolutional neural network algorithm for the identification and classification of dental implant systems, using panoramic and periapical radiographs: a pilot study", Medicine (Baltimore), 99, pp.e20787~ (2020)
- Kim JR, "Computerized bone age estimation using deep learning based program : evaluation of the accuracy and efficiency", AJR Am J Roentgenol, 209, pp.1374~1380 (2017)
- Sung J, "Added value of deep learning-based detection system for multiple major findings on chest radiographs : a randomized crossover study", Radiology, 299, pp.450~459 (2021)
- Schwendicke F, "Artificial intelligence in dental research: Checklist for authors, reviewers, readers", J Dent, 107, pp.103610~ (2021)
- Lee JH, "A performance comparison between automated deep learning and dental professionals in classification of dental implant systems from dental imaging: a multi-center study", Diagnostics (Basel), 10, pp.910~ (2020)
- Faes L, "Automated deep learning design for medical image classification by health-care professionals with no coding experience : a feasibility study", Lancet Digit Health, 1, pp.e232~e242 (2019)
- Waring J, "Automated machine learning : review of the state-of-the-art and opportunities for healthcare", Artif Intell Med, 104, pp.101822~ (2020)
- Lee DW, "Artificial intelligence in fractured dental implant detection and classification: evaluation using dataset from two dental hospitals", Diagnostics (Basel), 11, pp.233~ (2021)