Clinical validation of a deep-learning-based bone age software in healthy Korean children
2
조회
0
다운로드
0
인용
0
참고문헌
키워드
초록
Purpose: Bone age (BA) is needed to assess developmental status and growth disorders. We evaluated the clinical performance of a deep-learning-based BA software to estimate the chronological age (CA) of healthy Korean children.Methods: This retrospective study included 371 healthy children (217 boys, 154 girls), aged between 4 and 17 years, who visited the Department of Pediatrics for health check-ups between January 2017 and December 2018. A total of 553 left-hand radiographs from 371 healthy Korean children were evaluated using a commercial deep-learning-based BA software (BoneAge, Vuno, Seoul, Korea). The clinical performance of the deep learning (DL) software was determined using the concordance rate and Bland-Altman analysis via comparison with the CA.Results: A 2-sample <i>t</i>-test (<i>P</i><0.001) and Fisher exact test (<i>P</i>=0.011) showed a significant difference between the normal CA and the BA estimated by the DL software. There was good correlation between the 2 variables (<i>r</i>=0.96, <i>P</i><0.001); however, the root mean square error was 15.4 months. With a 12-month cutoff, the concordance rate was 58.8%. The Bland-Altman plot showed that the DL software tended to underestimate the BA compared with the CA, especially in children under the age of 8.3 years.Conclusion: The DL-based BA software showed a low concordance rate and a tendency to underestimate the BA in healthy Korean children.
Abstract
Purpose: Bone age (BA) is needed to assess developmental status and growth disorders. We evaluated the clinical performance of a deep-learning-based BA software to estimate the chronological age (CA) of healthy Korean children.Methods: This retrospective study included 371 healthy children (217 boys, 154 girls), aged between 4 and 17 years, who visited the Department of Pediatrics for health check-ups between January 2017 and December 2018. A total of 553 left-hand radiographs from 371 healthy Korean children were evaluated using a commercial deep-learning-based BA software (BoneAge, Vuno, Seoul, Korea). The clinical performance of the deep learning (DL) software was determined using the concordance rate and Bland-Altman analysis via comparison with the CA.Results: A 2-sample <i>t</i>-test (<i>P</i><0.001) and Fisher exact test (<i>P</i>=0.011) showed a significant difference between the normal CA and the BA estimated by the DL software. There was good correlation between the 2 variables (<i>r</i>=0.96, <i>P</i><0.001); however, the root mean square error was 15.4 months. With a 12-month cutoff, the concordance rate was 58.8%. The Bland-Altman plot showed that the DL software tended to underestimate the BA compared with the CA, especially in children under the age of 8.3 years.Conclusion: The DL-based BA software showed a low concordance rate and a tendency to underestimate the BA in healthy Korean children.
참고문헌 (22)
- Satoh M, "Bone age : assessment methods and clinical applications", Clin Pediatr Endocrinol, 24, pp.143~152 (2015)
- Chartrand G, "Deep learning : a primer for radiologists", Radiographics, 37, pp.2113~2131 (2017)
- Booz C, "Artificial intelligence in bone age assessment : accuracy and efficiency of a novel fully automated algorithm compared to the Greulich-Pyle method", Eur Radiol Exp, 4, pp.6~ (2020)
- Greulich WW, "Radiographic atlas of skeletal development of the hand and wrist" (1959), Stanford University Press
- Tanner JM, "Assessment of skeletal maturity and prediction of adult height (TW3 method)" (2001), W.B. Saunders
- Hao PY, "Skeletal bone age assessments for young children based on regression convolutional neural networks", Math Biosci Eng, 16, pp.6454~6466 (2019)
- Chai T, "Root mean square error(RMSE)or mean absolute error(MAE)?-Arguments against avoiding RMSE in the literature", Geosci Model Dev, 7, pp.1247~1250 (2014)
- Ramachandran N, "Diabetic retinopathy screening using deep neural network", Clin Exp Ophthalmol, 46, pp.412~416 (2018)
- Masood A, "Computer-assisted decision support system in pulmonary cancer detection and stage classification on CT images", J Biomed Inform, 79, pp.117~128 (2018)
- Yoo YJ, "Computeraided diagnosis of thyroid nodules via ultrasonography : initial clinical experience", Korean J Radiol, 19, pp.665~672 (2018)
- Polidori N, "Deciphering short stature in children", Ann Pediatr Endocrinol Metab, 25, pp.69~79 (2020)
- Yue S, "Genetic regulation of linear growth", Ann Pediatr Endocrinol Metab, 24, pp.2~14 (2019)
- Cameriere R, "Accuracy of three age estimation methods in children by measurements of developing teeth and carpals and epiphyses of the ulna and radius", J Forensic Sci, 57, pp.1263~1270 (2012)
- Kim JR, "Assessment of bone age in prepubertal healthy Korean children : comparison among the Korean standard bone age chart, Greulich-Pyle method, and Tanner-Whitehouse method", Korean J Radiol, 16, pp.201~205 (2015)
- Larson DB, "Performance of a deep-learning neural network model in assessing skeletal maturity on pediatric hand radiographs", Radiology, 287, pp.313~322 (2018)
- Lee H, "Fully automated deep learning system for bone age assessment", J Digit Imaging, 30, pp.427~441 (2017)
- Kim JR, "Computerized bone age estimation using deep learning based program : evaluation of the accuracy and efficiency", AJR Am J Roentgenol, 209, pp.1374~1380 (2017)
- Anthimopoulos M, "Lung pattern classification for interstitial lung diseases using a deep convolutional neural network", IEEE Trans Med Imaging, 35, pp.1207~1216 (2016)
- Lakhani P, "Deep learning at chest radiography : automated classification of pulmonary tuberculosis by using convolutional neural networks", Radiology, 284, pp.574~582 (2017)
- Boeyer ME, "Evidence of the non-linear nature of skeletal maturation", Arch Dis Child, 105, pp.631~638 (2020)
- Eitel KB, "Differences in bone age readings between pediatric endocrinologists and radiologists", Endocr Pract, 26, pp.328~331 (2020)
- Zhang J, "Maturation disparity between hand-wrist bones in a chinese sample of normal children : an analysis based on automatic BoneXpert and manual Greulich and Pyle atlas assessment", Korean J Radiol, 17, pp.435~442 (2016)