수술 도구의 세분화와 행동 인식 기능이 탑재된 AI 서비스 개발
Development of AI Service with Surgical Tools Segmentation and Action Recognition
0
조회
0
다운로드
1
인용
0
참고문헌
키워드
초록
In this paper, we propose an artificial intelligence (AI) service that plays a supportive role in robot assisted-surgery using deep learning algorithm that have recently been spotlighted in several fields. The proposed AI service is equipped with the ability to segment surgical tools and the ability to recognize the behavior of surgical tools. In addition, such AI service is opened using public web page to make them easier for surgeons to use. Models mounted on AI service are segmentation deep learning model and action recognition deep learning model. The segmentation deep learning model showed a final mIoU performance of 0.867 for seven surgical tools, and the action recognition deep learning model shows an accuracy of 86.96% for the opening and closing actions of all surgical tools.
Abstract
In this paper, we propose an artificial intelligence (AI) service that plays a supportive role in robot assisted-surgery using deep learning algorithm that have recently been spotlighted in several fields. The proposed AI service is equipped with the ability to segment surgical tools and the ability to recognize the behavior of surgical tools. In addition, such AI service is opened using public web page to make them easier for surgeons to use. Models mounted on AI service are segmentation deep learning model and action recognition deep learning model. The segmentation deep learning model showed a final mIoU performance of 0.867 for seven surgical tools, and the action recognition deep learning model shows an accuracy of 86.96% for the opening and closing actions of all surgical tools.
참고문헌 (16)
- Olga Russakovsky, "Imagenet large scale visual recognition challenge", International journal of computer vision, 115(3), pp.211~252 (2015)
- Krizhevsky, Alex, "ImageNet classification with deep convolutional neural networks", Communications of the ACM, 60(6), pp.84~90 (2017)
- Simonyan, Karen, "Very deep convolutional networks for large-scale image recognition", arXiv preprint arXiv:1409.1556, ~ (2014)
- K. He, "Deep residual learning for image recognition", IEEE Conference on Computer Vision and Pattern Recognition(CVPR), pp.770~778 (2016)
- Christian Szegedy, "Going deeper with convolutions", Proceedings of the IEEE conference on computer vision and pattern recognition (2015)
- Gao Huang, "Densely connected convolutional networks", Proceedings of the IEEE conference on computer vision and pattern recognition (2017)
- Tan, Mingxing, "Efficientnet: Rethinking model scaling for convolutional neural networks", International Conference on Machine Learning. PMLR (2019)
- Long, Jonathan, "Fully convolutional networks for semantic segmentation", Proceedings of the IEEE conference on computer vision and pattern recognition (2015)
- Ronneberger, Olaf, "U-net:Convolutional networks for biomedical image segmentation", International Conference on Medical image computing and computer-assisted intervention (2015)
- Liang-Chieh Chen, "Semantic image segmentation with deep convolutional nets and fully connected crfs", arXiv preprint arXiv:1412.7062, ~ (2014)
- Liang-Chieh Chen, "Deeplab: Semantic image segmentation with deep convolutional nets, atrous convolution, and fully connected crfs", IEEE transactions on pattern analysis and machine intelligence, 40(4), pp.834~848 (2017)
- Liang-Chieh Chen, "Rethinking atrous convolution for semantic image segmentation", arXiv preprint arXiv:1706.05587, ~ (2017)
- Liang-Chieh Chen, "Encoder-decoder with atrous separable convolution for semantic image segmentation", Proceedings of the European conference on computer vision(ECCV) (2018)
- Saining Xie, "Aggregated residual transformations for deep neural networks", Proceedings of the IEEE conference on computer vision and pattern recognition (2017)
- Zagoruyko, Sergey, "Wide residual networks", arXiv preprint arXiv:1605.07146, ~ (2016)
- Bryan C. Russell, "LabelMe: a database and web-based tool for image annotation", International journal of computer vision, 77(1-3), pp.157~173 (2008)