소량 데이터 딥러닝 기반 강판 표면 결함 검출 시스템 개발
Development of a Steel Plate Surface Defect Detection System Based on Small Data Deep Learning
2
조회
0
다운로드
1
인용
0
참고문헌
키워드
초록
Collecting and labeling sufficient training data, which is essential to deep learning-based visual inspection, is difficult for manufacturers to perform because it is very expensive. This paper presents a steel plate surface defect detection system with industrial-grade detection performance by training a small amount of steel plate surface images consisting of labeled and non-labeled data. To overcome the problem of lack of training data, we propose two data augmentation techniques: program-based augmentation, which generates defect images in a geometric way, and generative model-based augmentation, which learns the distribution of labeled data. We also propose a 4-step semi-supervised learning using pseudo labels and consistency training with fixed-size augmentation in order to utilize unlabeled data for training. The proposed technique obtained about 99% defect detection performance for four defect types by using 100 real images including labeled and unlabeled data.
Abstract
Collecting and labeling sufficient training data, which is essential to deep learning-based visual inspection, is difficult for manufacturers to perform because it is very expensive. This paper presents a steel plate surface defect detection system with industrial-grade detection performance by training a small amount of steel plate surface images consisting of labeled and non-labeled data. To overcome the problem of lack of training data, we propose two data augmentation techniques: program-based augmentation, which generates defect images in a geometric way, and generative model-based augmentation, which learns the distribution of labeled data. We also propose a 4-step semi-supervised learning using pseudo labels and consistency training with fixed-size augmentation in order to utilize unlabeled data for training. The proposed technique obtained about 99% defect detection performance for four defect types by using 100 real images including labeled and unlabeled data.
참고문헌 (39)
- C. Shorten, "A Survey on Image Data Augmentation for Deep Learning", J Big Data, 6(1), pp.1~48 (2019)
- Y. Wang, "Generalizing from a Few Examples : A Survey on Few-shot Learning", ACM Comput. Surv, 53(3), pp.1~3 (2021)
- K. Weiss, "A Survey of Transfer Learning", J Big Data, 3(1), pp.1~40 (2016)
- S. Bernhard, "Analysis of Representations for Domain Adaptation", Advances in Neural Information Processing Systems 19: Proceedings of the 2006 Conference, pp.137~144 (2007), MIT Press
- M. Khanam, "A Survey on Unsupervised Machine Learning Algorithms for Automation, Classification and Maintenance", International Journal of Computer Applications, 119(13), pp.34~39 (2015)
- A. Jaiswal, "A Survey on Contrastive Self- Supervised Learning", Technologies, 9(1), pp.2~ (2021)
- J. E. Van Engelen, "A Survey on Semi-supervised Learning", Mach Learn, 109(2), pp.373~440 (2020)
- T. DeVries, "Improved Regularization of Convolutional Neural Networks with Cutout", arXiv : 1708. 04552, ~ (2017)
- H. Zhang, "mixup : Beyond Empirical Risk Minimization", arXiv : 1710. 09412, ~ (2017)
- A. Bochkovskiy, "YOLOv4 : Optimal Speed and Accuracy of Object Detection", arXiv:2004.10934, ~ (2020)
- G. Ghiasi, "Simple Copy-Paste is a Strong Data Augmentation Method for Instance Segmentation", Proceedings of the IEEE, 2021, 2918~2928
- B. Christopher, "GAN Augmentation: Augmenting Training data Using Generative Adversarial Networks", arXiv preprint, ~ (2018)
- A. Antoniou, "Data Augmentation Generative Adversarial Networks", Proceedings of the International Conference on Learning Representations Workshops (ICLR Workshops) (2018)
- M. Arjovsky, "Wasserstein GAN", arXiv:1701.07875, ~ (2017)
- Y. Xian, "Feature Generating Networks for Zero-shot Learning", CVPR (2018)
- Y. Wang, "Generalizing from a Few Examples: A Survey on Few-Shot Learning", ACM Computing Surveys, 53(3), pp.1~34 (2020)
- D. Kim, "Learning Image Representations by Completing Damaged Jigsaw Puzzles", 2018 IEEE Winter Conference on Applications of Computer Vision (WACV), pp.793~802 (2018)
- S. Gidaris, "Unsupervised Representation Learning by Predicting Image Rotations", 6th International Conference on Learning Representations (ICLR) (2018)
- L. Songtao, "Self-EMD: Self-Supervised Object Detection Wthout ImageNet", ArXiv abs, 2020 (2011)
- D. H. Lee, "Pseudo-Label : The Simple and Efficient Semi-Supervised Learning Method for Deep Neural Networks", ICML 2013 Workshop: Challenges in Representation Learning (WREPL), 3(2), pp.896~ (2013)
- S. Laine, "Temporal Ensembling for Semi-Supervised Learning", arXiv:1610.02242, ~ (2016)
- J. Jeong, "Consistency-based Semi-supervised Learning for Object Detection", NIPS'19: Proceedings of the 33rd International Conference on Neural Information Processing Systems, pp.10759~10768 (2019)
- A. Tarvainen, "Mean Teachers are Better Role Models: Weight-averaged Consistency Targets Improve Semi-supervised Deep Learning Results", NIPS'17: Proceedings of the 31st International Conference on Neural Information Processing Systems, pp.1195~1204 (2017)
- Q. Xie, "Unsupervised Data Augmentation for Consistency Training", Advances in Neural Information Processing Systems, 33, pp.6256~6268 (2020)
- D. Berthelot, "MixMatch: a Holistic Approach to Semi-supervised Learning", NIPS'19: Proceedings of the 33rd International Conference on Neural Information Processing Systems, pp.5049~5059 (2019)
- Q. Guo, "Scale-Equivalent Distillation for Semi-Supervised Object Detection", Proceedings of the IEEE, 2022, 14522~14531
- F. Guo, "Surface Defects Detection of Steel Plate Based on Visual Attention Mechanism", 2017 Chinese Automation Congress (CAC), pp.3174~3177 (2017)
- K. He, "Deep Residual Learning for Image Recognition", Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp.770~778 (2016)
- S. Ren, "Faster R-CNN:Towards Real-Time Object Detection with Region Proposal Networks", Advances in Neural Information Processing Systems, 28 (2015)
- S. Wang, "Automatic Detection and Classification of Steel Surface Defect Using Deep Convolutional Neural Networks", Metals, 11(3), pp.388~ (2021)
- D. Amin, "Deep Learning-Based Defect Detection System in Steel Sheet Surfaces", 2020 IEEE Region 10 Symposium (TENSYMP), pp.444~448 (2020)
- P. Damacharla, A. R. M. V, "TLU-Net: A Deep Learning Approach for Automatic Steel Surface Defect Detection", 2021International Conference on Applied Artificial Intelligence (ICAPAI), pp.1~6 (2021)
- A. M. Deshpande, "One-Shot Recognition of Manufacturing Defects in Steel Surfaces", Procedia Manufacturing, 48, pp.1064~1071 (2020)
- J. Božič, "Mixed Supervision for Surface-defect Detection: from Weakly to Fully Supervised Learning", Computers in Industry, 129, pp.103459~ (2021)
- "Jensen–Shannon Divergence"[URL]
- L. C. Chen, "Encoder-Decoder with Atrous Separable Convolution for Semantic Image Segmentation", Proceedings of the European Conference on Computer Vision (ECCV), pp.801~818 (2018)
- J. Hu, "Squeeze-and-Excitation Networks", Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (2018)
- "YOLOv5 v5.0 YOLOv5-P6 models"[URL]
- T. Y. Lin, "Focal Loss for Dense Object Detection", Proceedings of the IEEE International Conference on Computer Vision, pp.2980~2929 (2017)