Integration of Multi-scale CAM and Attention for Weakly Supervised Defects Localization on Surface Defective Apple
0
조회
0
다운로드
1
인용
0
참고문헌
키워드
초록
Weakly supervised object localization (WSOL) is a task of localizing an object in an image using only image-level labels. Previous studies have followed the conventional class activation mapping (CAM) pipeline. However, we reveal the current CAM approach suffers from problems which cause original CAM could not capture the complete defects features. This work utilizes a convolutional neural network (CNN) pretrained on image-level labels to generate class activation maps in a multi-scale manner to highlight discriminative regions. Additionally, a vision transformer (ViT) pretrained was treated to produce multi-head attention maps as an auxiliary detector. By integrating the CNN-based CAMs and attention maps, our approach localizes defective regions without requiring bounding box or pixel-level supervision during training. We evaluate our approach on a dataset of apple images with only image-level labels of defect categories. Experiments demonstrate our proposed method aligns with several Object Detection models performance, hold a promise for improving localization.
Abstract
Weakly supervised object localization (WSOL) is a task of localizing an object in an image using only image-level labels. Previous studies have followed the conventional class activation mapping (CAM) pipeline. However, we reveal the current CAM approach suffers from problems which cause original CAM could not capture the complete defects features. This work utilizes a convolutional neural network (CNN) pretrained on image-level labels to generate class activation maps in a multi-scale manner to highlight discriminative regions. Additionally, a vision transformer (ViT) pretrained was treated to produce multi-head attention maps as an auxiliary detector. By integrating the CNN-based CAMs and attention maps, our approach localizes defective regions without requiring bounding box or pixel-level supervision during training. We evaluate our approach on a dataset of apple images with only image-level labels of defect categories. Experiments demonstrate our proposed method aligns with several Object Detection models performance, hold a promise for improving localization.
참고문헌 (34)
- X. Zhang, "Adversarial Complementary Learning for Weakly Supervised Object Localization", Proceedings of the IEEE conference on computer vision and pattern recognition (2019)
- B. Zhou, "Learning deep features for discriminative localization", Proceedings of the IEEE conference on computer vision and pattern recognition (2016)
- A. Krizhevsky, "ImageNet Classification with Deep Convolutional Neural Networks", Advances in neural information processing systems, 25 (2012)
- K. Simonyan, "Very deep convolutional networks for large-scale image recognition" (2014)
- J. Long, "Do convnets learn correspondence?", Advances in neural information processing systems, 27 (2014)
- B. Wang, "Multi-scale low discriminative feature reactivation for weakly supervised object localization", IEEE Transactions on Image Processing, 30, pp.6050~6065 (2021)
- X. Zhou, "Master-CAM: Multi-scale fusion guided by Master map for high-quality class activation maps", Displays, 76, pp.102339~ (2023)
- A. Dosovitskiy, "An Image is Worth 16x16 Words: Transformers for Image Recognition at Scale" (2020)
- T.-Y. Lin, "Microsoft COCO: Common Objects in Context", Computer Vision–ECCV 2014: 13th European Conference (2014)
- J. Deng, "ImageNet : A large-scale hierarchical image database", 2009 IEEE conference on computer vision and pattern recognition (2009)
- A. Kuznetsova, "The open images dataset v4: Unified image classification, object detection, and visual relationship detection at scale", International Journal of Computer Vision, 128(7), pp.1956~1981 (2020)
- W. Bae, "Rethinking class activation mapping for weakly supervised object localization", Computer Vision–ECCV 2020: 16th European Conference (2020)
- D. Zhang, "Weakly Supervised Object Localization and Detection : A Survey", IEEE transactions on pattern analysis and machine intelligence, 44(9), pp.5866~5885 (2021)
- R. R. Selvaraju, "Grad-CAM: Visual Explanations from Deep Networks via Gradient-based Localization", Proceedings of the IEEE international conference on computer vision (2017)
- K. K. Singh, "Hide-and-Seek: Forcing a Network to be Meticulous for Weakly-supervised Object and Action Localization", Proceedings of the IEEE International Conference on Computer Vision (2017)
- Z. W. Haofan Wang, "Score-CAM: Score-Weighted Visual Explanations for Convolutional Neural Networks", Proceedings of the IEEE, 2020, ~
- X. Zhang, "Self-produced Guidance for Weakly-supervised Object Localization", Proceedings of the European conference on computer vision (ECCV) (2018)
- J. Choe, "Attention-based Dropout Layer for Weakly Supervised Object Localization", Proceedings of the IEEE, 2019, ~
- H. Xue, "DANet: Divergent Activation for Weakly Supervised Object Localization", Proceedings of the IEEE, 2019, ~
- S. Desai, "Ablation-CAM: Visual Explanations for Deep Convolutional Network via Gradient-free Localization", Proceedings of the IEEE, 2020, ~
- B. Zhou, "Object Detectors Emerge in Deep Scene CNNs" (2014)
- X. Ma, "MS-CAM: Multi-Scale Class Activation Maps for Weakly-Supervised Segmentation of Geographic Atrophy Lesions in SD-OCT Images", IEEE Journal of Biomedical and Health Informatics, 24(12), pp.3443~3455 (2020)
- T. Liu, "An Explainable Laser Welding Defect Recognition Method Based on Multi-Scale Class Activation Mapping", IEEE Transactions on Instrumentation and Measurement, 71, pp.1~12 (2022)
- C. Robinson, "Large Scale High-Resolution Land Cover Mapping with Multi-Resolution Data", Proceedings of the IEEE, 2019, ~
- K. KC, "Impacts of background removal on convolutional neural networks for plant disease classification in-situ", Agriculture, 11(9), pp.827~ (2021)
- K. He, "Deep Residual Learning for Image Recognition", Proceedings of the IEEE conference on computer vision and pattern recognition (2016)
- M. Tan, "EfficientNet: Rethinking Model Scaling for Convolutional Neural Networks", In International conference on machine learning (2019)
- C. Szegedy, "Rethinking the Inception Architecture for Computer Vision", Proceedings of the IEEE conference on computer vision and pattern recognition (2015)
- H. Zhao, "Pyramid Scene Parsing Network", Proceedings of the IEEE conference on computer vision and pattern recognition (2017)
- G. Lin, "RefineNet: Multi-Path Refinement Networks for High-Resolution Semantic Segmentation", Proceedings of the IEEE conference on computer vision and pattern recognition (2016)
- K. H. R. G. J. S. Shaoqing Ren, "Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networks", Advances in neural information processing systems (2015)
- T.-Y. Lin, "Focal Loss for Dense Object Detection", Proceedings of the IEEE international conference on computer vision (2017)
- D. A. D. E. Wei Liu, "SSD: Single Shot MultiBox Detector", Computer Vision–ECCV 2016: 14th European Conference (2016)
- Caron, Mathilde, "Emerging properties in self-supervised vision transformers", Proceedings of the IEEE, 2021, ~