로봇시스템에서 작은 마커 인식을 하기 위한 사물 감지 어텐션 모델
Small Marker Detection with Attention Model in Robotic Applications
1
조회
0
다운로드
0
인용
0
참고문헌
키워드
초록
As robots are considered one of the mainstream digital transformations, robots with machine vision becomes a main area of study providing the ability to check what robots watch and make decisions based on it. However, it is difficult to find a small object in the image mainly due to the flaw of the most of visual recognition networks. Because visual recognition networks are mostly convolution neural network which usually consider local features. So, we make a model considering not only local feature, but also global feature. In this paper, we propose a detection method of a small marker on the object using deep learning and an algorithm that considers global features by combining Transformer’s self-attention technique with a convolutional neural network. We suggest a self-attention model with new definition of Query, Key and Value for model to learn global feature and simplified equation by getting rid of position vector and classification token which cause the model to be heavy and slow. Finally, we show that our model achieves higher mAP than state of the art model YOLOr.
Abstract
As robots are considered one of the mainstream digital transformations, robots with machine vision becomes a main area of study providing the ability to check what robots watch and make decisions based on it. However, it is difficult to find a small object in the image mainly due to the flaw of the most of visual recognition networks. Because visual recognition networks are mostly convolution neural network which usually consider local features. So, we make a model considering not only local feature, but also global feature. In this paper, we propose a detection method of a small marker on the object using deep learning and an algorithm that considers global features by combining Transformer’s self-attention technique with a convolutional neural network. We suggest a self-attention model with new definition of Query, Key and Value for model to learn global feature and simplified equation by getting rid of position vector and classification token which cause the model to be heavy and slow. Finally, we show that our model achieves higher mAP than state of the art model YOLOr.
참고문헌 (22)
- J. Ruiz-del-Solar, "A survey on deep learning methods for robot vision", Computer Vision and Pattern Recognition (2018)
- Y. Wu, "The First International Symposium on Management and Social Sciences (ISMSS 2019)" (2019), Atlantis Press
- H. Liang, "Pointnetgpd: Detecting grasp configurations from point sets", 2019 International Conference on Robotics and Automation (ICRA), pp.3629~3635 (2019)
- A. Zeng, "Robotic pick-and-place of novel objects in clutter with multi-affordance grasping and cross-domain image matching", 2018 IEEE International Conference on Robotics and Automation (ICRA) (2018)
- Y. LeCun, "Backpropagation applied to handwritten zip code recognition", Neural Computation, 1(4), pp.541~551 (1989)[DOI]
- A. Bochkovskiy, "Yolov4 : Optimal speed and accuracy of object detection", Computer Vision and Pattern Recognition (2020)
- R. Joseph, "Yolov3: An incremental improvement", Computer Vision and Pattern Recognition (2018)
- W. Liu, "European Conference on Computer Vision", pp.21~37 (2016), Springer
- L. Deng, "RFBNet : deep multimodal networks with residual fusion blocks for RGB-D semantic segmentation", Computer Vision and Pattern Recognition (2019)
- B. Koonce, "Convolutional Neural Networks with Swift for Tensorflow", pp.109~123 (2021), Apress
- A. Ajaz, "Small Object Detection using Deep Learning", Computer Vision and Pattern Recognition (2022)
- F. O. Unel, "The power of tiling for small object detection", 2019 IEEE, 2019, ~
- T. Y. Lin, "Feature pyramid networks for object detection", 2017IEEE Conference on Computer Vision and Pattern Recognition (CVPR) (2017)
- A. Vaswani, "Attention is all you need", Computation and Language (2017)[DOI]
- H. Wu, "Cvt : Introducing convolutions to vision transformers", Computer Vision and Pattern Recognition (2021)
- A. Dosovitskiy, "An image is worth 16x16 words:Transformers for image recognition at scale", Computer Vision and Pattern Recognition (2020)
- C. Y. Wang, "You only learn one representation : Unified network for multiple tasks", Computer Vision and Pattern Recognition (2021)
- K. Wang, "Panet: Fewshot image semantic segmentation with prototype alignment", 2019 IEEE, 2019, ~
- J. Redmon, "You only look once: Unified, real-time object detection", 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) (2016)
- J. Redmon, "YOLO9000: better, faster, stronger", 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) (2017)
- R. R. Selvaraju, "Grad-cam: Visual explanations from deep networks via gradient-based localization", 2017 IEEE International Conference on Computer Vision (ICCV) (2017)
- S. M. Lundberg, "A unified approach to interpreting model predictions", Artificial Intelligence (2017)