딥러닝 기반의 Semantic Segmentation을 위한 DeepLabv3+에서 강조 기법에 관한 연구
A Study on Attention Mechanism in DeepLabv3+for Deep Learning-based Semantic Segmentation
2
조회
0
다운로드
0
인용
0
참고문헌
키워드
초록
본 논문에서는 정밀한 semantic segmentation을 위해 강조 기법을 활용한 DeepLabv3+ 기반의 인코더-디코더 모델을 제안하였다. DeepLabv3+는 딥러닝 기반 semantic segmentation 방법이며 자율주행 자동차, 적외선 이미지 분석 등의 응용 분야에서 주로 사용된다. 기존 DeepLabv3+는 디코더 부분에서 인코더의 중간 특징맵 활용이 적어 복원 과정에서 손실이 발생한다. 이러한 복원 손실은 분할 정확도를 감소시키는 문제를 초래한다. 따라서 제안하는 방법은 하나의 중간 특징맵을 추가로 활용하여 복원 손실을 최소화하였다. 또한, 추가 중간 특징맵을 효과적으로 활용하기 위해 작은 크기의 특징맵부터 계층적으로 융합하였다. 마지막으로, 디코더에 강조 기법을 적용하여 디코더의 중간 특징맵 융합 능력을 극대화하였다. 본 논문은 거리 영상 분할연구에 공통으로 사용되는 Cityscapes 데이터셋에서 제안하는 방법을 평가하였다. 실험 결과는 제안하는 방법이 기존 DeepLabv3+와 비교하여 향상된 분할 결과를 보였다. 이를 통해 제안하는 방법은 높은 정확도가 필요한 응용 분야에서 활용될 수 있다.
Abstract
In this paper, we proposed a DeepLabv3+ based encoder-decoder model utilizing an attention mechanism for precise semantic segmentation. The DeepLabv3+ is a semantic segmentation method based on deep learning and is mainly used in applications such as autonomous vehicles, and infrared image analysis. In the conventional DeepLabv3+, there is little use of the encoder's intermediate feature map in the decoder part, resulting in loss in restoration process. Such restoration loss causes a problem of reducing segmentation accuracy. Therefore, the proposed method firstly minimized the restoration loss by additionally using one intermediate feature map. Furthermore, we fused hierarchically from small feature map in order to effectively utilize this. Finally, we applied an attention mechanism to the decoder to maximize the decoder's ability to converge intermediate feature maps. We evaluated the proposed method on the Cityscapes dataset, which is commonly used for street scene image segmentation research. Experiment results showed that our proposed method improved segmentation results compared to the conventional DeepLabv3+. The proposed method can be used in applications that require high accuracy.
참고문헌 (16)
- 신석용, "딥러닝 기반의 Semantic Segmentation을 위한 Residual U-Net에 관한 연구", 디지털융복합연구, 19(6), pp.251~257 (2021), 한국디지털정책학회[DOI]
- S. Y. Shin, "Modified DeepLabV3+ for Semantic Segmentation based on Deep Learning", The 11th International Conference on Convergence Technology, pp.266~367 (2021), KCS
- Seokyong Shin, "Improved YOLOv3 with duplex FPN for object detection based on deep learning", The International Journal of Electrical Engineering & Education, pp.002072092098352~ (2021), SAGE Publications[DOI]
- Evan Shelhamer, "Fully Convolutional Networks for Semantic Segmentation", IEEE Transactions on Pattern Analysis and Machine Intelligence, 39(4), pp.640~651 (2017), Institute of Electrical and Electronics Engineers (IEEE)[DOI]
- O. Ronneberger, "U-Net: Convolutional Networks for Biomedical Image Segmentation", Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics), 9351, pp.234~241 (2015)
- Vijay Badrinarayanan, "SegNet: A Deep Convolutional Encoder-Decoder Architecture for Image Segmentation", IEEE Transactions on Pattern Analysis and Machine Intelligence, 39(12), pp.2481~2495 (2017), Institute of Electrical and Electronics Engineers (IEEE)[DOI]
- "Semantic Image Segmentation with Deep Convolutional Nets and Fully Connected CRFs" (2014)[URL]
- Liang-Chieh Chen, "DeepLab: Semantic Image Segmentation with Deep Convolutional Nets, Atrous Convolution, and Fully Connected CRFs", IEEE Transactions on Pattern Analysis and Machine Intelligence, 40(4), pp.834~848 (2018), Institute of Electrical and Electronics Engineers (IEEE)[DOI]
- "Rethinking Atrous Convolution for Semantic Image Segmentation" (2017)[URL]
- L. C. Chen, "Encoder-Decoder with Atrous Separable Convolution for Semantic Image Segmentation", Pertanika Journal of Tropical Agricultural Science, 34(1), pp.833~851 (2018)[DOI]
- Evgenii Sovetkin, "Encoder–Decoder Semantic Segmentation Models for Electroluminescence Images of Thin-Film Photovoltaic Modules", IEEE Journal of Photovoltaics, 11(2), pp.444~452 (2021), Institute of Electrical and Electronics Engineers (IEEE)[DOI]
- F. Chollet, "Xception: Deep Learning with Depthwise Separable Convolutions", 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp.1800~1807 (2017)
- K. He, "Deep Residual Learning for Image Recognition", Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition(CVPR) (2016)
- S. Estrada, "Competition vs. Concatenation in Skip Connections of Fully Convolutional Networks", International Workshop on Machine Learning in Medical Imaging, pp.214~222 (2018), Springer
- M. Cordts, "The Cityscapes Dataset for Semantic Urban Scene Understanding", 2016 IEEE Conference on Computer Vision and Pattern Recognition(CVPR), pp.3213~3223 (2016)
- I. Loshchilov, "Decoupled Weight Decay Regularization", 7th International Conference on Learning Representations (2019)