딥러닝 기반의 Multi Scale Attention을 적용한 개선된 Pyramid Scene Parsing Network
Modified Pyramid Scene Parsing Network with Deep Learning based Multi Scale Attention
1
조회
0
다운로드
0
인용
0
참고문헌
키워드
초록
딥러닝의 발전으로 인하여 의미론적 분할 방법은 다양한 분야에서 연구되고 있다. 의료 영상 분석과 같이 정확성을 요구하는 분야에서 분할 정확도가 떨어지는 문제가 있다. 본 논문은 의미론적 분할 시 특징 손실을 최소화하기 위해 딥러닝 기반 분할 방법인 PSPNet을 개선하였다. 기존 딥러닝 기반의 분할 방법은 특징 추출 및 압축 과정에서 해상도가 낮아져 객체에 대한 특징 손실이 발생한다. 이러한 손실로 윤곽선이나 객체 내부 정보에 손실이 발생하여 객체 분류 시 정확도가 낮아지는 문제가 있다. 이러한 문제를 해결하기 위해 의미론적 분할 모델인 PSPNet을 개선하였다. 기존 PSPNet에 제안하는 multi scale attention을 추가하여 객체의 특징 손실을 방지하였다. 기존 PPM 모듈에 attention 방법을 적용하여 특징 정제 과정을 수행하였다. 불필요한 특징 정보를 억제함으로써 윤곽선 및 질감 정보가 개선되었다. 제안하는 방법은 Cityscapes 데이터 셋으로 학습하였으며, 정량적 평가를 위해 분할 지표인 MIoU를 사용하였다. 실험을 통해 기존 PSPNet 대비 분할 정확도가 약 1.5% 향상되었다.
Abstract
With the development of deep learning, semantic segmentation methods are being studied in various fields. There is a problem that segmenation accuracy drops in fields that require accuracy such as medical image analysis. In this paper, we improved PSPNet, which is a deep learning based segmentation method to minimized the loss of features during semantic segmentation. Conventional deep learning based segmentation methods result in lower resolution and loss of object features during feature extraction and compression. Due to these losses, the edge and the internal information of the object are lost, and there is a problem that the accuracy at the time of object segmentation is lowered. To solve these problems, we improved PSPNet, which is a semantic segmentation model. The multi-scale attention proposed to the conventional PSPNet was added to prevent feature loss of objects. The feature purification process was performed by applying the attention method to the conventional PPM module. By suppressing unnecessary feature information, eadg and texture information was improved. The proposed method trained on the Cityscapes dataset and use the segmentation index MIoU for quantitative evaluation. As a result of the experiment, the segmentation accuracy was improved by about 1.5% compared to the conventional PSPNet.
참고문헌 (15)
- 박찬수, "효율적인 객체 검출을 위해 Attention Process를 적용한 경량화 모델에 대한 연구", 디지털융복합연구, 19(5), pp.307~313 (2021), 한국디지털정책학회[DOI]
- 신석용, "딥러닝 기반의 Semantic Segmentation을 위한 Residual U-Net에 관한 연구", 디지털융복합연구, 19(6), pp.251~257 (2021), 한국디지털정책학회[DOI]
- Seokyong Shin, "Improved YOLOv3 with duplex FPN for object detection based on deep learning", The International Journal of Electrical Engineering & Education (2021), SAGE Publications[DOI]
- V. Badrinarayanan, "SegNet : A Deep Convolutional Encoder-Decoder Architecture for Image Segmentation", IEEE Transactions on Pattern Analysis and Machine Intelligence, 39(12), pp.2481~2495 (2017)
- E. Sovetkin, "Encoder–Decoder Semantic Segmentation Models for Electroluminescence Images of Thin-Film Photovoltaic Modules", IEEE Journal of Photovoltaics, 11(2), pp.444~452 (2021)
- E. Shelhamer, "Fully Convolutional Networks for Semantic Segmentation", IEEE Transactions on Pattern Analysis and Machine Intelligence, 39(4), pp.640~651 (2017)
- O. Ronneberger, "U-Net: Convolutional Networks for Biomedical Image Segmentation", Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics), 9351, pp.234~241 (2015)
- H. Zhao, "Pyramid Scene Parsing Network", 2017 IEEE Conference on Computer Vision and Pattern Recognition(CVPR) (2017)
- S. Woo, "CBAM: Convolutional block attention module", Lecture Notes in Computer Science (Including Subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics), 9, pp.3~19 (2018)
- Y. Su, "Semantic Segmentation of High Resolution Remote Sensing Image Based on Batch-Attention Mechanism", International Geoscience and Remote Sensing Symposium(IGARSS), pp.3856~3859 (2019)
- L. Sun, "Anatomical Attention Guided Deep Networks for ROI Segmentation of Brain MR Images", IEEE Transactions on Medical Imaging, 39(6), pp.2000~2012 (2020)
- A. Sinha, "Multi-Scale Self-Guided Attention for Medical Image Segmentation", IEEE Journal of Biomedical and Health Informatics, 25(1), pp.121~130 (2021)
- S. Xie, "Aggregated Residual Transformations for Deep Neural Networks", 2017 IEEE Conference on Computer Vision and Pattern Recognition(CVPR) (2017)
- Rethinking Atrous Convolution for Semantic Image Segmentation, "L. C. Chen", ~ (2017)
- L. C. Chen, "Encoder-decoder with atrous separable convolution for semantic image segmentation", Lecture Notes in Computer Science (Including Subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics), pp.833~851 (2018)