딥 러닝 기반의 팬옵틱 분할 기법 분석
Survey on Deep Learning-based Panoptic Segmentation Methods
1
조회
0
다운로드
0
인용
0
참고문헌
키워드
초록
Panoptic segmentation, which is now widely used in computer vision such as medical image analysis, and autonomous driving, helps understanding an image with holistic view. It identifies each pixel by assigning a unique class ID, and an instance ID. Specifically, it can classify ‘thing’ from ‘stuff’, and provide pixel-wise results of semantic prediction and object detection. As a result, it can solve both semantic segmentation and instance segmentation tasks through a unified single model, producing two different contexts for two segmentation tasks. Semantic segmentation task focuses on how to obtain multi-scale features from large receptive field, without losing low-level features. On the other hand, instance segmentation task focuses on how to separate ‘thing’ from ‘stuff’ and how to produce the representation of detected objects. With the advances of both segmentation techniques, several panoptic segmentation models have been proposed. Many researchers try to solve discrepancy problems between results of two segmentation branches that can be caused on the boundary of the object. In this survey paper, we will introduce the concept of panoptic segmentation, categorize the existing method into two representative methods and explain how it is operated on two methods: top-down method and bottom-up method. Then, we will analyze the performance of various methods with experimental results.
Abstract
Panoptic segmentation, which is now widely used in computer vision such as medical image analysis, and autonomous driving, helps understanding an image with holistic view. It identifies each pixel by assigning a unique class ID, and an instance ID. Specifically, it can classify ‘thing’ from ‘stuff’, and provide pixel-wise results of semantic prediction and object detection. As a result, it can solve both semantic segmentation and instance segmentation tasks through a unified single model, producing two different contexts for two segmentation tasks. Semantic segmentation task focuses on how to obtain multi-scale features from large receptive field, without losing low-level features. On the other hand, instance segmentation task focuses on how to separate ‘thing’ from ‘stuff’ and how to produce the representation of detected objects. With the advances of both segmentation techniques, several panoptic segmentation models have been proposed. Many researchers try to solve discrepancy problems between results of two segmentation branches that can be caused on the boundary of the object. In this survey paper, we will introduce the concept of panoptic segmentation, categorize the existing method into two representative methods and explain how it is operated on two methods: top-down method and bottom-up method. Then, we will analyze the performance of various methods with experimental results.
참고문헌 (12)
- J. Long, "Fully Convolutional Networks for Semantic Segmentation", Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp.3431~3440 (2015)
- K. He, "Mask r-cnn", Proceedings of the IEEE International Conference on Computer Vision, pp.2961~2969 (2017)
- A. Kirillov, "Panoptic Segmentation", Proceedings of the IEEE, 2019, 9404~9413
- A. Kirillov, "Panoptic Feature Pyramid Networks", Proceedings of the IEEE, 2019, 6399~6408
- Y. Xiong, "Upsnet : A Unified Panoptic Segmentation Network", Proceedings of the IEEE, 2019, 8818~8826
- T. J. Yang, "Deeperlab : Single-shot Image Parser", arXiv preprint arXiv : 1902. 05093, ~ (2019)
- B. Cheng, "Panoptic-deeplab : A Simple, Strong, and Fast Baseline for Bottom-up Panoptic Segmentation", Proceedings of the IEEE, 2020, 12475~12485
- H. Wang, "Axial-deeplab : Stand-alone Axial-attention for Panoptic Segmentation", European Conference on Computer Vision, pp.108~126 (2020)
- T. Y. Lin, "Feature Pyramid Networks for Object Detection", Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp.2117~2125 (2017)
- H. Zhao, "Exploring Self-attention for Image Recognition", Proceedings of the IEEE, 2020, 10076~10085
- M. Cordts, "The Cityscapes Dataset for Semantic Urban Scene Understanding", Proceedings of the IEEE Conference on Computer Vision and Pattern Eecognition, pp.3213~3223 (2016)
- A. Veit, "Coco-text : Dataset and Benchmark for Text Detection and Recognition in Natural Images", arXiv preprint arXiv : 1601. 07140, ~ (2016)