Image Signal Processing을 고려한 딥러닝 기반 저조도 이미지 처리
Deep Learning-Based Low-Light Imaging Considering Image Signal Processing
0
조회
0
다운로드
1
인용
0
참고문헌
키워드
초록
이 논문에서는 image signal processing 을 고려하여 저조도에서 촬영된 저품질의 raw 이미지를딥러닝에 기반하여 개선하는 방법을 제안한다. 스마트폰 카메라의 경우 DSLR 카메라에 비해 렌즈나 센서의 확장에 제약이 있어 저조도 상황에서 이미지에 노이즈가 증가되고 품질이 저하되는문제점을 보인다. 기존 딥러닝 기반 저조도 이미지 처리 방식은 image signal processing의 주요 요소인 렌즈 쉐이딩 효과와 화이트 밸런스를 고려하지 못하여 부자연스러운 이미지를 생성하기도한다. 본 논문에서는 렌즈 쉐이딩 효과와 화이트 밸런스를 딥러닝 모델에 적용하기 위해 중심거리와 채널 평균을 활용한다. 스마트폰으로 촬영된 저조도 이미지를 통한 실험에서 제안하는 방법이 기존 방법에 비해 더 높은 peak signal to noise ratio 와 structural similarity index measure를 달성함과 동시에 높은 품질의 저조도 이미지를 생성함을 확인한다.
Abstract
In this paper, we propose a method for improving raw images captured in a low light condition based on deep learning considering the image signal processing. In the case of a smart phone camera, compared to a DSLR camera, the size of a lens or sensor is limited, so the noise increases and the reduces the quality of images in low light conditions. Existing deep learning-based low-light image processing methods create unnatural images in some cases since they do not consider the lens shading effect and white balance, which are major factors in the image signal processing. In this paper, pixel distances from the image center and channel average values are used to consider the lens shading effect and white balance with a deep learning model. Experiments with low-light images taken with a smart phone demonstrate that the proposed method achieves a higher peak signal to noise ratio and structural similarity index measure than the existing method by creating high-quality low-light images.
참고문헌 (11)
- Abdelhamed, A., "A high-quality denoising dataset for smartphone cameras", Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp.1692~1700 (2018)
- Cepeda-Negrete, J, "Gray-world assumption on perceptual color spaces", Pacific-Rim Symposium on Image and Video Technology, pp.493~504 (2014)
- Chen, C, "Learning to see in the dark", Proceedings of the IEEE conference on computer vision and pattern recognition, pp.3291~3300 (2018)
- Guo, C., "Zero-reference deep curve estimation for low-light image enhancement", Proceedings of the IEEE, 2020, 1780~1789
- Ignatov, A., "Fast camera image denoising on mobile gpus with deep learning, mobile ai 2021 challenge: Report", Proceedings of the IEEE, 2021, 2515~2524
- Lim, B, "Enhanced deep residual networks for single image super-resolution", Proceedings of the IEEE conference on computer vision and pattern recognition workshops, pp.136~144 (2017)
- Lugmayr, A, "Srflow:Learning the super-resolution space with normalizing flow", European conference on computer vision, pp.715~732 (2020), Springer
- Ronneberger, O., "U-net:Convolutional networks for biomedical image segmentation", International Conference on Medical image computing and computer-assisted intervention, pp.234~241 (2015), Springer, Cham
- Z. Wang, "Image Quality Assessment: From Error Visibility to Structural Similarity", IEEE Transactions on Image Processing, 13(4), pp.600~612 (2004), Institute of Electrical and Electronics Engineers (IEEE)[DOI]
- Ian T. Young, "Shading Correction: Compensation for Illumination and Sensor Inhomogeneities", Current Protocols in Cytometry, 14(1) (2000), Wiley[DOI]
- Zhang, Y., "Image super-resolution using very deep residual channel attention networks", Proceedings of the European conference on computer vision (ECCV), pp.286~301 (2018)