영상의 내포되어 있는 피사계 심도를 효율적으로 추출하기 위한 합성곱 기반의 인공 신경망 기법
Artificial Neural Network Method Based on Convolution to Efficiently Extract the DoF Embodied in Images
0
조회
0
다운로드
0
인용
0
참고문헌
키워드
초록
본 논문에서는 카메라의 포커싱과 아웃포커싱에 의해 이미지에서 뿌옇게 표현되는 피사계 심도(Depth of field, DoF) 영역을 효율적인 합성곱 신경망을 통해 찾는 방법을 제안한다. 우리의 접근방식은 RGB채널기반의 상호-상관 필터를 이용하여 DoF영역을 이미지로부터 효율적으로 분류하고, 합성곱 신경망 네트워크에 학습하기 위한 데이터를 구축하며, 이렇게 얻어진 데이터를 이용하여 이미지-DoF가중치 맵 데이터 쌍을 설정한다. 학습할 때 사용되는 데이터는 이미지와 상호-상관필터 기반으로 추출된 DoF 가중치 맵을 이용하며, 네트워크 학습 단계에서 수렴률을 높이기 위해스무딩을 과정을 한번 더 적용한 결과를 사용한다. 테스트 결과로 얻은 DoF 가중치 이미지는 입력 이미지에서 DoF영역을 안정적으로 찾아내며, 제안하는 방법은 DoF영역을 사용자의 ROI(Region of interest)로 활용하여 NPR렌더링, 객체 검출 등 다양한 곳에 활용이 가능하다.
Abstract
In this paper, we propose a method to find the DoF(Depth of field) that is blurred in an image by focusing and out-focusing the camera through a efficient convolutional neural network. Our approach uses the RGB channel-based cross-correlation filter to efficiently classify the DoF region from the image and build data for learning in the convolutional neural network. A data pair of the training data is established between the image and the DoF weighted map. Data used for learning uses DoF weight maps extracted by cross-correlation filters, and uses the result of applying the smoothing process to increase the convergence rate in the network learning stage. The DoF weighted image obtained as the test result stably finds the DoF region in the input image. As a result, the proposed method can be used in various places such as NPR(Non-photorealistic rendering) rendering and object detection by using the DoF area as the user's ROI(Region of interest).
참고문헌 (26)
- Gargallo, Pau, "Bayesian 3D modeling from images using multiple depth maps", 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05), 2, pp.885~891 (2005), IEEE
- Silberman, "Indoor segmentation and support inference from rgbd images", European conference on computer vision, pp.746~760 (2012), Springer
- Häne, "3D visual perception for self-driving cars using a multi-camera system:Calibration, mapping, localization, and obstacle detection", Image and Vision Computing, pp.14~27 (2017)
- Müller, K., "3-D video representation using depth maps", Proceedings of the IEEE, 99(4), pp.643~656 (2010)
- Häne, "Stereo depth map fusion for robot navigation", IEEE, 2011, 1618~1625
- Rafiee, Gholamreza, "Region-of-interest extraction in low depth of field images using ensemble clustering and difference of Gaussian approaches", Pattern Recognition, pp.2685~2699 (2013)
- Park, Jungwoo, "Extracting focused object from low depth-of-field image sequences", Visual Communications and Image Processing, pp.60771~ (2006)
- Simonyan, Karen, "Data-driven estimation of cloth simulation models", arXiv preprint arXiv:1409.1556, ~ (2014)
- Hadsell, Raia, "Learning long-range vision for autonomous off-road driving", Journal of Field Robotics, pp.120~144 (2009)
- Eigen, David, "Depth map prediction from a single image using a multi-scale deep network", Advances in neural information processing systems, pp.2366~2374 (2014)
- Laina, Iro, "Deeper depth prediction with fully convolutional residual networks", 2016 Fourth international conference on 3D vision (3DV), pp.239~248 (2016), IEEE
- Liu, "Deep convolutional neural fields for depth estimation from a single image", Proceedings of the IEEE conference on computer vision and pattern recognition, pp.5162~5170 (2015)
- Geiger, "Are we ready for autonomous driving? the kitti vision benchmark suite", 2012 IEEE Conference on Computer Vision and Pattern Recognition, pp.3354~3361 (2012)
- Li, "Megadepth : Learning single-view depth prediction from internet photos", Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp.2041~2050 (2018)
- Srinivasan, "Aperture supervision for monocular depth estimation", Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp.6393~6401 (2018)
- Suwajanakorn, "Depth from focus with your mobile phone", Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp.3497~3506 (2015)
- Barron, "Fast bilateral-space stereo for synthetic defocus", Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp.4466~4474 (2015)
- Ha, "High-quality depth from uncalibrated small motion clip", Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp.5413~5421 (2016)
- Micro-baseline stereo, "Joshi, Neel", 8~, pp.Technical Report MSR-TR-2014–73 (2014)
- Klose, Felix, "Sampling based scene-space video processing", ACM Transactions on Graphics (TOG), 34(4), pp.67~ (2015)
- Haeberli, Paul, "The accumulation buffer:hardware support for high-quality rendering", ACM SIGGRAPH computer graphics, 24(4), pp.309~318 (1990)
- Lee, Sungkil, "Real-time lens blur effects and focus control", ACM Transactions on Graphics (TOG), 29(4), pp.1~7 (2010)
- Kraus, Martin, "Depth‐of‐field rendering by pyramidal image processing", Computer graphics forum, 26(3), pp.645~654 (2007)
- Lee, Sungkil, "Real-time depth-of-field rendering using anisotropically filtered mipmap interpolation", IEEE Transactions on Visualization and Computer Graphics, 15(3), pp.453~464 (2009)
- Yang, Yang, "Virtual dslr: High quality dynamic depth-of-field synthesis on mobile platforms", Electronic Imaging, (18), pp.1~9 (2016)
- Dong, Chao, "Image super-resolution using deep convolutional networks", IEEE transactions on pattern analysis and machine intelligence, pp.295~307 (2015)