컨볼루션 뉴럴 네트워크와 키포인트 매칭을 이용한 짧은 베이스라인 스테레오 카메라의 거리 센싱 능력 향상
Improving Detection Range for Short Baseline Stereo Cameras Using Convolutional Neural Networks and Keypoint Matching
0
조회
0
다운로드
0
인용
0
참고문헌
키워드
초록
This study proposes a method to overcome the limited detection range of short-baseline stereo cameras (SBSCs). The proposed method includes two steps: (1) predicting an unscaled initial depth using monocular depth estimation (MDE) and (2) adjusting the unscaled initial depth by a scale factor. The scale factor is computed by triangulating the sparse visual keypoints extracted from the left and right images of the SBSC. The proposed method allows the use of any pre-trained MDE model without the need for additional training or data collection, making it efficient even when considering the computational constraints of small platforms. Using an open dataset, the performance of the proposed method was demonstrated by comparing it with other conventional stereobased depth estimation methods.
Abstract
This study proposes a method to overcome the limited detection range of short-baseline stereo cameras (SBSCs). The proposed method includes two steps: (1) predicting an unscaled initial depth using monocular depth estimation (MDE) and (2) adjusting the unscaled initial depth by a scale factor. The scale factor is computed by triangulating the sparse visual keypoints extracted from the left and right images of the SBSC. The proposed method allows the use of any pre-trained MDE model without the need for additional training or data collection, making it efficient even when considering the computational constraints of small platforms. Using an open dataset, the performance of the proposed method was demonstrated by comparing it with other conventional stereobased depth estimation methods.
참고문헌 (21)
- J. Kim, "Proactive Camera Attribute Control Using Bayesian Optimization for Illumination-Resilient Visual Navigation", IEEE Trans. Robot., 36(4), pp.1256~1271 (2020)
- J. Kim, "Dark Synthetic Vision : Lightweight Active Vision to Navigate in the Dark", IEEE Robot. Autom Lett., 6(1), pp.143~150 (2020)
- J. -R. Chang, "Pyramid Stereo Matching Network", Proc. of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp.5410~5418 (2018)
- J. -R. Chang, "Attention-Aware Feature Aggregation for Real-time Stereo Matching on Edge Devices", Proc. of Asian Conference on Computer Vision (ACCV), pp.1~16 (2020)
- C. Godard, "Digging into Self-Supervised Monocular Depth Prediction", Proc. of International Conference Computer Vision(ICCV), pp.3828~2838 (2019)
- H. Hirschmuller, "Stereo Processing by Semiglobal Matching and Mutual Information", IEEE Trans. Pattern Anal. Mach. Intell., 30(2), pp.328~341 (2008)
- A. Geiger, "Efficient Large-Scale Stereo Matching", Proc. of Asian Conference on Computer Vision(ACCV), pp.25~38 (2010)
- D. Sun, "PWC-Net : CNNs for Optical Flow Using Pyramid, Warping, and Cost Volume", Proc. of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp.8934~8943 (2018)
- A. Geiger, "Vision meets robotics : The KITTI dataset", Int. J. Rob. Res., 32(11), pp.1231~1237 (2013)
- Z. Li, "MegaDepth : Learning Single-View Depth Prediction from Internet Photos", Proc. of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp.2041~2050 (2018)
- R. Ranftl, "Vision Transformers for Dense Prediction", Proc. of the IEEE, 2021, 12179~12188
- D. Wofk, "Fast-Depth : Fast Monocular Depth Estimation on Embedded Systems", Proc. of International Conference on Robotics and Automation(ICRA), pp.6101~6108 (2019)
- J. -Y. Zhu, "Unpaired Image-to-Image Translation using Cycle-Consistent Adversarial Networks", Proc. of the IEEE International Conference on Computer Vision(ICCV), pp.2223~2232 (2017)
- X. Huang, "Multimodal Unsupervised Image-to-Image Translation", Proc. of the European Conference on Computer Vision(ECCV), pp.172~189 (2018)
- E. Rosten, "Faster and better : a machine learning approach to corner detection", IEEE Trans. Pattern Anal. Mach. Intell., 32(1), pp.105~119 (2008)
- P. F. Alcantarilla, "Fast Explicit Diffusion for Accelerated Features in Nonlinear Scale Spaces", Proc. of the 24th British Machine Vision Conference(BMVC), pp.1281~1298 (2013)
- A. Geiger, "StereoScan : Dense 3D Reconstruction in Real-time", Proc. of IEEE Intelligent Vehicles Symposium(IV), pp.963~968 (2011)