센서 융합 시스템을 이용한 심층 컨벌루션 신경망 기반 6자유도 위치 재인식
Deep Convolutional Neural Network Based 6-DOF Relocalization with Sensor Fusion System
0
조회
0
다운로드
1
인용
0
참고문헌
키워드
초록
This paper presents a 6-DOF relocalization using a 3D laser scanner and a monocular camera. A relocalization problem in robotics is to estimate pose of sensor when a robot revisits the area. A deep convolutional neural network (CNN) is designed to regress 6-DOF sensor pose and trained using both RGB image and 3D point cloud information in end-to-end manner. We generate the new input that consists of RGB and range information. After training step, the relocalization system results in the pose of the sensor corresponding to each input when a new input is received. However, most of cases, mobile robot navigation system has successive sensor measurements. In order to improve the localization performance, the output of CNN is used for measurements of the particle filter that smooth the trajectory. We evaluate our relocalization method on real world datasets using a mobile robot platform.
Abstract
This paper presents a 6-DOF relocalization using a 3D laser scanner and a monocular camera. A relocalization problem in robotics is to estimate pose of sensor when a robot revisits the area. A deep convolutional neural network (CNN) is designed to regress 6-DOF sensor pose and trained using both RGB image and 3D point cloud information in end-to-end manner. We generate the new input that consists of RGB and range information. After training step, the relocalization system results in the pose of the sensor corresponding to each input when a new input is received. However, most of cases, mobile robot navigation system has successive sensor measurements. In order to improve the localization performance, the output of CNN is used for measurements of the particle filter that smooth the trajectory. We evaluate our relocalization method on real world datasets using a mobile robot platform.
참고문헌 (16)
- R. Li, "Indoor Relocalization in Challenging Environments With Dual-Stream Convolutional Neural Networks", IEEE Transaction on Automation Science and Engineering, 15(2), pp.651~662 (2018)
- J. L. Schonberger, "Structure-from-Motion Revisited", 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp.4104~4113 (2016)
- D. Nistér, "Scalable recognition with a vocabulary tree", 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'06) (2006)
- A. Kendall, "PoseNet: A convolutional network for real-time 6-DOF camera relocalization", 2015 IEEE International Conference on Computer Vision (ICCV), pp.2938~2946 (2015)
- A. Kendall, "Modelling uncertainty in deep learning for camera relocalization", 2016 IEEE International Conference on Robotics and Automation (ICRA), pp.4762~4769 (2016)
- S. Thrun, "Robust Monte Carlo localization for mobile robots", Artificial Intelligence, 128(1-2), pp.99~141 (2001)
- R. Arandjelovi´c, "NetVLAD : CNN Architecture for Weakly Supervised Place Recognition", IEEE Transactions on Pattern Analysis and Machine Intelligence, 40(6), pp.1437~1451 (2018)
- J. Shotton, "Scene coordinate regression forests for cam- era relocalization in RGB-D images", 2013 IEEE Conference on Computer Vision and Pattern Recognition, pp.2930~2937 (2013)
- E. Brachmann, "DSAC – Differentiable RANSAC for Camera Localization", 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) (2017)
- Z. Chen, "Convolutional neural network-based place recognition", ~ (2014)
- R. Clark, "VidLoc:A Deep Spatio-Temporal Model for 6-DoF Video-Clip Relocalization", 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp.6856~6864 (2017)
- F. Walch, "Image-based localization using LSTMs for structured feature correlation", 2017 IEEE International Conference on Computer Vision (ICCV), pp.627~637 (2017)
- M. Velas, "Calibration of RGB Camera With Velodyne LiDAR", WSCG 2014, pp.135~144 (2014)
- H. Jo, "Multi-Resolution Point Cloud Generation Based on Heterogeneous Sensor Fusion System", 2017 14th International Conference on Ubiquitous Robots and Ambient Intelligence (URAI), pp.886~888 (2017)
- C. Szegedy, "Going deeper with convolutions", 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) (2015)
- H. Jo, "Efficient Grid-Based Rao-Blackwellized Particle Filter SLAM With Interparticle Map Sharing", IEEE Transactions on Mechatronics, 23(2), pp.714~724 (2018)