객체 영역에 특화된 뎁스 추정 기반의 충돌방지 기술개발
Object-aware Depth Estimation for Developing Collision Avoidance System
0
조회
0
다운로드
0
인용
0
참고문헌
키워드
초록
Collision avoidance system is important to improve the robustness and functional safety of autonomous vehicles. This paper proposes an object-level distance estimation method to develop a collision avoidance system, and it is applied to golfcarts utilized in country club environments. To improve the detection accuracy, we continually trained an object detection model based on pseudo labels generated by a pre-trained detector. Moreover, we propose object-aware depth estimation (OADE) method which trains a depth model focusing on object regions. In the OADE algorithm, we generated dense depth information for object regions by utilizing detection results and sparse LiDAR points, and it is referred to as object-aware LiDAR projection (OALP). By using the OALP maps, a depth estimation model was trained by backpropagating more gradients of the loss on object regions. Experiments were conducted on our custom dataset, which was collected for the travel distance of 22 km on 54 holes in three country clubs under various weather conditions. The precision and recall rate were respectively improved from 70.5% and 49.1% to 95.3% and 92.1% after the continual learning with pseudo labels. Moreover, the OADE algorithm reduces the absolute relative error from 4.76% to 4.27% for estimating distances to obstacles.
Abstract
Collision avoidance system is important to improve the robustness and functional safety of autonomous vehicles. This paper proposes an object-level distance estimation method to develop a collision avoidance system, and it is applied to golfcarts utilized in country club environments. To improve the detection accuracy, we continually trained an object detection model based on pseudo labels generated by a pre-trained detector. Moreover, we propose object-aware depth estimation (OADE) method which trains a depth model focusing on object regions. In the OADE algorithm, we generated dense depth information for object regions by utilizing detection results and sparse LiDAR points, and it is referred to as object-aware LiDAR projection (OALP). By using the OALP maps, a depth estimation model was trained by backpropagating more gradients of the loss on object regions. Experiments were conducted on our custom dataset, which was collected for the travel distance of 22 km on 54 holes in three country clubs under various weather conditions. The precision and recall rate were respectively improved from 70.5% and 49.1% to 95.3% and 92.1% after the continual learning with pseudo labels. Moreover, the OADE algorithm reduces the absolute relative error from 4.76% to 4.27% for estimating distances to obstacles.
참고문헌 (22)
- H. Kang, "고령화 사회와 환대산업의 전망", Journal of Korea Entertainment Industry Association, 10(1), pp.10~16 (2018)
- M. Kim, "Demand Prediction Analysis of the Domestic Golf Courses Applying Exponential Smoothing Model", Korean Journal of Convergence Science(KJCS), 11(11), pp.113~131 (2022)
- J. Kim, "Design and Implementation of Android Based Golf Cart Autonomous Driving Simulation System", Proceedings of the Korea Information Processing Society Conference, 19(1), pp.843~845 (2012)
- J. Choi, "Autonomous Traveling of Unmanned Golf-Car using GPS and Vision System", Journal of the Korean Society for Precision Engineering, 26(6), pp.74~80 (2009)
- H. Park, "Development of Cost-effective Self-Driving Module for Golf Cart", Proceddings of Institude of Control, Robotics and Systems, pp.208~209 (2020)
- J. Kim, "Yolo v3-based Golf Course Environmental Object Detection Method", The Journal of Korean Institute of Communications and Information Sciences, pp.1164~1165 (2020)
- S. Ren, "Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networks", Proceedings of Advances in Neural Information Processing Systems, 28 (2015)
- T. Y. Lin, "Feature Pyramid Networks for Object Detection", Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp.2117~2125 (2017)
- N. Carion, "End-to-End Object Detection with Transformers", European Conference on Computer Vision (ECCV), pp.216~229 (2020)
- S. Bhat, "AdaBins: Depth Estimation Using Adaptive Bins", Proceedings of the IEEE, 2021, 4009~4018
- 송지민, "비지도학습 기반의 뎁스 추정을 위한 지식 증류 기법", 대한임베디드공학회논문지, 17(4), pp.209~215 (2022)
- D. Tsai, "Optimising the Selection of Samples for Robust Lidar Camera Calibration", Proceddings of 2021 IEEE International Intelligent Transportation Systems Conference (ITSC), pp.2631~2638 (2021)
- J. L. Bentley, "Multidimensional Binary Search Trees Used for Associative Searching", Communications of the ACM, 18, pp.509~517 (1975)
- J. Redmon, "You Only Look Once: Unified, Real-Time Object Detection", Proceedings of the IEEE, 2016, 779~788
- C. Wang, "CSPNet: A New Backbone that can Enhance Learning Capability of CNN", Proceedings of the IEEE, 2020, 390~391
- S. Liu, "Aggregation Network for Instance Segmentation", Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp.8759~8768 (2018)
- T. Lin, "Microsoft COCO: Common Objects in Context", Proceedings of European Conference on Computer Vision (ECCV), pp.740~755 (2014)
- M. Yang, "DenseASPP for Semantic Segmentation in Street Scenes", Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp.3684~3692 (2018)
- G. Huang, "Densely Connected Convolutional Networks", Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp.4700~4708 (2017)
- A. Geiger, "Are we Ready for Autonomous Driving? The KITTI Vision Benchmark Suite", Proceedings of 2012 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp.3354~3361 (2012)