Mapless Navigation with Distributional Reinforcement Learning
0
조회
0
다운로드
0
인용
0
참고문헌
키워드
초록
This paper provides a study of distributional perspective on reinforcement learning for application in mobile robot navigation. Mapless navigation algorithms based on deep reinforcement learning are proven to promising performance and high applicability. The trial-and-error simulations in virtual environments are encouraged to implement autonomous navigation due to expensive real-life interactions. Nevertheless, applying the deep reinforcement learning model in real tasks is challenging due to dissimilar data collection between virtual simulation and the physical world, leading to high-risk manners and high collision rate. In this paper, we present distributional reinforcement learning architecture for mapless navigation of mobile robot that adapt the uncertainty of environmental change. The experimental results indicate the superior performance of distributional soft actor critic compared to conventional methods.
Abstract
This paper provides a study of distributional perspective on reinforcement learning for application in mobile robot navigation. Mapless navigation algorithms based on deep reinforcement learning are proven to promising performance and high applicability. The trial-and-error simulations in virtual environments are encouraged to implement autonomous navigation due to expensive real-life interactions. Nevertheless, applying the deep reinforcement learning model in real tasks is challenging due to dissimilar data collection between virtual simulation and the physical world, leading to high-risk manners and high collision rate. In this paper, we present distributional reinforcement learning architecture for mapless navigation of mobile robot that adapt the uncertainty of environmental change. The experimental results indicate the superior performance of distributional soft actor critic compared to conventional methods.
참고문헌 (11)
- J. Jin, "Mapless navigation among dynamics with socialsafety-awareness : a reinforcement learning approach from 2d laser scans", 2020 IEEE international conference on robotics and automation(ICRA), pp.6979~6985 (2020)
- "Crowdmove:Autonomous mapless navigation in crowded scenarios" (2018)[URL]
- L. Tai, "Virtual-to-real deep reinforcement learning : Continuous control of mobile robots for mapless navigation", 2017 IEEE, 2017, 31~36
- T. Haarnoja, "Soft actorcritic : Off-policy maximum entropy deep reinforcement learning with a stochastic actor", the 35th International Conference on Machine Learning, pp.1861~1870 (2018)
- W. Dabney, "Distributional reinforcement learning with quantile regression", AAAI Conference on Artificial Intelligence, 32(1) (2018)
- C. Liu, "Adaptive Risk-Tendency : Nano Drone Navigation in Cluttered Environments with Distributional Reinforcement Learning", 2023 IEEE International Conference on Robotics and Automation(ICRA), pp.7198~7204 (2023)
- J. Duan, "Distributional Soft Actor-Critic : Off-Policy Reinforcement Learning for Addressing Value Estimation Errors", IEEE Transactions on Neural Networks and Learning Systems, 33(11), pp.6584~6598 (2022)[DOI]
- W. Dabney, "Implicit quantile networks for distributional reinforcement learning", the 35th International Conference on Machine Learning, pp.1096~1105 (2018)
- W. Zhu, "A Hierarchical Deep Reinforcement Learning Framework With High Efficiency and Generalization for Fast and Safe Navigation", IEEE Transactions on Industrial Electronics, 70(5), pp.4962~4971 (2023)[DOI]
- M. Labbé, "Appearance-Based Loop Closure Detection for Online Large-Scale and Long-Term Operation", IEEE Transactions on Robotics, 29(3), pp.734~745 (2013)[DOI]