심층강화학습 기반 자율주행차량의 차로변경 방법론
Lane Change Methodology for Autonomous Vehicles Based on Deep Reinforcement Learning
0
조회
0
다운로드
1
인용
0
참고문헌
키워드
초록
현재 국내에서는 자율주행차량의 상용화를 목표로 다양한 노력을 기울이고 있으며 자율주행차량이 운영 가이드라인에 따라 안전하고 신속하게 주행할 수 있는 연구들이 대두되고 있다. 본 연구는 자율주행차량의 경로탐색을 미시적인 관점으로 바라보며 Deep Q-Learning을 통해 자율주행차량의 차로변경을 학습시켜 효율성을 입증하고자 한다. 이를 위해 SUMO를 사용하였으며, 시나리오는 출발지에서 랜덤 차로로 출발하여 목적지의 3차로까지 차로변경을 통해우회전하는 것으로 설정하였다. 연구 결과 시뮬레이션 기반의 차로변경과 Deep Q-Learning을적용한 시뮬레이션 기반의 차로변경으로 구분하여 분석하였다. 평균 통행 속도는 Deep Q-Learning을 적용한 시뮬레이션의 경우가 적용하지 않은 경우에 비해 약 40% 향상되었으며평균 대기 시간은 약 2초, 평균 대기 행렬 길이는 약 2.3대 감소하였다.
Abstract
Several efforts in Korea are currently underway with the goal of commercializing autonomous vehicles. Hence, various studies are emerging on autonomous vehicles that drive safely and quickly according to operating guidelines. The current study examines the path search of an autonomous vehicle from a microscopic viewpoint and tries to prove the efficiency required by learning the lane change of an autonomous vehicle through Deep Q-Learning. A SUMO was used to achieve this purpose. The scenario was set to start with a random lane at the starting point and make a right turn through a lane change to the third lane at the destination. As a result of the study, the analysis was divided into simulation-based lane change and simulation-based lane change applied with Deep Q-Learning. The average traffic speed was improved by about 40% in the case of simulation with Deep Q-Learning applied, compared to the case without application, and the average waiting time was reduced by about 2 seconds and the average queue length by about 2.3 vehicles.
참고문헌 (19)
- 장경진, "협조운용을 적용한 자율주행 차선변경에 관한 연구", 한국콘텐츠학회 논문지, 21(1), pp.139~146 (2021), 한국콘텐츠학회[DOI]
- Choi, Y. G., "Lane Change and Path Planning of Autonomous Vehicles using GIS", 12th International Conference on Ubiquitous Robots and Ambient Intelligence (URAI), pp.163~166 (2015)
- Deutsches Zentrum für Luft- und Raumfahrt e.V.(DLR), "Microscopic modeling of traffic flow : Investigation of collision free vehicle dynamics", 55(5), pp.5597~ (1998)
- "Eclipse SUMO"[URL]
- "Eclipse SUMO"[URL]
- Erdmann, J., "Modeling Mobility with Open Data, SUMO’s lane-changing model", pp.105~123 (2015), Springer
- Route Selection and Speed Control of Autonomous Vehicles Based on Decentralized Deep Reinforcement Learning, "Kang, M. S.", The Korean Institute of Communications and Information Sciences, 1501~1502 (2021)
- Kwon, J. U., "Path Planning Algorithm based on Dijkstra Using HD-map", The Korean Society of Automotive Engineers, pp.455~457 (2022)
- Li, Z., "Efficient Lane Change Path Planning based on Quintic splinefor Autonomous Vehicles", 2020 IEEE International Conference on Mechatronics and Automation (ICMA), pp.338~344 (2020)
- Lu, Q., "Impacts of autonomous vehicles on the urban fundamental diagram", 5th International Conference on Road and Rail Infrastructure, CETRA 2018, pp.1265~1271 (2018)
- "Ministry of Land, Infrastructure and Transport(MOLIT)"[URL]
- Mnih, V., "Playing atari with deep reinforcement learning", arXiv preprint arXiv:1312.5602, ~ (2013)
- National Highway Traffic Safety Administration(NHTSA), "A Framework for Automated Driving System Testable Cases and Scenarios", ~ (2018)
- Shim, Y. B., "A Study on the HD Map Editor for the HD Map based Path Planning", The Korean Society of Automotive Engineers, pp.513~517 (2020)
- Song, J., "Research on car-following model based on SUMO", The 7th IEEE, 2014, 47~55[DOI]
- Université Gustave Eiffel, "Reinforcement Learning Project", 1~12 (2021)
- Wang, F. J., "Evaluation of Freeway Traffic Management and Control Measures Based on SUMO", Journal of Physics: Conference Series, 1910, pp.012044~ (2021)[DOI]
- Wang, P., "A Reinforcement Learning Based Approach for Automated Lane Change Maneuvers", Proc. IEEE Intelligent Vehicles Symposium, 2018(2), pp.1379~1384 (2018)
- Ye, F., "Automated Lane Change Strategy using Proximal Policy Optimization-based Deep Reinforcement Learning", Proc. IEEE Intelligent Vehicles Symposium, pp.1746~1752 (2020)