A Study on Ship Route Generation with Deep Q Network and Route Following Control
0
조회
0
다운로드
1
인용
0
참고문헌
키워드
초록
Ships need to ensure safety during their navigation, which makes route determination highly important. It must be accompanied by a route following controller that can accurately follow the route. This study proposes a method for automatically generating the ship route based on deep reinforcement learning algorithm and following it using a route following controller. To generate a ship route, under keel clearance was applied to secure the ship's safety and navigation chart information was used to apply ship navigation related regulations. For the experiment, a target ship with a draft of 8.23 m was designated. The target route in this study was to depart from Busan port and arrive at the pilot boarding place of the Ulsan port. As a route following controller, a velocity type fuzzy PID controller that could compensate for the limitation of a linear controller was applied. As a result of using the deep Q network, a route with a total distance of 62.22 km and 81 waypoints was generated. To simplify the route, the Douglas-Peucker algorithm was introduced to reduce the total distance to 55.67 m and the number of way points to 3. After that, an experiment was conducted to follow the path generated by the target ship. Experiment results revealed that the velocity type fuzzy PID controller had less overshoot and fast settling time. In addition, it had the advantage of reducing the energy loss of the ship because the change in rudder angle was smooth. This study can be used as a basic study of route automatic generation. It suggests a method of combining ship route generation with the route following control.
Abstract
Ships need to ensure safety during their navigation, which makes route determination highly important. It must be accompanied by a route following controller that can accurately follow the route. This study proposes a method for automatically generating the ship route based on deep reinforcement learning algorithm and following it using a route following controller. To generate a ship route, under keel clearance was applied to secure the ship's safety and navigation chart information was used to apply ship navigation related regulations. For the experiment, a target ship with a draft of 8.23 m was designated. The target route in this study was to depart from Busan port and arrive at the pilot boarding place of the Ulsan port. As a route following controller, a velocity type fuzzy PID controller that could compensate for the limitation of a linear controller was applied. As a result of using the deep Q network, a route with a total distance of 62.22 km and 81 waypoints was generated. To simplify the route, the Douglas-Peucker algorithm was introduced to reduce the total distance to 55.67 m and the number of way points to 3. After that, an experiment was conducted to follow the path generated by the target ship. Experiment results revealed that the velocity type fuzzy PID controller had less overshoot and fast settling time. In addition, it had the advantage of reducing the energy loss of the ship because the change in rudder angle was smooth. This study can be used as a basic study of route automatic generation. It suggests a method of combining ship route generation with the route following control.
참고문헌 (25)
- Chen, C., "A knowledge-free path planning approach for smart ships based on reinforcement learning", Ocean Engineering, 189, pp.106299~ (2019)
- Davidson, K. S. M., "Turning and course keeping qualities transactions of SNAME", ~ (1946)
- Guo, S., "Path planning of coastal ships based on optimized DQN reward function", Journal of Marine Science and Engineering, 9(2), pp.210~ (2021)
- He, S., "Fuzzy self-tuning of PID controllers", Fuzzy sets and systems, 56, pp.37~46 (1993)
- 김치효, "수중로봇의 롤 운동제어를 위한 모델 베이스 제어에 관한연구", 한국항해항만학회지, 33(5), pp.323~330 (2009), 한국항해항만학회
- 김대정, "자율운항선박의 항로추정성능 평가기법 개발에 관한 연구", 한국항해항만학회지, 47(1), pp.10~17 (2023), 한국항해항만학회
- 김홍태, "자율운항선박의 개발 및 운용을 위한 육상 운항사의 인적요인 이슈 고찰", 한국항해항만학회지, 43(6), pp.395~402 (2019), 한국항해항만학회[DOI]
- Kim, J. H., "A fuzzy PID controller for nonlinear and uncertain systems", Soft computing, 4, pp.312~129 (2000)
- 김민규, "퍼지 외란 추정기를 이용한 선박의 퍼지 PID형 오토파일럿 및 항로 추종", 한국마린엔지니어링학회지, 42(1), pp.49~57 (2018), 한국마린엔지니어링학회[DOI]
- 김성완, "Simplified rule-based strategy control for electric propulsion system", 한국마린엔지니어링학회지, 45(6), pp.380~385 (2021), 한국마린엔지니어링학회[DOI]
- 곽상필, "퍼지논리제어기 설계를 위한 새로운 비퍼지화 방법과 수치예를 통한 성능 분석", 한국지능시스템학회 논문지, 28(4), pp.350~354 (2018), 한국지능시스템학회
- Lee, H. T., "Generation of Ship’s Passage Plan Using Data-Driven Shortest Path Algorithms", IEEE Access, 10, pp.126217~126231 (2022)
- Lee, J. S., "Maritime traffic route detection framework based on statistical density analysis from AIS data using a clustering algorithm", IEEE Access, 10, pp.23355~23366 (2022)
- 윤현규, "자세제어장비를 장착한 선박의 파랑중 운동 모델링 및 시뮬레이션", 한국항해항만학회지, 28(4), pp.347~352 (2004), 한국항해항만학회
- 이원희, "해상 상태 및 선저여유수심을 고려한 연안 내 선박의 최적 항로 결정", 대한조선학회 논문집, 56(6), pp.480~487 (2019), 대한조선학회[DOI]
- Lie, C., "A-star algorithm considering water current, traffic separation and berthing for vessel path planning", Applied science, 9(6) (2019)
- Logan, C., "Using deep reinforcement learning to reveal how the brain encodes abstract state-space representations in high-dimensional environments", Neuron, 109(4), pp.724~738 (2021)
- Nam, S. K., "Fuzzy PID control with accelerated reasoning for DC servo motors", Engineering application of artificial intelligent, 7, pp.559~569 (1994)
- Novac, V., "Ship routing in the black sea based on Dijkstra algorithm", Proc. SGEM Int. Multidisciplinary Sci. GeoConf. EXPO, pp.301~308 (2020)
- Orsic, J. P., "The influence of route choice and operating conditions on fuel consumption and CO2 emission of ships", Journal of marine science and technology, 20, pp.434~457 (2016)
- Ozturk, U. G., "A review of path planning algorithms in maritime autonomous surface ships : navigation safety perspective", Ocean Engineering, 251 (2022)
- 노명일, "Determination of an economical shipping route considering the effects of sea state for lower fuel consumption", International Journal of Naval Architecture and Ocean Engineering, 5(2), pp.246~262 (2013), 대한조선학회
- Roland, S. B., "An intelligent integrated ship guidance system", IFAC proceedings, 25(3), pp.199~208 (1992)
- Wang, H., "A threedimensional Dijkstra's algorithm for multi-objective ship voyage optimization", Ocean engineering, 186 (2019)
- Zhao, L., "A method for simplifying ship trajectory based on improves Douglas-peucker algorithms", Ocean engineering, 166, pp.37~46 (2018)