Application of reinforcement learning to fire suppression system of an autonomous ship in irregular waves
0
조회
0
다운로드
3
인용
0
참고문헌
키워드
초록
In fire suppression, continuous delivery of water or foam to the fire source is essential. The present study concerns fire suppression in a ship under sea condition, by introducing reinforcement learning technique to aiming of fire extinguishing nozzle, which works in a ship compartment with six degrees of freedom movement by irregular waves. The physical modeling of the water jet and compartment motion was provided using Unity 3D engine. In the reinforcement learning, the change of the nozzle angle during the scenario was set as the action, while the reward is proportional to the ratio of the water particle delivered to the fire source area. The optimal control of nozzle aiming for continuous delivery of water jet could be derived. Various algorithms of reinforcement learning were tested to select the optimal one, the proximal policy optimization.
Abstract
In fire suppression, continuous delivery of water or foam to the fire source is essential. The present study concerns fire suppression in a ship under sea condition, by introducing reinforcement learning technique to aiming of fire extinguishing nozzle, which works in a ship compartment with six degrees of freedom movement by irregular waves. The physical modeling of the water jet and compartment motion was provided using Unity 3D engine. In the reinforcement learning, the change of the nozzle angle during the scenario was set as the action, while the reward is proportional to the ratio of the water particle delivered to the fire source area. The optimal control of nozzle aiming for continuous delivery of water jet could be derived. Various algorithms of reinforcement learning were tested to select the optimal one, the proximal policy optimization.
참고문헌 (24)
- Beck, J. E., "Using a learning agent with a student model", International Conference on Intelligent Tutoring Systems, pp.6~15 (1998), Springer
- Brent, R. P., "Algorithms for Minimization without Derivatives" (1973), Prentice-Hall
- de Vos, J., "Assessment of the required subdivision index for autonomous ships based on equivalent safety", Assessment, 17~18 (2019)
- DeFilippo, M., "The remote explorer IV: an autonomous vessel for oceanographic research", OCEANS 2019-Marseille, pp.1~8 (2019)
- Department of Defense, "Interface Standard for Shipboard Systems: Ship Motion and Attitude (Metric), DOD-STD-1399(NAVY) Section 301A", Naval Sea Systems Command, ~ (1986)
- "Elkhart brass X-Stream" (2020)[URL]
- Fraize, J., "Multi-objective reliability-based design optimization of an autonomous sailing vessel", 29th International Ocean and Polar Engineering Conference. International Society of Offshore and Polar Engineers (2019)
- IMO, "Maritime safety committee (MSC) 100th session", ~ (2018)
- Juliani, A., "Unity: A General Platform for Intelligent Agents arXiv preprint arXiv 1809.02627", ~ (2018)
- Kim, J. B., "Research trends on PID control and reinforcement learning control an drone", J. Adv. Technol. Res, 4(1), pp.6~13 (2019)
- 고은수, "해양무인체계의 법적 지위에 관한 연구", 한국군사학논집, 75(3), pp.89~118 (2019), 화랑대연구소[DOI]
- Lee, G. I., "Standardization trend of IEC for self-operating ships", Proceedings of the Korean Institute of Navigation and Port Research Conference. Korean Institute of Navigation and Port Research, pp.222~224 (2019)
- Macklin, M., "Position based fluids", ACM Trans. Graph, 32(4), pp.1~12 (2013)
- McNeil, J. G., "Robotic fire suppression through autonomous feedback control", Fire Technol, 53, pp.1171~1199 (2017)
- Miyashita, T., "Modeling and analysis of water discharge trajectory with large capacity monitor", Fire Saf. J, 63, pp.1~8 (2014)
- "ML-Agents" (2020)[URL]
- Mnih, V., "Asynchronous Methods for Deep Reinforcement Learning", ArXiv preprint arXiv:1602.01783, ~ (2016)
- "Obi user manual" (2020)[URL]
- Perez, T., "Ship Motion Control: Course Keeping and Roll Stabilisation Using Rudder and Fins" (2006), Springer Science & Business Media
- Sin, I. S., "Special Report-Trends in standardization of autonomous transport ships", TTA J, 36(42) (2018)
- "SM-1250 SERIES REACH" (2020)[URL]
- Tang, H., "A model for vessel trajectory prediction based on long short-term memory neural network", J. Mar. Eng. Technol, 1(10) (2019)
- "Unity"[URL]
- Yoon, M. O., "Expansion of the application of autonomous firefighting facilities and fire suppression strategy improvement plan for the reduction of fire damage", J. Kor. Inst. Fire Sci. Eng (2019)