무인수상선의 디지털 트윈 공간 재구성을 위한 이미지 보정 및 점군데이터 간의 매핑 프레임워크 설계
Design of a Mapping Framework on Image Correction and Point Cloud Data for Spatial Reconstruction of Digital Twin with an Autonomous Surface Vehicle
1
조회
0
다운로드
1
인용
0
참고문헌
키워드
초록
In this study, we present a mapping framework for 3D spatial reconstruction of digital twin model using navigation and perception sensors mounted on an Autonomous Surface Vehicle (ASV). For improving the level of realism of digital twin models, 3D spatial information should be reconstructed as a digitalized spatial model and integrated with the components and system models of the ASV. In particular, for the 3D spatial reconstruction, color and 3D point cloud data which acquired from a camera and a LiDAR sensors corresponding to the navigation information at the specific time are required to map without minimizing the noise. To ensure clear and accurate reconstruction of the acquired data in the proposed mapping framework, a image preprocessing was designed to enhance the brightness of low-light images, and a preprocessing for 3D point cloud data was included to filter out unnecessary data. Subsequently, a point matching process between consecutive 3D point cloud data was conducted using the Generalized Iterative Closest Point (G-ICP) approach, and the color information was mapped with the matched 3D point cloud data. The feasibility of the proposed mapping framework was validated through a field data set acquired from field experiments in a inland water environment, and its results were described.
Abstract
In this study, we present a mapping framework for 3D spatial reconstruction of digital twin model using navigation and perception sensors mounted on an Autonomous Surface Vehicle (ASV). For improving the level of realism of digital twin models, 3D spatial information should be reconstructed as a digitalized spatial model and integrated with the components and system models of the ASV. In particular, for the 3D spatial reconstruction, color and 3D point cloud data which acquired from a camera and a LiDAR sensors corresponding to the navigation information at the specific time are required to map without minimizing the noise. To ensure clear and accurate reconstruction of the acquired data in the proposed mapping framework, a image preprocessing was designed to enhance the brightness of low-light images, and a preprocessing for 3D point cloud data was included to filter out unnecessary data. Subsequently, a point matching process between consecutive 3D point cloud data was conducted using the Generalized Iterative Closest Point (G-ICP) approach, and the color information was mapped with the matched 3D point cloud data. The feasibility of the proposed mapping framework was validated through a field data set acquired from field experiments in a inland water environment, and its results were described.
참고문헌 (18)
- Campos, D. F., "Multidomain mapping for offshore asset inspection using an autonomous surface vehicle", 2020 IEEE International Conference on Autonomous Robot Systems and Competitions (ICARSC), pp.221~226 (2020), IEEE
- Feixiang, Z. H. U., "Research on Marine Buoy Surface Reconstruction Algorithm Based on Point Cloud Data", 2019 6th International Conference on Information Science and Control Engineering (ICISCE), pp.480~484 (2019), IEEE
- Heo, S. H., "A Preliminary Study for Development of Digital Twin Ship Technology Using Autonomous Surface Vehicle", 2023 20th International Conference on Ubiquitous Robots (UR), pp.255~260 (2023), IEEE
- Joung, J. H., "3D environment reconstruction using modified color ICP algorithm by fusion of a camera and a 3D laser range finder", IEEE, 2009, 3082~3088
- Jung, J. D., "Consistent mapping of marine structures with an autonomous surface vehicle using motion compensation and submap-based filtering", Ocean Engineering, 290, pp.116418~ (2023)
- Kaur, H., "A study for applications of histogram in image enhancement", International Journal of Engineering and Science(IJES)6(6), pp.59~63 (2017)
- Kim, H. G., "GP-ICP : Ground plane ICP for mobile robots", IEEE Access, 7, pp.76599~76610 (2019)
- Kusuma, B. N., "Improvement of the automatic gamma correction method in cloud image detection", Matrix : Journal Manajemen Teknologi dan Informatika, 12(3), pp.137~146 (2022)
- Leedekerken, J. C., "Mapping complex marine environments with autonomous surface craft", Experimental Robotics: The 12th International Symposium on Experimental Robotics, pp.525~539 (2010)
- Madusanka, N. S., "Digital twin in the maritime domain : A review and emerging trends", Journal of Marine Science and Engineering, 11(5), pp.1021~ (2023)
- Park, H. S., "A Study on Playback of Ship Collision Accident Using Free Running Model Test", Journal of the Society of Naval Architects of Korea, 60(6), pp.450~459 (2023)
- Sattler, F., "Real-time embedded reconstruction of dynamic objects for a 3D maritime situational awareness picture", European Workshop on Maritime Systems Resilience and Security (2022)
- Segal, A., "Generalized-icp", Robotics: science and systems, 2(4), pp.435~ (2009)
- Servos, J., "Multi-Channel Generalized-ICP : A robust framework for multi-channel scan registration", Robotics and Autonomous systems, 87, pp.247~257 (2017)
- Wang, P., "Research on comparison of LiDAR and camera in autonomous driving", Journal of Physics:Conference Series, 2093(1), pp.012032~ (2021)
- Zhang, T., "A new visual inertial simultaneous localization and mapping(SLAM)algorithm based on point and line features", Drones, 6(1), pp.23~ (2022)
- Zhao, X., "Fusion of 3D LIDAR and camera data for object detection in autonomous vehicle applications", IEEE Sensors Journal, 20(9), pp.4901~4913 (2020)