Two-dimensional camera and TOF sensor-based volume measurement system for automated object volume measuring
0
조회
0
다운로드
0
인용
0
참고문헌
키워드
초록
In smart systems such as smart factories and smart logistics centers, vision inspection or volume measurement automation systems that reverify the damage status and size of products are essential. Existing methods have limitations in that they use many sensors for development or require a large installation space, which results in high construction costs. Therefore, in this study, we propose an object-volume measurement system based on image segmentation using a two-dimensional (2D) camera and a time-of-flight (TOF) sensor. The proposed system captures product images using a 2D camera and determines the pixel area of the product using an image-segmentation model. The height of the product is then obtained using a TOF sensor, and the horizontal and vertical lengths of the object are output through a conversion equation that converts one pixel to millimeters based on the height information. The proposed system has the advantage of low construction costs because it does not require expensive equipment such as 3D cameras or radio detection and ranging (RADAR) and can be easily installed in various environments. Thus, it is possible to easily build a volume measurement system, even with a limited structure, contributing to logistics automation.
Abstract
In smart systems such as smart factories and smart logistics centers, vision inspection or volume measurement automation systems that reverify the damage status and size of products are essential. Existing methods have limitations in that they use many sensors for development or require a large installation space, which results in high construction costs. Therefore, in this study, we propose an object-volume measurement system based on image segmentation using a two-dimensional (2D) camera and a time-of-flight (TOF) sensor. The proposed system captures product images using a 2D camera and determines the pixel area of the product using an image-segmentation model. The height of the product is then obtained using a TOF sensor, and the horizontal and vertical lengths of the object are output through a conversion equation that converts one pixel to millimeters based on the height information. The proposed system has the advantage of low construction costs because it does not require expensive equipment such as 3D cameras or radio detection and ranging (RADAR) and can be easily installed in various environments. Thus, it is possible to easily build a volume measurement system, even with a limited structure, contributing to logistics automation.
참고문헌 (21)
- 오세운, "딥 러닝을 이용한 새로운 다중 객체 구별 방법", 전기학회논문지, 70(1), pp.168~175 (2021), 대한전기학회
- 원종운, "택배화물 자동 하역장비를 위한 딥러닝 기반의 화물 인식 알 고리즘", 한국지능시스템학회 논문지, 29(6), pp.430~436 (2019), 한국지능시스템학회
- X. Zhao, "BIM-based indoor mobile robot initialization for construction automation using object de-tection", Automation in Construction, 146, pp.104647~ (2023)
- T. Huang, "Demon-stration-guided reinforcement learning with efficient explo-ration for task automation of surgical robot", 2023 IEEE In-ternational Conference on Robotics and Automation, pp.4640~4647 (2023)
- Q. Chen, "The research status and prospect of machine vision inspection for 3D concrete print-ing", Journal of Information Technology in Civil Engineer-ing and Architecture, 15(5), pp.1~8 (2023)
- D. Lee, "Vision-based inspection of prefabricated components using camera poses: Addressing inherent limitations of image-based 3D reconstruction", Journal of Building Engineering, 64, pp.105710~ (2023)
- Y. Lyu, "Vision-based plane estimation and following for building inspection with auton-omous UAV", IEEE Transactions on Systems, Man, and Cybernetics : Systems, 53(12), pp.7475~7488 (2023)
- S. Minaee, "Image segmentation using deep learn-ing: A survey", IEEE Transactions on Pattern Analysis and Machine Intelligence, 44(7), pp.3523~3542 (2022)
- C. Yu, "Bise-net: Bilateral segmentation network for real-time semantic segmentation", Proceedings of the European Conference on Computer Vision, pp.334~349 (2018)
- D. Bolya, "Yolact: Real-time instance segmentation", Proceedings of the IEEE, 2019, 9156~9165
- P. Zheng, "Brain tumour segmentation based on an improved U-Net", BMC Medical Imaging, 22(1), pp.1~9 (2022)
- S. Saha Roy, "An automated liver tumour segmentation and classification model by deep learning based approaches", Computer Methods in Biomechanics and Biomedical Engineering : Im-aging & Visualization, 11(3), pp.638~650 (2023)
- 이수민, "딥러닝 기반 다양한 외벽에 강인한 균열 구획화 및 두께 측정 모델 개발", 한국통신학회논문지, 48(5), pp.554~566 (2023), 한국통신학회[DOI]
- L. Barazzetti, "Crack measurement: Devel-opment, testing and applications of an automatic image-based algorithm", ISPRS Journal of Photogrammetry and Remote Sensing, 64(3), pp.285~296 (2009)
- M. Kamari, "Vision-based volumetric meas-urements via deep learning-based point cloud segmentation for material management in jobsites", Automation in Con-struction, 121, pp.103430~ (2021)
- 원종운, "한대의 카메라에 기반한 직육면체의 부피 계측 방법", 정보과학회 컴퓨팅의 실제 논문지, 8(5), pp.562~573 (2002), 한국정보과학회
- 홍석주, "다중 깊이 카메라 기반 배 과실의 실시간 3차원 복원 및 부피 측정 기술 개발", 한국산학기술학회논문지, 24(10), pp.1~8 (2023), 한국산학기술학회[DOI]
- M. Khojastehnazhand, "Maturity detection and volume estimation of apricot using image processing technique", Scientia Horticulturae, 251, pp.247~251 (2019)
- D. M. Blei, "Latent dirichlet allocation", Journal of Machine Learning Research, pp.993~1022 (2003)
- J. L. Sidel, "Quanti-tative descriptive analysis", Descriptive Analysis in Sensory Evaluation, pp.287~318 (2018)
- "CAS"[URL]