CPU-FPGA 구조를 이용한 실시간 FCWS 구현
Real-time FCWS implementation using CPU-FPGA architecture
0
조회
0
다운로드
1
인용
0
참고문헌
키워드
초록
최근 운전자의 편의와 안전을 위해 전방 차량 추돌 감지 시스템(Front Collision Warning System : FCWS)과 같은 다양한 운전자 보조 시스템(Advanced Driver Assistance System : ADAS)이 개발되고 있다. FCWS는 주행 중 실시간으로 동작해야 하기 때문에 높은 처리속도를 필요로 한다. 또한 자동차의 전장화에 따라 FCWS를 차량용 임베디드 시스템에서 동작시키기 위해 저전력 시스템이 필요하다. 본 논문에서는 FCWS를 CPU-FPGA 구조에서 실시간 처리가 가능하도록 구현하였다. 차선 검출은 Inverse Transform Perspective(IPM)와 슬라이딩 윈도우 방식을 이용하여 CPU에서도 빠른 속도로 동작할 수 있도록 하였다. 차량검출은 높은 인식률을 가지는 Convolutional Neural Network(CNN)을 이용하였고, FPGA에서 병렬처리로 가속하였다. 제안하는 구조는 저전력으로 동작하는 ARM-Core A9과 FPGA를 내장한 Intel FPGA Cyclone V SoC(System on Chip)에서 검증하였다. HD해상도에서 FCWS는 44FPS로 실시간으로 동작하며, 고성능 PC 환경보다 처리속도 대비 에너지 효율이 약 3.33배 높은 것을 확인했다.
Abstract
Advanced Driver Assistance Systems(ADAS), such as Front Collision Warning System (FCWS) are currently being developed. FCWS require high processing speed because it must operate in real time while driving. In addition, a low–power system is required to operate in an automobile embedded system. In this paper, FCWS is implemented in CPU-FPGA architecture in embedded system to enable real-time processing. The lane detection enabled the use of the Inverse Transform Perspective (IPM) and sliding window methods to operate at fast speed. To detect the vehicle, a Convolutional Neural Network (CNN) with high recognition rate and accelerated by parallel processing in FPGA is used. The proposed architecture was verified using Intel FPGA Cyclone V SoC(System on Chip) with ARM-Core A9 which operates in low power and on-board FPGA. The performance of FCWS in HD resolution is 44FPS, which is real time, and energy efficiency is about 3.33 times higher than that of high performance PC enviroment.
참고문헌 (20)
- "NHTSA Announces Model Year 2012 Vehicles to be Rated Under Government 5-Star Safety Ratings Program"[URL]
- Gao, Yongbin, "Vehicle Make Recognition Based on Convolutional Neural Network", Information Science and Security (ICISS), 2015 2nd International Conference on (2015), IEEE
- A. Krizhevsky, "ImageNet classification with deep convolutional neural networks", Proc. Neural Information Processing Systems (NIPS’12) (2012)
- Cuneyt Akinlar, "EDLines: A real-time line segment detector with a false detection control", Pattern Recognition Letters, 32(13), pp.1633~1642 (2011), Elsevier BV[DOI]
- X. Lu, "Cannylines: A parameter-free line segment detector", 2015 IEEE International Conference on Image Processing (ICIP), pp.507~511 (2015)
- Massimo Bertozzi, "Real-Time Lane and Obstacle Detection on the GOLD System", IEEE International Symposium on Computer Vision (1995)
- H.Tan, "A novel curve lane detection based on Improved River Flow and RANSAC", Intelligent Transportation Systems (ITSC), 2014 IEEE 17th International Conference on, pp.133~138 (2014), IEEE
- J.Wang, "An approach of lane detection based on Inverse Perspective Mapping", Intelligent Transportation Systems (ITSC), 2014 IEEE 17th International Conference on, pp.35~38 (2014), IEEE
- Kaur, Gurjyot, "Curved Lane Detection using Improved Hough Transform and CLAHE in a Multi-Channel ROI", International Journal of Computer Applications, 122(13) (2015)
- Nur Shazwani A, "Vehicle Detection Based on Underneath Vehicle Shadow Using Edge Features", 2016 6th IEEE International Conference on Control System, Computing and Engineering, pp.25~27 (2016)
- Corinna Cortes, "Support-vector networks", Machine Learning, 20(3), pp.273~297 (1995), Springer Nature[DOI]
- Hao Yu, "Vision-based Lane Marking Detection and Moving Vehicle Detection", 2016 8th International Conference on Intelligent Human-Machine Systems and Cybernetics (2016)
- Sungji Han, "Vehicle Detection Method Using Haar-like Feature on Real Time System", World Academy of Science, Engineering and Technology, 59 (2009)
- Zhipeng Di, "Forward Collision Warning System Based on Vehicle Detection and Tracking", 2016 International Conference on Optoelectronics and Image Processing (2016)
- Olga Russakovsky, "ImageNet Large Scale Visual Recognition Challenge", International Journal of Computer Vision, 115(3), pp.211~252 (2015), Springer Nature[DOI]
- D. Strigl, "Performance and scalability of gpu-based convolutional neural networks", Parallel, Distributed, and Network-Based Processing, Euromicro Conference on, pp.317~324 (2010)
- 김진수, "차량 장착 블랙박스 카메라를 이용한 효과적인 도로의 거리예측방법", 한국정보통신학회논문지, 19(3), pp.651~658 (2015), 한국정보통신학회[DOI]
- "Accelerating Genomics Research with OpenCL™ and FPGAs"[URL]
- 김일호, "FPGA와 DSP를 이용한 실시간 차선 및 차량인식 시스템 구현", 한국통신학회논문지C, 36(12), pp.727~737 (2011), 한국통신학회
- 방지원, "차량 검출용 CNN 분류기의 실시간 처리를 위한 하드웨어 설계", 전기전자학회논문지, 20(4), pp.351~360 (2016), 한국전기전자학회