Fast Super-Resolution GAN 기반 자동차 번호판 검출 및 인식 성능 고도화 기법
Improved Method of License Plate Detection and Recognition Facilitated by Fast Super-Resolution GAN
0
조회
0
다운로드
3
인용
0
참고문헌
키워드
초록
자동차 번호판 인식 기술은 도로의 교통상황 통제, 과속차량 단속, 도주 차량의 추적 등 현대 교통 시설 및 교통 안전망을 책임지고 있는 핵심 기술 중 하나이다. 이 기법은 과거에도 연구되었던 분야였으나 최근 딥러닝 기술의 발전으로 다양한 기법들을 적용하여 향상된 성능을 보이는 분야이며, 크게 자동차 번호판 검출과 번호판 인식으로 나뉜다. 본 연구에서는 다양한 객체 검출 모델과 WPOD-Net(Warped Planar Object Detection Network) 모델을 활용하여 자동차 번호판 검출 성능을 향상시키기 위한 실험을 진행하였으며, 객체 검출 모델을 활용하여 번호판을 검출하는 기존 방식들 대신 차량을 검출한 다음 번호판을 검출하는 방식을 택하여 정확도를 높였다. 특히 Super-Resolution 기법 중 하나인 Fast-SRGAN 모델을 활용하여 이미지 내에 존재하는 노이즈를 제거하는 처리를 통해 최종 성능을 향상시켰다. 결과적으로 92.38%에서 96.72%로 선행 연구 대비 평균 4.34% 향상된 성능이 실험을 통해 확인되었다.
Abstract
Vehicle License Plate Recognition is one of the approaches for transportation and traffic safety networks, such as traffic control, speed limit enforcement and runaway vehicle tracking. Although it has been studied for decades, it is attracting more and more attention due to the recent development of deep learning and improved performance. Also, it is largely divided into license plate detection and recognition. In this study, experiments were conducted to improve license plate detection performance by utilizing various object detection methods and WPOD-Net(Warped Planar Object Detection Network) model. The accuracy was improved by selecting the method of detecting the vehicle(s) and then detecting the license plate(s) instead of the conventional method of detecting the license plate using the object detection model. In particular, the final performance was improved through the process of removing noise existing in the image by using the Fast-SRGAN model, one of the Super-Resolution methods. As a result, this experiment showed the performance has improved an average of 4.34% from 92.38% to 96.72% compared to previous studies.
참고문헌 (32)
- H. Li, "Towards End-to-End Car License Plates Detection and Recognition with Deep Neural Networks", IEEE TRANSACTIONS ON INTELLIGENT TRANSPORTATION SYSTEMS, 20, pp.1126~1136 (2019)
- 민동욱, "Fast-Super-Resolution GAN 기반 자동차 번호판 검출 및 인식 성능 향상 방법에 대한 연구", 스마트미디어학회 춘계 학술대회 (2020)
- 박승현, "Haar-like Feature 및 CLNF 알고리즘을 이용한 차량 번호판 인식", 스마트미디어저널, 5(1), pp.15~23 (2016), (사)한국스마트미디어학회
- 이광옥, "차량 번호판 밝기 제어를 이용한 인식률 개선 방안", 스마트미디어저널, 6(3), pp.57~63 (2017), (사)한국스마트미디어학회
- 김운기, "SSD-Mobilenet과 ResNet을 이용한 모바일 기기용 자동차 번호판 인식시스템", 스마트미디어저널, 9(2), pp.92~98 (2020), (사)한국스마트미디어학회[DOI]
- S. Lee, "Vehicle model recognition in video", International Journal of Signal Processing, Image Processing and Pattern Recognition, 6(2) (2013)
- O. Bulan, "Segmentation and Annotation Free License Plate Recognition With Deep Localization and Failure Identification", IEEE Transactions on Intelligent Transportation Systems, 18(9), pp.2351~2363 (2017)
- J. Redmon, "You Only Look Once : Unified, Real-Time Object Detection", IEEE Conference on Computer Vision and Pattern Recognition(CVPR), pp.779~788 (2016)
- J. Redmon, "YOLO9000: Better, Faster, Stronger", IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp.6517~6525 (2017)
- S.M. Silva, "Real-time brazilian license plate detection and recognition using deep convolutional neural networks", SIBGRAPI Conference on Graphics, Patterns and Images (SIBGRAPI), pp.55~62 (2017)
- G.S. Hsu, "Robust license plate de-tection in the wild", IEEE International Conference on Advanced Video and Signal Based Surveillance (AVSS), pp.1~6 (2017)
- L. Xie, "A New CNN-Based Method for Multi-Directional Car License Plate Detection", IEEE Transactions on Intelligent Transportation Systems, 19, pp.507~517 (2018)
- R. Laroca, "A robust real-time automatic license plate recognition based on the YOLO detector", International Joint Conference on Neural Networks (IJCNN) (2018)
- D. K. Francisco, "Convolutional neural networks for license plate detection in images", IEEE International Conference on Image Processing(ICIP), pp.3395~3399 (2017)
- Z. Selmi, "Deep Learning System for Automatic License Plate Detection and Recognition", IAPR International Conference on Document Analysis and Recognition(ICDAR), pp.1132~1138 (2017)
- W. Liu, "SSD : Single Shot MultiBox Detector", European Conference on Computer Vision(ECCV), pp.21~37 (2016)
- S. Ren, "Faster R-CNN : Towards Real-Time Object Detection with Region Proposal Networks", IEEE Transactions on Pattern Analysis and Machine Intelligence, 39, pp.1137~1149 (2017)
- M. Jaderberg, "Synthetic Data and Artificial Neural Networks for Natural Scene Text Recognition", Conference on Neural Information Processing Systems, pp.1~10 (2014)
- A. Gupta, "Synthetic Data for Text Localisation in Natural Images", IEEE Conference on Computer Vision and Pattern Recognition (2016)
- F. Wang, "Geometry-Aware Scene Text Detection with Instance Transformation Network", IEEE Conference on Computer Vision and Pattern Recognition(CVPR), pp.1381~1389 (2018)
- "Towards end-to-end car license plates detection and recognition with deep neural networks"[URL]
- S. M. Silva, "License plate detection and recognition in unconstrained scenarios", European Conference on Computer Vision, pp.593~609 (2018)
- T.Y. Lin, "Microsoft COCO: Common Objects in Context", European Conference on Computer Vision(ECCV), Lecture Notes in Computer Science, 8693 (2014)
- J. Špaňhel, "Holistic recognition of low quality license plates by CNN using track annotated data", IEEE International Conference on Advanced Video and Signal Based Surveillance(AVSS), pp.1~6 (2017)
- "OpenALPR Benchmarks"[URL]
- "YOLOv3: An Incremental Improvement"[URL]
- M. Tan, "EfficientDet : Scalable and Efficient Object Detection", The IEEE, 2020, 10781~10790
- K. Simonyan, "Very deep convolutional networks for large-scale image recognition", The International Conference on Learning Representations(ICLR) (2015)
- "EfficientNet: Rethinking model scaling for convolutional neural networks"[URL]
- "Photo-realistic single image Super-Resolution using a generative adversarial network"[URL]
- "Fast-SRGAN"[URL]
- O. Prakash, "Human detection in complex real scenes based on combination of biorthogonal wavelet transform and Zernike moments", Optik-International Journal for Light and Electron Optics, 157, pp.1267~1281 (2018)