본문 바로가기
KERD
논문KCI 등재

운전자의 주의분산 연구동향 및 딥러닝 기반 동작 분류 모델

Study on driver's distraction research trend and deep learning based behavior recognition model

최정인|한상곤
한국컴퓨터정보학회 (The Korean Society Of Computer And Information)|2021.11|한국컴퓨터정보학회논문지 (Journal of The Korea Society of Computer and Information)|제26권 제11호|pp. 173-182|DOI https://doi.org/10.9708/jksci.2021.26.11.173

0

조회

0

다운로드

0

인용

0

참고문헌

키워드

CAM동작 인식Behavior Recognition운전자의 동작운전자의 주의 분산ResNet-101Driver‘s BehaviorDriver’s Distraction
주제분류컴퓨터학

초록

본 논문에서는 운전자의 주의산만을 유발하는 운전자, 탑승자의 동작을 분석하고 핸드폰과 관련된 운전자의 행동 10가지를 인식하였다. 먼저 주의산만을 유발하는 동작을 환경 및 요인으로분류하고 관련 최근 논문을 분석하였다. 분석된 논문을 기반으로 주의산만을 유발하는 주요 원인인 핸드폰과 관련된 10가지 운전자의 행동을 인식하였다. 약 10만 개의 이미지 데이터를 기반으로 실험을 진행하였다. SURF를 통해 특징을 추출하고 3가지 모델(CNN, ResNet-101, 개선된ResNet-101)로 실험하였다. 개선된 ResNet-101 모델은 CNN보다 학습 오류와 검증 오류가 8.2배, 44.6배가량 줄어들었으며 평균적인 정밀도와 f1-score는 0.98로 높은 수준을 유지하였다. 또한CAM(class activation maps)을 활용하여 딥러닝 모델이 운전자의 주의 분산 행동을 판단할 때, 핸드폰 객체와 위치를 결정적 원인으로 활용했는지 검토하였다.

Abstract

In this paper, we analyzed driver's and passenger's motions that cause driver's distraction, and recognized 10 driver's behaviors related to mobile phones. First, distraction-inducing behaviors were classified into environments and factors, and related recent papers were analyzed. Based on the analyzed papers, 10 driver's behaviors related to cell phones, which are the main causes of distraction, were recognized. The experiment was conducted based on about 100,000 image data. Features were extracted through SURF and tested with three models (CNN, ResNet-101, and improved ResNet-101). The improved ResNet-101 model reduced training and validation errors by 8.2 times and 44.6 times compared to CNN, and the average precision and f1-score were maintained at a high level of 0.98. In addition, using CAM (class activation maps), it was reviewed whether the deep learning model used the cell phone object and location as the decisive cause when judging the driver's distraction behavior.

참고문헌 (49)

  3. Alexey Kashevnik, "Driver Distraction Detection Methods: A Literature Review and Framework", IEEE Access, 9, pp.60063~60076 (2021), Institute of Electrical and Electronics Engineers (IEEE)[DOI]
  4. "State Farm Distracted Driver Detection"[URL]
  5. B. Zhou, "Learning deep features for discriminative localization", Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp.2921~2929 (2016)
  6. Gultekin Gunduz, "Prediction of Risk Generated by Different Driving Patterns and Their Conflict Redistribution", IEEE Transactions on Intelligent Vehicles, 3(1), pp.71~80 (2018), Institute of Electrical and Electronics Engineers (IEEE)[DOI]
  7. Mozhgan Nasr Azadani, "Driving Behavior Analysis Guidelines for Intelligent Transportation Systems", IEEE Transactions on Intelligent Transportation Systems, pp.1~19 (2021), Institute of Electrical and Electronics Engineers (IEEE)[DOI]
  8. Miguel Costa, "Detecting Driver’s Fatigue, Distraction and Activity Using a Non-Intrusive Ai-Based Monitoring System", Journal of Artificial Intelligence and Soft Computing Research, 9(4), pp.247~266 (2019), Walter de Gruyter GmbH[DOI]
  9. S. Kim, "A Study of Driver’s Visual and Auditory Task Distraction using Virtual Reality Driving Simulator", Master, pp.2018
  10. H. J. Kim, "Design and Evaluation of Alert Threshold for Takeover Request in Partial Autonomous Vehicles considering Human Factors", Proceedings of Conference, Korean Society of Automotive Engineers (2016)
  11. Naomi J. Dunn, "Investigating the impact of driving automation systems on distracted driving behaviors", Accident Analysis & Prevention, 156, pp.106152~ (2021), Elsevier BV[DOI]
  12. B. Wagner, "Vision Based Detection of Driver Cell Phone Usage and Food Consumption", IEEE Transactions on Intelligent Transportation Systems (2021)
  13. X. Zeng, "A stochastic driver pedal behavior model incorporating road information", IEEE Transactions on Human-Machine Systems, 47(5), pp.614~624 (2017)
  14. H. J. Chung, "A Study on Effect of Women Driver’s Dangerous Behavior based on the Theory of Planned Behavior(TPB)", Doctor, pp.2013
  15. Q. Hua, "Cognitive Distraction State Recognition of Drivers at a Nonsignalized Intersection in a Mixed Traffic Environment", Advances in Civil Engineering, 2021, pp.1~16 (2021)[DOI]
  16. Wencai Sun, "Driver Distraction Recognition Using Wearable IMU Sensor Data", Sustainability, 13(3), pp.1342~ (2021), MDPI AG[DOI]
  17. Yuxin Zhang, "Deep unsupervised multi-modal fusion network for detecting driver distraction", Neurocomputing, 421, pp.26~38 (2021), Elsevier BV[DOI]
  18. António Lobo, "Exploring Monitoring Systems Data for Driver Distraction and Drowsiness Research", Sensors, 20(14), pp.3836~ (2020), MDPI AG[DOI]
  19. Mohit Dua, "Deep CNN models-based ensemble approach to driver drowsiness detection", Neural Computing and Applications, 33(8), pp.3155~3168 (2021), Springer Science and Business Media LLC[DOI]
  20. C.V. Hari, "Driver distraction analysis using face pose cues", Expert Systems with Applications, 179, pp.115036~ (2021), Elsevier BV[DOI]
  21. Z. Zhao, "Driver Distraction Detection Method Based on Continuous Head Pose Estimation", Computational Intelligence and Neuroscience, 2020 (2020)[DOI]
  22. Li Li, "Detection of driver manual distraction via image-based hand and ear recognition", Accident Analysis & Prevention, 137, pp.105432~ (2020), Elsevier BV[DOI]
  23. Francisco Vicente, "Driver Gaze Tracking and Eyes Off the Road Detection System", IEEE Transactions on Intelligent Transportation Systems, 16(4), pp.2014~2027 (2015), Institute of Electrical and Electronics Engineers (IEEE)[DOI]
  24. A. Bhatt, "Analyzing behavioral attributes of drivers and implementing safe driving model", 2017 IEEE International Conference on Vehicular Electronics and Safety (ICVES), pp.228~232 (2017)
  25. Arief Koesdwiady, "Recent Trends in Driver Safety Monitoring Systems: State of the Art and Challenges", IEEE Transactions on Vehicular Technology, 66(6), pp.4550~4563 (2017), Institute of Electrical and Electronics Engineers (IEEE)[DOI]
  26. M. Raja, "WiBot! in-vehicle behaviour and gesture recognition using wireless network edge", Proceeding of IEEE 38th International Conference on Distributed Computing Systems (ICDCS), pp.376~387 (2018)
  27. Guofa Li, "A Temporal-Spatial Deep Learning Approach for Driver Distraction Detection Based on EEG Signals", IEEE Transactions on Automation Science and Engineering, pp.1~13 (2021), Institute of Electrical and Electronics Engineers (IEEE)[DOI]
  28. Melanie Karthaus, "Distraction in the Driving Simulator: An Event-Related Potential (ERP) Study with Young, Middle-Aged, and Older Drivers", Safety, 7(2), pp.36~ (2021), MDPI AG[DOI]
  29. S. D. Ki, "An analysis on the effects of the driver distraction on the car accidents", Insurance and Financial Research, 22(3), pp.3~32 (2011)
  30. Nasim Arbabzadeh, "A Data-Driven Approach for Driving Safety Risk Prediction Using Driver Behavior and Roadway Information Data", IEEE Transactions on Intelligent Transportation Systems, 19(2), pp.446~460 (2018), Institute of Electrical and Electronics Engineers (IEEE)[DOI]
  31. Gyu Ho Choi, "Driver Identification System Using Normalized Electrocardiogram Based on Adaptive Threshold Filter for Intelligent Vehicles", Sensors, 21(1), pp.202~ (2021), MDPI AG[DOI]
  32. 이순열, "Moderating Effect of Speed Desire Frustration on the Relationship between Driving Stress and Coping Behavior on Traffic Accident Risk", 한국심리학회지: 산업 및 조직, 25(3), pp.571~587 (2012), 한국산업및조직심리학회[DOI]
  33. Y. Xing, "Identification and analysis of driver postures for in-vehicle driving activities and secondary tasks recognition", IEEE Transactions on Computational Social Systems, 5(1), pp.95~108 (2018)
  34. M. Mori, "Measuring driver awareness based on correlation between gaze behavior and risks of surrounding vehicles", Proceeding of 2012 15th International IEEE Conference on Intelligent Transportation Systems, pp.644~647 (2012)
  35. J. H. L. Hansen, "Driver Modeling for Detection and Assessment of Driver Distraction : Examples from the UTDrive Test Bed", EEE Signal Processing Magazine, 34, pp.130~142 (2017)
  36. Nanxiang Li, "Predicting Perceived Visual and Cognitive Distractions of Drivers With Multimodal Features", IEEE Transactions on Intelligent Transportation Systems, 16(1), pp.51~65 (2015), Institute of Electrical and Electronics Engineers (IEEE)[DOI]
  37. Carrie Huisingh, "The Prevalence of Distraction Among Passenger Vehicle Drivers: A Roadside Observational Approach", Traffic Injury Prevention, 16(2), pp.140~146 (2014), Informa UK Limited[DOI]
  38. C. A. Pickering, "A research study of hand gesture recognition technologies and applications for human vehicle interaction", Proceeding of 3rd Institution of Engineering and Technology conference on Automotive Electronics, pp.1~15 (2007)
  39. W. Yan, "Impact to Longitude Velocity Control of Autonomous Vehicle from Human Driver's Distraction Behavior", Proceeding of IEEE 86th Vehicular Technology Conference (VTC-Fall), pp.1~5 (2017)
  40. "SAE International Releases Updated Visual Chart for Its “Levels of Driving Automation” Standard for Self-Driving Vehicles"[URL]
  41. E. Pakdamanian, "Deeptake: Prediction of driver takeover behavior using multimodal data", Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems, pp.1~14 (2021)
  42. "Waymo Open Dataset"[URL]
  43. "Self-Driving Vehicle Hits Bicyclist"[URL]
  44. H. Bay, "Speeded-up robust features(SURF)", Comput. Vision Image Understanding, 110(3), pp.346~359 (2008)
  45. D. G. Lowe, "Distinctive image features from scale-invariant keypoints", International Journal of Computer Vision, 60(2), pp.91~110 (2004)
  46. K. He, "Deep residual learning for image recognition", Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp.770~778 (2016)
  47. N. Srivastava, "Dropout: a simple way to prevent neural networks from overfitting", The Journal of Machine Learning Research, 15(1), pp.1929~1958 (2014)
  48. D. Scherer, "Evaluation of pooling operations in convolutional architectures for object recognition", International Conference on Artificial Neural Networks, pp.92~101 (2010)
  49. A. A. Suzen, "Benchmark analysis of jetson TX2, jetson nano and raspberry PI using deep-CNN", 2020 International Congress on Human-Computer Interaction, Optimization and Robotic Applications (HORA), pp.1~5 (2020)

관련 논문AI추천

CAM 기반의 계층적 및 수평적 분류 모델을 결합한 운전자 부주의 검출 및 특징 영역 지역화고수연, 최영우한국정보처리학회 · 정보처리학회 논문지2021 · 제10권 제11호SERN 기반 운전자의 다중 행동 특징을 이용한 졸음 검출 시스템김민준, 김원열, 최규호한국차세대컴퓨팅학회 · 한국차세대컴퓨팅학회 논문지2024 · 제20권 제3호딥러닝 기반의 운전자의 안전/위험 상태 인지 시스템 개발강보영, 이현순, 미아오쉬한국로봇학회 · 로봇학회 논문지2018 · 제13권 제1호행동 분류에 기반한 영상의 시공간적 특성과 자기주도 학습의 융합적 접근강성관, 김종구한국인공지능융합기술학회 · 인공지능융합기술연구2024 · 제4권 제1호대조학습 방법을 이용한 주행패턴 분석 기법 연구권장우, 김승하, 김준희, 정회준한국ITS학회 · 한국ITS학회 논문지2024 · 제23권 제1호운전자 이동행동 및 시선에 따른 교통사고 위험도 예측김태욱, 양지웅, 이한진, 정현진, 홍정희한국컴퓨터정보학회 · 한국컴퓨터정보학회논문지2024 · 제29권 제8호

이 간행물의 다른 논문 (29건)

SSD 신뢰성 향상을 위한 3D 낸드 플래시 메모리 오류율에 따른 K-means 클러스터링 분석 및 차별화된 보호 정책김재호, 손승우pp. 1-9슈퍼커패시터와 통합된 태양광 패널에 의해 전력이 공급되는 소물인터넷 프로토타입의 설계 및 평가박상수pp. 11-19스태킹 앙상블을 이용한 병렬 네트워크 이상호흡음 분류 모델남명우, 최영진, 이홍철, 최회련pp. 21-31전장상황인식을 위한 지식베이스 임베딩 기반 유사 단어 추출에 관한 연구김상민, 이우신, 진소연pp. 33-40API Call 정보 기반의 안드로이드 악성코드 분류를 위한 특성 집합 추출이수진, 황희진pp. 41-49
원문 보기