피로도 측정을 위한 정면 얼굴 영상 분석
Frontal Face Video Analysis for Detecting Fatigue States
0
조회
0
다운로드
0
인용
0
참고문헌
키워드
초록
사람이 느끼는 피로는 다양한 생체신호로부터 측정이 가능한 것으로 알려져 있으며, 기존 연구는 질병과 관련된 심각한 피로수준을 산정하는데 주된 목적을 두고 있다. 본 연구에서는 피실험자의 영상을 이용하여 딥러닝 기반의 영상 분석 기술을 적용, 피로 여부를 판단하기 위한 모델을 제안한다. 특히 화상 분석에서 통상적으로 사용되는 객체 인식, 요소 추출과 함께 영상 데이터의 시계열적 특성을 고려하여 방법론을 교차한 3개 분석모델을 제시했다. 다양한 피로상황에서 수집된정면 얼굴 영상 데이터를 이용하여 제시된 모델을 실험하였으며, CNN 모델의 경우 0.67의 정확도로 피로 상태를 분류할 수 있어 영상 분석 기반의 피로 상태 분류가 유의미하다고 판단된다. 또한모델별 학습 및 검증 절차 분석을 통해 영상 데이터 특성에 따른 모델 적용방안을 제시했다.
Abstract
We can sense somebody's feeling fatigue, which means that fatigue can be detected through sensing human biometric signals. Numerous researches for assessing fatigue are mostly focused on diagnosing the edge of disease-level fatigue. In this study, we adapt quantitative analysis approaches for estimating qualitative data, and propose video analysis models for measuring fatigue state. Proposed three deep-learning based classification models selectively include stages of video analysis: object detection, feature extraction and time-series frame analysis algorithms to evaluate each stage's effect toward dividing the state of fatigue. Using frontal face videos collected from various fatigue situations, our CNN model shows 0.67 accuracy, which means that we empirically show the video analysis models can meaningfully detect fatigue state. Also we suggest the way of model adaptation when training and validating video data for classifying fatigue.
참고문헌 (35)
- Dinges, D. F, "An overview of sleepiness and accidents", Journal of sleep research, 4, pp.4~14 (1995)
- Smets, E, "The Multidimensional Fatigue Inventory (MFI) Psychometric Qualifies of an Instrument to Assess Fatigue", Journal of Psychosomatic Research, 39(3), pp.315~325 (1995)
- Lee, Y, "An Experimental study on Self-rated Fatigue Assessment Tool for the Fatigue Risk Groups", Proceedings of 2021 KMIST Conference, pp.1755~1756 (2021)
- Choe, J.-H, "Trend of Convergence Technology between Healthcare and the IoT", Information and Communications Magazine, 31(12), pp.10~16 (2014)
- Kim, K, "Wearable Health Device Technology in the IoT Era", The Korean Institute of Electrical Engineers, 65(11), pp.18~22 (2016)
- Daeho Kim, "피로위험관리를 위한 조종사 피로측정방법 고찰", 한국항공우주의학회지, 30(2), pp.54~60 (2020), 한국항공우주의학협회[DOI]
- Simonyan, K, "Very Deep Convolutional Networks for Large-Scale Image Recognition", ~ (2014)
- Szegedy, C, "Going deeper with convolutions", Proceedings of the IEEE conference on computer vision and pattern recognition, pp.1~9 (2015)
- He, K, "Deep Residual Learning for Image Recognition", Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp.770~778 (2016)
- Chollet, F, "Xception: Deep Learning with Depthwise Separable Convolutions", Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp.1251~1258 (2017)
- Huang, G, "Densely Connected Convolutional Networks", Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp.4700~4708 (2017)
- Howard, A. G, "MobileNets:Efficient Convolutional Neural Networks for Mobile Vision Applications", ~ (2017)
- Tan, M, "EfficientNet: Rethinking Model Scaling for Convolutional Neural Networks", International Conference on Machine Learning (2019)
- Dosovitskiy, A, "An Image is Worth 16x16 Words:Transformers for Image Recognition at Scale", ~ (2020)
- Dai, Z, "CoAtNet: Marrying Convolution and Attention for All Data Sizes", Advances in Neural Information Processing Systems, pp.34~ (2021)
- Vaswani, A, "Attention Is All You Need", Advances in Neural Information Processing Systems, pp.30~ (2017)
- Hochreiter, S, "LONG SHORT-TERM MEMROY", Neural Computation, 9(8), pp.1735~1780 (1997)
- Cho, K, "Learning Phrase Representations using RNN Encoder-Decoder for Statistical Machine Translation", ~ (2014)
- Dalal, "Histograms of oriented gradients for human detection", 2005 IEEE computer society conference on computer vision and pattern recognition (CVPR'05), 1, pp.886~893 (2005), IEEE
- Soomro, K, "UCF101: A Dataset of 101 Human Actions Classes From Videos in The Wild", ~ (2012)
- Kay, W, "The Kinetics Human Action Video Dataset", ~ (2017)
- Girshick, R, "Rich feature hierarchies for accurate object detection and semantic segmentation", Proceedings of the IEEE conference on Computer Vision and Pattern Recognition, pp.580~587 (2014)
- Redmon, J, "You Only Look Once: Unified, Real-Time Object Detection", Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp.779~788 (2016)
- Liu, W, "SSD: Single Shot MultiBox Detector", European conference on computer vision, pp.21~37 (2016), Springer
- Sagonas, C, "300 faces in-the-wild challenge: The first facial landmark localization challenge", Proceedings of the IEEE international conference on computer vision work-shops, pp.397~403 (2013)
- 유승훈, "라즈베리 파이를 이용한 생체신호 수집시스템 개발", 한국정보통신학회논문지, 25(12), pp.1935~1941 (2021), 한국정보통신학회[DOI]
- Redmon, J, "YOLOv3: An Incremental", ~ (2018)
- Yang, S, "WIDER FACE:A Face Detection Benchmark", Procedings of the IEEE conference on computer vision and pattern recognition, pp.5525~5533 (2016)
- Kazemi, V, "One Millisecond Face Alignment with an Ensemble of Regression Trees", Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp.1867~1874 (2014)
- Lin, M, "Network in network", ~ (2013)
- Lilleholt, L, "Pandemic fatigue: Measurement, correlates, and consequences", ~ (2020)
- Qiang, Y, "Dynamic fatigue measurement of human erythrocytes using dielectrophoresis", Acta biomaterialia, 57, pp.352~362 (2017)
- Escobar-Linero, E, "Worker’s physical fatigue classification using neural networks", Expert Systems with Applications, 198, pp.116784~ (2022)
- Zhuang, Q, "Driver fatigue detection method based on eye states with pupil and iris segmentation", Ieee Access, 8, pp.173440~173449 (2020)
- Yan, P, "Driver fatigue detection system based on colored and infrared eye features fusion", Computers, Materials & Continua, 63(3), pp.1563~1574 (2020)