동영상에서 추출한 키포인트 정보의 동적 시간워핑(DTW)을이용한 인체 동작 유사도의 정량화 기법
A Quantification Method of Human Body Motion Similarity using Dynamic Time Warping for Keypoints Extracted from Video Streams
0
조회
0
다운로드
4
인용
0
참고문헌
키워드
초록
사람이 따라 하는 능력을 평가하는 스코어는 아동의 발달 단계 혹은 골프, 무용 동작 등을 점검하는 좋은 수단이 될 수 있다. 또한, 이는 AR, VR 응용에서 HCI로도 활용될 수 있다. 본 논문에서는 동작을 주도해서 수행하는 시범자와 그 동작을 따라 하는 참여자 간의 동작 유사도를 평가하는 방안을 제시하고, 여기서 우리는 Openpose의 키포인트 벡터 유사도의 유클리디안 L2 거리를 활용하는 동작 유사도를 제안한다. 제안된 기법은 DTW를 사용하기 때문에 시간 지연차가 있는 동작에 유연하게 대처할 수 있다.
Abstract
The matching score evaluating human copying ability can be a good measure to check children's developmental stages,or sports movements like golf swing and dance, etc. It also can be used as HCI for AR, VR applications. This paperpresents a method to evaluate the motion similarity between demonstrator who initiates movement and participant whofollows the demonstrator action. We present a quantification method of the similarity which utilizes Euclidean L2 distanceof Openpose keypoins vector similarity. The proposed method adapts DTW, thus can flexibly cope with the time delayedmotions.
참고문헌 (20)
- 백성희, "동작요소중심의 유아동작교육 프로그램이 기본동작능력 및 창의성에 미치는 영향", 열린유아교육연구, 11(4), pp.37~60 (2006), 한국열린유아교육학회
- Chen, Weiming, "Fall Detection Based on Key Points of Human-Skeleton Using OpenPose", Symmetry, 12(5), pp.744~ (2020)[DOI]
- Naidu, Chetna, "Hand gesture recognition using leap motion controller", International Journal of Science and Research (IJSR), pp.2319~7064 (2006)
- Moon, Gyeongsik, "V2v-posenet: Voxel-to-voxel prediction network for accurate 3d hand and human pose estimation from a single depth map", Proceedings of the IEEE conference on computer vision and pattern Recognition (CVPR), pp.5079~5088 (2018)
- Zhi-chao, Cao, "Key pose recognition toward sports scene using deeplylearned model", Journal of Visual Communication and Image Representation, 63, pp.102571~ (2019)[DOI]
- Lin Chen, "Hand Gesture Recognition Using Compact CNN via Surface Electromyography Signals", Sensors, 20(3), pp.672~ (2020), MDPI AG[DOI]
- Qiao, Sen, "Real-time human gesture grading based on OpenPose", 10th International Congress on Image and Signal Processing, BioMedical Engineering and Informatics (CISP-BMEI), pp.1~6 (2017), IEEE
- Cao, "OpenPose: realtime multi-person 2D pose estimation using Part Affinity Fields", arXiv preprint arXiv:1812.08008, ~ (2018)
- Senin Pavel, "Dynamic time warping algorithm review", Information and Computer Science Department University of Hawaii at Manoa Honolulu, 40(855), pp.1~23 (2008)
- Schneider, "Gesture recognition in RGB videos using human body keypoints and dynamic time warping", Robot World Cup, pp.37~60 (2019)
- Muda, Lindasalwa, "Voice recognition algorithms using mel frequency cepstral coefficient (MFCC)and dynamic time warping (DTW) techniques", arXiv preprint arXiv:1003.4083, ~ (2010)
- Bala, Anjali, "Voice command recognition system based on MFCC and DTW", International Journal of Engineering Science and Technology, 2(12), pp.7335~7342 (2010)
- Sempena, Samsu, "Human action recognition using dynamic time warping", Proceedings of the 2011 International Conference on Electrical Engineering and Informatics, pp.1~5 (2011), IEEE
- Xiao, Bin, "Simple baselines for human pose estimation and tracking", Proceedings of the European conference on computer vision (ECCV), pp.466~481 (2018)
- Mapari, Rajesh B., "Real time human pose recognition using leap motion sensor", 2015 IEEE International Conference on Research in Computational Intelligence and Communication Networks (ICRCICN), pp.323~328 (2015), IEEE
- Doliotis Paul, "Comparing gesture recognition accuracy using color and depth information", Proceedings of the 4th international conference on PErvasive technologies related to assistive environments, pp.1~7 (2011)
- Alp Güler, Rıza, "Densepose: Dense human pose estimation in the wild", Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp.7297~7306 (2018)
- JIAN HO CHUN, "Gesture recognition using windowed dynamic time warping", pp.2010
- Rossana Muscillo, "Early recognition of upper limb motor tasks through accelerometers: real-time implementation of a DTW-based algorithm", Computers in Biology and Medicine, 41(3), pp.164~172 (2011), Elsevier BV[DOI]
- Shotton Jamie, "Real-time human pose recognition in parts from single depth images", CVPR 2011, pp.1297~1304 (2011), IEEE