가상환경에서 사용자 동작에 따른 저글링 모션을 하기 위한 립모션 프레임워크
Leap Motion Framework for Juggling Motion According to User Motion in Virtual Environment
0
조회
0
다운로드
0
인용
0
참고문헌
키워드
초록
본 논문에서는 립모션 디바이스를 이용하여 사용자의 손 움직임을 계산하고, 이로부터 저글링동작뿐만 아니라 이것을 활용하여 팔 근육을 연습 및 분석할 수 있는 새로운 프레임워크를 제안한다. 제안하는 방법은 실시간으로 사용자의 손동작에 맞춰 가상환경에서 공의 움직임을 매핑 할수 있고, 근육의 이완과 수축을 시각화하여 운동량을 분석할 수 있다. 제안하는 프레임워크는 크게 세 부분으로 구성된다 : 1) 립모션 디바이스를 이용하여 사용자의 손 위치를 추적한다. 2) 저글링을 하듯이, 사용자가 공을 던지는 행동 패턴을 이벤트로 정의한다. 3) 사용자의 손 위치를 기준으로 저글링 형태의 움직임을 공에 매핑하기 위한 포물선 기반 입자 기법을 제안한다. 결과적으로 본 논문의 프레임워크를 이용하면 실시간 저글링 게임을 할 수 있다.
Abstract
In this paper, we propose a new framework that calculates the user's hand motions using a Leap Motion device, and uses this to practice and analyze arm muscles as well as juggling motions. The proposed method can map the movement of the ball in a virtual environment according to the user's hand motions in real time, and analyze the amount of exercise by visualizing the relaxation and contraction of the muscles. The proposed framework consists of three main parts : 1) It tracks the user's hand position with the Leap Motion device. 2) As with juggling, the action pattern of the user throwing the ball is defined as an event. 3) We propose a parabola-based particle method to map the movement of a juggling shape to a ball based on the user's hand position. As a result, using the our framework, it is possible to play a juggling game in real-time.
참고문헌 (27)
- S. I. Park, "Data-driven modeling of skin and muscle deformation", ACM SIGGRAPH 2008, 1(6), pp.1~6 (2008)
- S. Lee, "Scalable muscleactuated human simulation and control", ACM Transactions on Graphics(TOG), 38(4), pp.1~13 (2019)
- M. Romeo, "Muscle and fascia simulation with extended position based dynamics", Computer Graphics Forum, 39(1), pp.134~146 (2020)
- R. Yu, "Figure skating simulation from video", Computer graphics forum, 38(7), pp.225~234 (2019)
- P. Khungurn, "Pose estimation of anime", manga characters: a case for synthetic data, 2016, 1~6
- J. Chemin, "A physics-based juggling simulation using reinforcement learning", Proceedings of the 11th Annual International Conference on Motion, Interaction, and Games, pp.1~7 (2018)
- L. Kumarapu, "Animepose : Multiperson 3d pose estimation and animation", arXiv preprint arXiv:2002.02792, ~ (2020)
- J. Won, "Learning body shape variation in physicsbased characters", ACM Transactions on Graphics(TOG), 38(6), pp.1~12 (2019)
- M. Sra, "Metaspace ii: Object and full-body tracking for interaction and navigation in social vr", arXiv preprint arXiv:1512.02922, ~ (2015)
- L. E. Potter, "The leap motion controller:a view on sign language", Proceedings of the 25th Australian computer-human interaction conference: augmentation, application, innovation, collaboration, pp.175~178 (2013)
- J.-I. Choi, "Let’s be a virtual juggler", Computer Animation and Virtual Worlds, 27(3-4), pp.443~450 (2016)
- D. G. Thelen, "Adjustment of muscle mechanics model parameters to simulate dynamic contractions in older adults", J. Biomech. Eng, 125(1), pp.70~77 (2003)
- S. -H. Lee, "Comprehensive biomechanical modeling and simulation of the upper body", ACM Transactions on Graphics(TOG), 28(4), pp.1~17 (2009)
- W. Si, "Realistic biomechanical simulation and control of human swimming", ACM Transactions on Graphics(TOG), 34(1), pp.1~15 (2014)
- Y. Fan, "Active volumetric musculoskeletal systems", ACM Transactions on Graphics(TOG), 33(4), pp.1~9 (2014)
- O. Arikan, "Interactive motion generation from examples", ACM Transactions on Graphics(TOG), 21(3), pp.483~490 (2002)
- D. Holden, "A deep learning framework for character motion synthesis and editing", ACM Transactions on Graphics(TOG), 35(4), pp.1~11 (2016)
- D. Holden, "Phase-functioned neural networks for character control", ACM Transactions on Graphics(TOG), 36(4), pp.1~13 (2017)
- S. Clavet, "Motion matching and the road to next-gen animation", Proc. of GDC (2016)
- M. Da Silva, "Simulation of human motion data using short-horizon model-predictive control", Computer Graphics Forum, 27(2), pp.371~380 (2008)
- D. Han, "Data-guided model predictive control based on smoothed contact dynamics", Computer Graphics Forum, 35(2), pp.533~543 (2016)
- L. Liu, "Guided learning of control graphs for physics-based characters", ACM Transactions on Graphics, 35(3) (2016)
- S. Barrett, "Controlled kicking under uncertainty", The Fifth Workshop on Humanoid Soccer Robots at Humanoids (2010)
- T. Hester, "Generalized model learning for reinforcement learning on a humanoid robot", 2010 IEEE International Conference on Robotics and Automation, pp.2369~2374 (2010)
- S. Jain, "Interactive synthesis of humanobject interaction", Proceedings of the 2009 ACM SIGGRAPH, 2009, 47~53
- J.-I. Choi, "Virtual ball player", The Visual Computer, 31(6-8), pp.905~914 (2015)
- K. Ding, "Learning reduced-order feedback policies for motion skills", Proceedings of the 14th ACM SIGGRAPH, 2015, 83~92