몰입형 가상현실에서 손 기반 인터페이스의 비교 실험에 관한 연구
A Study on Comparative Experiment of Hand-based Interface in Immersive Virtua Reality
2
조회
0
다운로드
3
인용
0
참고문헌
키워드
초록
본 연구는 몰입형 가상현실에서의 상호작용 과정에서 사용자의 몰입을 높여 향상된 현존감을 제공하는 손 기반 인터페이스에 대한 비교 실험을 진행한다. 몰입형 가상현실에서 사용자에게 장비의 부담을 최소화하면서 동시에 손을 보다 직접적으로 사용하여 가상 환경과 객체를 제어할 수 있는 몰입형 체험 환경을 제공하기 위하여 손 동작 인식 센서 기반 상호작용과 컨트롤러 기반 상호작용의 두 가지 실험 인터페이스를 설계한다. 손 동작 인식 센서 기반 상호작용은 VR (virtual reality) HMD (head mounted display) 외에 추가적인 장비를 사용하는 대신 정확한 손의 움직임과 직접적인 제스쳐 및 동작 표현을 가상 환경에 반영한다. 컨트롤러 기반 상호작용은 VR HMD와 함께 제공되는 컨트롤러를 쉽게 활용할 수 있도록 손의 제스쳐와 컨트롤러의 키를 매핑시킨 일반화된 인터페이스를 설계한다. 이러한 과정을 통해 본 연구는 손을 활용한 가상현실에서의 상호작용이 사용자의 편리함과 직관성에 측면에서 현존감에 미치는 영향을 비교 실험을 통해 확인한다.
Abstract
This study compares hand-based interfaces to improve a user’s virtual reality (VR) presence by enhancing user immersion in VR interactions. To provide an immersive experience, in which users can more directly control the virtual environment and objects within that environment using their hands and, to simultaneously minimize the device burden on users using immersive VR systems, we designed two experimental interfaces (hand motion recognition sensor- and controller-based interactions). Hand motion recognition sensor-based interaction reflects accurate hand movements, direct gestures, and motion representations in the virtual environment, and it does not require using a device in addition to the VR head mounted display (HMD). Controller-based interaction designs a generalized interface that maps the gesture to the controller’s key for easy access to the controller provided with the VR HMD. The comparative experiments in this study confirm the convenience and intuitiveness of VR interactions using the user’s hand.
참고문헌 (30)
- H. Joo, "Total capture: A 3d deformation model for tracking faces, hands, and bodies", Proceedings of The 2018 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), ser. CVPR ’18 (2018), IEEE Computer Society
- M. Kim, "A study on interaction of gaze pointer-based user interface in mobile virtual reality environment", Symmetry, 9(9), pp.189~ (2017)
- S. Marwecki, "Virtualspace - overloading physical space with multiple virtual reality users", Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems, ser. CHI ’18, pp.241:1~241:10 (2018), ACM
- A. Jayasiri, "Desktop versions of the string-based haptic interface — spidar", 2015 IEEE Virtual Reality (VR). IEEE, pp.199~200 (2015)
- C. Pacchierotti, "Two finger grasping simulation with cutaneous and kinesthetic force feedback", Haptics: Perception, Devices, Mobility, and Communication (EuroHaptics 2012), pp.373~382 (2012)
- P. Lindemann, "A diminished reality simulation for driver-car interaction with transparent cockpits", 2017 IEEE Virtual Reality (VR). IEEE, pp.305~306 (2017)
- T. Pfeiffer, "Understanding Multimodal Deixis with Gaze and Gesture in Conversational Interfaces" (2011), Shaker Verlag GmbH
- T. Pfeiffer, "Using virtual reality technology in linguistic research", 2012 IEEE Virtual Reality Workshops (VRW). IEEE, pp.83~84 (2012)
- R. Tesic, "Exact collision detection using virtual objects in virtual reality modeling of a manufacturing process", Journal of Manufacturing Systems, 18(5), pp.367~376 (1999)
- Bharath, V. G., "Solid modelling interaction with sensors for virtual reality welding", MATEC Web Conf., 144, pp.01008~ (2018)
- A. Henrysson, "Virtual object manipulation using a mobile phone", Proceedings of the 2005 International Conference on Augmented Teleexistence, ser. ICAT ’05, pp.164~171 (2005), ACM
- S. Han, "A study on immersion of hand interaction for mobile platform virtual reality contents", Symmetry, 9(2), pp.22~ (2017)
- W. Zhao, "Combining markerbased mocap and rgb-d camera for acquiring high-fidelity hand motion data", Proceedings of the ACM SIGGRAPH, 2012, 33~42[DOI]
- Y. Visell, "Sound design and perception in walking interactions", International Journal of Human-Computer Studies, 67(11), pp.947~959 (2009)
- Y. Visell, "Interaction capture in immersive virtual environments via an intelligent floor surface", 2010 IEEE Virtual Reality Conference (VR). IEEE, pp.313~314 (2010)
- J. Lee, "Mave: Maze-based immersive virtual environment for new presence and experience", Computer Animation and Virtual Worlds, 28(3-4), pp.e1756~ (2017)
- K. Minamizawa, "Gravity grabber: Wearable haptic display to present virtual mass sensation", ACM SIGGRAPH 2007 Emerging Technologies, ser. SIGGRAPH ’07 (2007), ACM
- M. Oyarzabal, "Multi-finger haptic interface for collaborative tasks in virtual environments", Human-Computer Interaction. Interaction Platforms and Techniques (HCI 2007), pp.673~680 (2007)
- K. Koyanagi, "Development of vr-stef system with force display glove system", Proceedings of the 2005 International Conference on Augmented Tele-existence, ser. ICAT ’05, pp.91~97 (2005)
- M. D. Rinderknecht, "Combined tendon vibration and virtual reality for post-stroke hand rehabilitation", 2013 World Haptics Conference (WHC). IEEE, pp.277~282 (2013)
- I. Choi, "Wolverine: A wearable haptic interface for grasping in virtual reality", 2016 IEEE, 2016, 986~993
- M. Kim, "A study on immersion and presence of a portable hand haptic system for immersive virtual reality", Sensors, 17(5), pp.1141~ (2017)
- M. Slater, "Enhancing our lives with immersive virtual reality", Frontiers in Robotics and AI, 3, pp.74~ (2016)
- J. Lee, "A study on immersion and vr sickness in walking interaction for immersive virtual reality applications", Symmetry, 9(5), pp.78~ (2017)
- K. Jeong, "A study on new virtual reality system in maze terrain", International Journal of Human–Computer Interaction, 34(2), pp.129~145 (2018)
- 정기성, "몰입형 전래동화 콘텐츠 제작을 위한 가상현실 기술에 대한 연구", 한국컴퓨터그래픽스학회논문지, 22(3), pp.43~52 (2016), (사)한국컴퓨터그래픽스학회[DOI]
- 전찬규, "손 인터페이스 기반 3인칭 가상현실 콘텐츠 제작 공정에 관한 연구", 한국컴퓨터그래픽스학회논문지, 23(3), pp.9~17 (2017), (사)한국컴퓨터그래픽스학회[DOI]
- C. D. Metcalf, "Validation and application of a computational model for wrist and hand movements using surface markers", IEEE Transactions on Biomedical Engineering, 55(3), pp.1199~1210 (2008)
- C. Carvalheiro, "User redirection and direct haptics in virtual environments", Proceedings of the 2016 ACM on Multimedia Conference, ser. MM ’16, pp.1146~1155 (2016)
- B. G. Witmer, "The factor structure of the presence questionnaire", Presence : Teleoper. Virtual Environ, 14(3), pp.298~312 (2005)