A Multi-modal Interaction Glove for Immersive Education
1
조회
0
다운로드
1
인용
0
참고문헌
키워드
초록
The virtual reality systems may be used as a new educational tool because a user can be provided immersive sensation as he/she experiences a real object. One of the most important factors in developing educational tool based on virtual reality is to make a user naturally interact with a target object and to convey the sense of reality to a user. The sense of the reality means that a user feels or experiences an object in virtual world as the object exists in real world. In order to increase the sense of the reality, this paper addresses a multimodal interface device that allows a user not only to naturally interact with virtual objects but also to sense graphic and haptic feedback according to his/her interaction. The proposed system measures a user’s motion based on IMU (an inertia measurement unit) and then re-creates haptic feedback by the proposed multimodal interface device. To generate the haptic feedback in response to user’s interaction with virtual objects, our system consists of a haptic part for creating haptic information, a motion sensing part to measure user’s motion input, and a virtual environment part. We have also implemented educational contents in the virtual environment and have manipulated the educational contents with the proposed multimodal interaction device.
Abstract
The virtual reality systems may be used as a new educational tool because a user can be provided immersive sensation as he/she experiences a real object. One of the most important factors in developing educational tool based on virtual reality is to make a user naturally interact with a target object and to convey the sense of reality to a user. The sense of the reality means that a user feels or experiences an object in virtual world as the object exists in real world. In order to increase the sense of the reality, this paper addresses a multimodal interface device that allows a user not only to naturally interact with virtual objects but also to sense graphic and haptic feedback according to his/her interaction. The proposed system measures a user’s motion based on IMU (an inertia measurement unit) and then re-creates haptic feedback by the proposed multimodal interface device. To generate the haptic feedback in response to user’s interaction with virtual objects, our system consists of a haptic part for creating haptic information, a motion sensing part to measure user’s motion input, and a virtual environment part. We have also implemented educational contents in the virtual environment and have manipulated the educational contents with the proposed multimodal interaction device.
참고문헌 (13)
- Z. Merchanta, "Effectiveness of virtual reality-based instruction on students' learning outcomes in K-12 and higher education: A meta-analysis", Computers & Education, 70, pp.29~40 (2014)
- E. Ai-Lim Leea, "Learning with desktop virtual reality: Low spatial ability learners are more positively affected", Computers & Education, 79, pp.49~58 (2014)
- J. Robert, "Virtual reality, training's future?" (2011), Springer Science+Business Media
- F. Solina, "Virtual skiing as an art installation", 50th International Symposium ELMAR 2008, pp.507~510 (2008)
- H. Sugarman, "Use of the wii fit system for the treatment of balance problems in the elderly: A feasibility study", Virtual Rehabilitation International Conference, pp.111~116 (2009)
- "Kinect"[URL]
- "Nintendo"[URL]
- S. Andrews, "HaptiCast: A physically-based 3D game with haptic feedback" (2006), FuturePlay
- M. Faust, "Haptic feedback in pervasive games", Third International Workshop on Pervasive Gaming Applications (2006)
- S. B. Schorr, "Environment perception in the presence of kinesthetic or tactile guidance virtual fixtures", the Tenth Annual ACM, 2014, 287~294
- "Immersion"[URL]
- D. S. Kwon, "Haptic interfaces for mobile devices: A survey of the state of the art", Recent Patents on Computer Science, 1(2), pp.84~92 (2008)
- Y. J. Cho, "A smart actuator based on electrodynamics and piezoelectric effect for haptic feedback", Master, pp.2011