Implementation of Real-Time 3D Video Avatar for Immersive Telecommunication
2
조회
0
다운로드
0
인용
0
참고문헌
키워드
초록
Immersive telecommunication is a new challenging field that enables a user to share a virtual space with remote participants providing users with a sense of telepresence and interaction. This paper presents an implementation of realtime dynamic 3D avatar from multi-view cameras for the immersive telecommunication. The main objective is to offer rich communication modalities, as similar as those used in the face-to-face meetings like gestures, gaze awareness, realistic images, and correct sound direction. Active segmentation algorithm is suggested to generate realistic 3D video avatars in real-time and also to augment the avatars naturally into 3D collaborative virtual environment. The proposed algorithm has been integrated to the framework of distributed VR, called NAVER, and an example of application, Heritage Alive!, has been implemented to demonstrate the concept. As a result, the user can be immersed and has natural interaction with remote participant. This would overcome the limitations both of the conventional video-based telecommunication and also the VR-based collaborative virtual environment approaches.
Abstract
Immersive telecommunication is a new challenging field that enables a user to share a virtual space with remote participants providing users with a sense of telepresence and interaction. This paper presents an implementation of realtime dynamic 3D avatar from multi-view cameras for the immersive telecommunication. The main objective is to offer rich communication modalities, as similar as those used in the face-to-face meetings like gestures, gaze awareness, realistic images, and correct sound direction. Active segmentation algorithm is suggested to generate realistic 3D video avatars in real-time and also to augment the avatars naturally into 3D collaborative virtual environment. The proposed algorithm has been integrated to the framework of distributed VR, called NAVER, and an example of application, Heritage Alive!, has been implemented to demonstrate the concept. As a result, the user can be immersed and has natural interaction with remote participant. This would overcome the limitations both of the conventional video-based telecommunication and also the VR-based collaborative virtual environment approaches.
참고문헌 (20)
- "Communications of the ACM", 35, pp.64~72 (1992)
- "Virtualized Reality: Digitizing a 3D Time-Varying Event As Is and in Real Time" (1999), Springer-Verlag
- "Image-Based Visual Hulls", pp.369~374
- "Polyhedral visual hulls for real-time rendering", pp.115~125
- "Online Accelerated Rendering of Visual Hulls in Real Scenes", 11(2), pp.290~297 (2003)
- "blue-c: A Spatially Immersive Display and 3D Video Portal for Telepresence" (2003)
- "A survey of electromagnetic position tracker calibration techniques", 5(3), pp.169~182 (2000)
- "Online Model Reconstruction for Interactive Virtual Environments", pp.69~72
- "Real-Time Generation and High Fidelity Visualization of 3D Video" (2003)
- "The visual hull concept for silhouette-based image understanding", 16(2), pp.16 150~162
- "''Active Segmentation for Immersive Live Avatar"
- "Real-Time Consensus-Based Scene Reconstruction using Commodity Graphics Hardware" (2002)
- "Homography Based Parallel Volume Intersection: Toward Real-Time Volume Reconstruction Using Active Cameras", pp.331~339
- "Efficient view-dependent image-based rendering with projective texture-mapping", pp.105~116
- "Fast shadows and lighting effects using texture mapping", pp.249~252
- "''in Proceedings of 3D Data Processing"
- "Uniform spreading of amplitude panned virtual sources"
- "The office of the future: A unified approach to image-based modeling and spatially immersive displays", pp.179~188 (1998)
- "Development of String-based Force Display : SPIDAR" (2002)
- "K. ''Video flashlights - real time rendering of multiple videos for immersive model visualization ''in Proceedings of 13th Eurographics Workshop on Rendering."