Agent-Mediator based Communication Framework for Adaptive Mixed Reality Space
2
조회
0
다운로드
1
인용
0
참고문헌
키워드
초록
Digital technology has given rise to new media forms. Adaptive mixed reality (AMR) is a new emerging type of media that explores various approaches to combine natural environment with immersive display technology. In the AMR space, several objects interact in numerous ways which may lead to inconsistencies. Therefore, we have designed a cost-effective and robust communication framework that allows synchronized interaction in real time among different modules of the AMR space. The proposed system consists of Agent-Mediator communication framework. Each smart media agent (SMA) in AMR space has its own data processing, management and visualization units. It has its own copy of all the contents of the scene and renders the whole scene locally. SMA processes the data received from various input embedded devices (e.g. cameras, mic etc.) and updates the local model by reflecting the immersive contents on media walls. SMA maintains synchronization locally by displaying that part of the scene specified by the Mediator as well as transmits the information and raw-data to the Mediator for further processing. Mediator receives data from several SMAs and conducts comparative analysis to select appropriate information for maintaining single and coherent global view of the AMR space. It updates the global view by sharing the synchronized updated status with other SMAs in AMR space. Various experiments have been conducted to evaluate the synchronization and efficiency of the scene displayed on different smart media walls. The effect of gestures/poses recognition has also been assessed in AMR space using the proposed communication framework. Extensive experimental results validate that the proposed communication framework provides a real time interaction with immersive contents and maintain single and synchronized view of the scene in the AMR space.
Abstract
Digital technology has given rise to new media forms. Adaptive mixed reality (AMR) is a new emerging type of media that explores various approaches to combine natural environment with immersive display technology. In the AMR space, several objects interact in numerous ways which may lead to inconsistencies. Therefore, we have designed a cost-effective and robust communication framework that allows synchronized interaction in real time among different modules of the AMR space. The proposed system consists of Agent-Mediator communication framework. Each smart media agent (SMA) in AMR space has its own data processing, management and visualization units. It has its own copy of all the contents of the scene and renders the whole scene locally. SMA processes the data received from various input embedded devices (e.g. cameras, mic etc.) and updates the local model by reflecting the immersive contents on media walls. SMA maintains synchronization locally by displaying that part of the scene specified by the Mediator as well as transmits the information and raw-data to the Mediator for further processing. Mediator receives data from several SMAs and conducts comparative analysis to select appropriate information for maintaining single and coherent global view of the AMR space. It updates the global view by sharing the synchronized updated status with other SMAs in AMR space. Various experiments have been conducted to evaluate the synchronization and efficiency of the scene displayed on different smart media walls. The effect of gestures/poses recognition has also been assessed in AMR space using the proposed communication framework. Extensive experimental results validate that the proposed communication framework provides a real time interaction with immersive contents and maintain single and synchronized view of the scene in the AMR space.
참고문헌 (31)
- P.R. Messinger, "Virtual worlds.past, present, and future: New directions in social computing", Decision Support Systems, 47, pp.204~228 (2009)
- D. Wei, "MTMR: A conceptual interior design framework integrating Mixed Reality with the Multi-Touch tabletop interface, Mixed and Augmented Reality (ISMAR)", 2010 9th IEEE International Symposium on, IEEE, pp.279~280 (2010)
- M. Ibanez, "Learning a foreign language in a mixed-reality environment, Internet Computing", IEEE, 15, pp.44~47 (2011)
- J. Han, "A Mixed-Reality System for Broadcasting Sports Video to Mobile Devices, Multimedia", IEEE, 18, pp.72~84 (2011)
- K. Wan, "Advertising insertion in sports webcasts, Multimedia", IEEE, 14, pp.78~82 (2007)
- G. Papagiannakis, "Practical precomputed radiance transfer for mixed reality", Proceedings of Virtual Systems and Multimedia, pp.189~199 (2005)
- G. Papagiannakis, "Believability and presence in mobile mixed reality environments", IEEE VR2005 Workshop on Virtuality Structures (2005)
- C.E. Hughes, "Mixed reality in education, entertainment, and training, Computer Graphics and Applications", IEEE, 25, pp.24~30 (2005)
- M. Otsuki, "Novel interaction methods with mixed reality space", SICE Annual Conference, pp.456~460 (2008)
- R. Azuma, "Recent advances in augmented reality, Computer Graphics and Applications", IEEE, 21, pp.34~47 (2001)
- C.D. Tran, "EISEval, a Generic Reconfigurable Environment for Evaluating Agent-based Interactive Systems", International Journal of Human-Computer Studies (2013)
- X. Xie, "Immersion with robots in large virtual environments", Proceedings of the seventh annual ACM, 2012, 273~274[DOI]
- G. Humphreys, "Distributed rendering for scalable displays", Proceedings of the 2000 ACM, 2000, 30~[DOI]
- X. Yu, "Inserting 3D projected virtual content into broadcast tennis video", Proceedings of the 14th annual ACM international conference on Multimedia, pp.619~622 (2006), ACM
- A. Egges, "An interactive mixed reality framework for virtual humans", Cyberworlds, W'06. International Conference on, IEEE, pp.165~172 (2006)
- C. Frazier, "OpenGL Reference Manual: the Official Reference Document to OpenGL Vol. 1" (1992)
- P. Merrell, "Model synthesis: A general procedural modeling algorithm", Visualization and Computer Graphics, IEEE Transactions, 17, pp.715~728 (2011)
- C. Niederauer, "Non-invasive interactive visualization of dynamic architectural environments", Proceedings of the 2003 symposium on Interactive 3D graphics, pp.55~58 (2003), ACM
- L. Chittaro, "Vexcms: A tool to design virtual exhibitions and walkthroughs that integrates automatic camera control capabilities", pp.103~114 (2010), Smart Graphics, Springer
- D. Siwiak, "A home-based adaptive mixed reality rehabilitation system", Proceedings of the 19th ACM international conference on Multimedia, 19, pp.785~786 (2011), ACM
- E. Fassbender, "Using a dance pad to navigate through the virtual heritage environment of macquarie lighthouse In Virtual Systems and Multimedia", pp.1~12 (2008), Springer
- H.-J. Kim, "Ambient wall: Smart wall display interface which can be controlled by simple gesture for smart home", SIGGRAPH Asia 2011 Sketches, 1, pp.1~ (2011), ACM
- S.W. Baik, "Agent based distributed data mining In Parallel and Distributed Computing: Applications and Technologies", pp.42~45 (2005), Springer
- N. Ejaz, "A collaborative multi-agent framework for abnormal activity detection in crowded areas", Int J Innov Comput Inform Control, 8, pp.4219~4234 (2012)
- S. Baik, "Performance evaluation of an agent based distributed data mining system In Advances in Artificial Intelligence", pp.25~32 (2005), Springer
- M. Sajjad, "Multi-kernel based adaptive interpolation for image superresolution", Multimedia Tools and Applications, 1(23), pp.1~23 (2012)
- 지수미, "효율적인 3D 게임 및 애니메이션 콘텐츠 제작을 위한 직관적인 저작 기술 개발", 멀티미디어학회논문지, 13(5), pp.780~791 (2010), 한국멀티미디어학회
- J. J. Lee, "A Case Study on 3D Contents Authoring Tool", 한국디지털콘텐츠학회학회지, 7, pp.31~35 (2011)