가젯암: 확장현실을 위한 손 제스처 기반 대화형 데이터 시각화 시스템
Gadget Arms: Interactive Data Visualization using Hand Gesture in Extended Reality
0
조회
0
다운로드
5
인용
0
참고문헌
키워드
초록
가상 및 증강현실과 같은 확장현실(XR: Extended Reality)은 몰입형 데이터 시각화 및 분석을 위한 거대한 잠재력을 가지고 있다. 확장현실에서 사용자는 3차원 가상 공간을 활용하여 데이터 및 여러 사용자와 사실적으로 상호 작용할 수 있으므로 보다 직관적인 데이터 분석이 가능하다. 그러나 확장현실의 장점을 제대로 활용하기 위한 시각화를 생성하는 것은 복잡한 프로그래밍이 필요하기 때문에 상당히 어려운 일이다. 본 논문에서는 손 제스처만으로 XR을 위한 시각화 전 과정을 수행하 고, 모든 3차원 공간을 활용할 수 있는 가젯암(Gadget Arms) 시스템을 제안한다. 이 시스템에서 분석가는 데스크탑 기반 환경이나 복잡한 프로그래밍을 사용할 필요 없이 XR 기기를 착용한 상태에서 직관적으로 전체 시각화 공간을 디자인할 수 있으며, 가상의 손을 임의의 3차원 공간에 자유자재로 위치시킬 수 있는 인터랙션을 통해 거대한 3차원 공간을 효과적으로 활용할 수 있다. 우리는 사용자 연구를 통해 제안된 시스템이 시각화 제작과 공간 활용의 사용성을 크게 향상시시키는 것을 확인하였다.
Abstract
Extended Reality (XR), such as virtual and augmented reality, has huge potential for immersive data visualization and analysis. In XR, users can interact with data and other users realistically by navigating the shared virtual space, allowing for more intuitive data analysis. However, creating a visualization in XR also poses a challenge because complicated, low-level programming is required, which hinders broad adaptation in visual analytics. This paper proposes an interactive visualization authoring tool based on hand gesture for immersive data visualization?Gadget Arms. The proposed system provides a novel user interaction to create and place visualization in the 3D virtual world. This simple, but intuitive, user interaction enables user designs the entire visualization space in the XR without using a host computer and low-level programming. Our user study also confirmed that the proposed user interaction significantly improves the usability of the visualization authoring tool.
참고문헌 (34)
- "Inspector Gadget"[URL]
- "Leap Motion"[URL]
- "Microsoft Docs"[URL]
- "Unity"[URL]
- Hassan Abu Alhaija, "Augmented Reality Meets Computer Vision: Efficient Data Generation for Urban Driving Scenes", International Journal of Computer Vision, 126(9), pp.961~972 (2018)
- Rahul Arora, "SymbiosisSketch: Combining 2D & 3D Sketching for Designing Detailed 3D Objects in Situ", Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems. ACM (2018)
- Benjamin Bach, "Drawing into the AR-CANVAS: Designing embedded visualizations for augmented reality", Workshop on Immersive Analytics, IEEE Vis (2017)
- Hrvoje Benko, "Normaltouch and texturetouch: High-fidelity 3d haptic shape rendering on handheld virtual reality controllers", Proceedings of the 29th Annual Symposium on User Interface Software and Technology. ACM, pp.717~728 (2016)
- Simon Butscher, "Clusters, Trends, and Outliers: How Immersive Technologies Can Facilitate the Collaborative Analysis of Multidimensional Data", Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems (CHI ’18). ACM (2018)
- Yeonjoo Cha, "Extended Fitts’ law for 3D pointing tasks using 3D target arrangements", International Journal of Industrial Ergonomics, 43(4), pp.350~355 (2013)
- Inrak Choi, "CLAW: A Multifunctional Handheld Haptic Controller for Grasping, Touching, and Triggering in Virtual Reality", Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems. ACM, pp.654~ (2018)
- Maxime Cordeil, "ImAxes: Immersive Axes As Embodied Affordances for Interactive Multivariate Data Visualisation", Proceedings of the 30th Annual ACM Symposium on User Interface Software and Technology (UIST ’17). ACM, pp.71~83 (2017)
- Maxime Cordeil, "Immersive collaborative analysis of network connectivity: Cave-style or head-mounted display?", IEEE transactions on visualization and computer graphics, 23(1), pp.441~450 (2017)[DOI]
- Ciro Donalek, "Immersive and collaborative data visualization using virtual reality platforms", 2014 IEEE International Conference on Big Data (Big Data), pp.609~614 (2014)
- Adrien Fonnet, "Immersive Data Exploration and Analysis", Student Interaction Design Research conference (2018)
- Joon Hyub Lee, "Projective Windows: Bringing Windows in Space to the Fingertip", Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems. ACM (2018)
- James R Lewis, "IBM computer usability satisfaction questionnaires: psychometric evaluation and instructions for use", International Journal of HumanComputer Interaction, 7(1), pp.57~78 (1995)
- Martin Luboschik, "On spatial perception issuesin augmented reality based immersive analytics", Proceedings of the 2016 ACM Companion on Interactive Surfaces and Spaces. ACM, pp.47~53 (2016)
- Longfei Ma, "Augmented reality surgical navigation with ultrasound-assisted registration for pedicle screw placement : a pilot study", International journal of computer assisted radiology and surgery, 12(12), pp.2205~2215 (2017)
- Patrick Millais, "Exploring Data in Virtual Reality: Comparisons with 2D Data Visualizations", Extended Abstracts of the 2018 CHI Conference on Human Factors in Computing Systems (CHI EA ’18). ACM, pp.6~ (2018)
- Patrick Millais, "Exploring Data in Virtual Reality: Comparisons with 2D Data Visualizations", Extended Abstracts of the 2018 CHI Conference on Human Factors in Computing Systems. ACM (2018)
- Ekaterina Olshannikova, "Visualizing Big Data with augmented and virtual reality: challenges and research agenda", Journal of Big Data, 2(1), pp.22~ (2015)
- Scott Riddle, "Touching The Human Neuron: User-Centric Augmented Reality Viewing and Interaction of in-vivo Cellular Confocal Laser Scanning Microscopy (CLSM) Utilizing High Resolution zStack Data Sets", Journal of Biocommunication, 41(1) (2017)
- Ronell Sicat, "DXR: A Toolkit for Building Immersive Data Visualizations", IEEE Transactions on Visualization and Computer Graphics (2018)
- Maurício Sousa, "VRRRRoom: Virtual Reality for Radiologists in the Reading Room", Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems (CHI ’17). ACM, pp.4057~4062 (2017)
- Daniele Sportillo, "An immersive Virtual Reality system for semiautonomous driving simulation: a comparison between realistic and 6-DoF controller-based interaction", Proceedings of the 9th International Conference on Computer and Automation Engineering. ACM, pp.6~10 (2017)
- Will Usher, "A virtual reality visualization tool for neuron tracing", IEEE transactions on visualization and computer graphics, 24(1), pp.994~1003 (2018)
- Eric Whitmire, "Haptic Revolver: Touch, Shear, Texture, and Shape Rendering on a Reconfigurable Virtual Reality Controller", Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems. ACM (2018)
- Ivan Poupyrev, "Tadao Ichikawa: The Go-Go Interaction Technique: Non-Linear Mapping for Direct Manipulation in VR", Symposium on User Interface Software and Technology, pp.79~80 (1996)
- Bowman, D. A., "An evaluation of techniques for grabbing and manipulating remote objects in immersive virtual environments", Proceedings of the 1997 symposium on Interactive 3D graphics ACM, pp.35-ff~ (1997)
- "Google Tilt Brush"[URL]
- "Mixed Reality Toolkit"[URL]
- D. Filonik, "Glance: Generalized geometric primitives and transformations for information visualization in AR", VR environments, 2016, 461~468