사진 속 피사체의 법선 벡터 예측에 기반한 햅틱 상호 작용
Haptic Interaction with Objects Displayed in a Picture based on Surface Normal Estimation
1
조회
0
다운로드
0
인용
0
참고문헌
키워드
초록
In this paper we propose a haptic interaction system that physically represents the underlying geometry of objects displayed in a 2D picture, i.e., a digital image. To obtain the object’s geometry displayed in the picture, we estimate the physical transformation between the object plane and the image plane based on homographic information. We then calculate the rotated surface normal vector of the object’s face and place it on the corresponding part in the 2D image. The purpose of this setup is to create a force that can be rendered along with the image without distorting the visual information. We evaluated the proposed haptic rendering system using a set of pictures of objects with different orientations. The experimental results show that the participants reliably identified the geometric configuration by touching the object in the picture. We conclude this paper with a set of applications.
Abstract
In this paper we propose a haptic interaction system that physically represents the underlying geometry of objects displayed in a 2D picture, i.e., a digital image. To obtain the object’s geometry displayed in the picture, we estimate the physical transformation between the object plane and the image plane based on homographic information. We then calculate the rotated surface normal vector of the object’s face and place it on the corresponding part in the 2D image. The purpose of this setup is to create a force that can be rendered along with the image without distorting the visual information. We evaluated the proposed haptic rendering system using a set of pictures of objects with different orientations. The experimental results show that the participants reliably identified the geometric configuration by touching the object in the picture. We conclude this paper with a set of applications.
참고문헌 (19)
- J. P. Fritz, "Stochastic models for haptic texture", 34~44
- J. Shopf, "Procedural haptic texture", 179~185
- S.-C. Kim, "Sound Generation for the Haptic Perception using an Irregular Primitive Function", 19~24
- P. Bach-y-Rita, "Vision substitution by tactile image projection", Nature, 221(6845), pp.963~964 (1969)
- M. Shinohara, "Threedimensional tactile display for the blind", Rehabilitation Engineering, IEEE Transactions on, 6(3), pp.249~256 (1998)
- B.-K. Han, "Physical mobile interaction with kinesthetic feedback", 571~575
- S.-C. Kim, "Feeling the unseen: physical interaction with depth-embedded images", in CHI '13 Extended Abstracts on Human Factors in Computing Systems, pp.727~732 (2013)
- M. Minsky, "Feeling and seeing: issues in force display", SIGGRAPH Comput. Graph, 24(2), pp.235~241 (1990)
- A. Israr, "Tactile feedback on flat surfaces for the visually impaired", in Proceedings of the 2012 ACM annual conference extended abstracts on Human Factors in Computing Systems Extended Abstracts, pp.1571~1576 (2012)
- G. Robles-De-La-Torre, "Virtual surfaces and haptic shape perception", 1081~1085
- G. Robles-De-La-Torre, "Force can overcome object geometry in the perception of shape through active touch", Nature, 412(6845), pp.445~448 (2001)
- S. Saga, "Lateral-Force-Based 2.5- Dimensional Tactile Display for Touch Screen", 15~22
- K. Hinckley, "The videomouse: a camera-based multi-degree-of-freedom input device", 103~112
- K. D. D. Willis, "SideBySide: ad-hoc multi-user interaction with handheld projectors", in Proceedings of the 24th annual ACM symposium on User interface software and technology, pp.431~440 (2011)
- S. J. Lederman, "Haptic identification of common objects : Effects of constraining the manual exploration process", Attention, Perception, & Psychophysics, 66(4), pp.618~628 (2004)
- S. J. Lederman, "Haptic perception : A tutorial", Attention, Perception, & Psychophysics, 71(7), pp.1439~1459 (2009)
- H. Yano, "Haptic interface for perceiving remote object using a laser range finder", in Proceedings of the Third Joint EuroHaptics Conference and Symposium on Haptic Interfaces for Virtual Environment and Teleoperator Systems, pp.196~201 (2009)
- D. C. Ruspini, "The haptic display of complex graphical environments", 345~352
- C. Basdogan, "A ray-based haptic rendering technique for displaying shape and texture of 3D objects in virtual environments", 77~84