Segmentation of Pointed Objects for Service Robots
0
조회
0
다운로드
0
인용
0
참고문헌
키워드
초록
This paper describes how a person extracts a unknown object with pointing gesture while interacting with a robot. Using a stereo vision sensor, our proposed method consists of two stages: the detection of the operators' face, the estimation of the pointing direction, and the extraction of the pointed object. The operator's face is recognized by using the Haar-like features. And then we estimate the 3D pointing direction from the shoulder-to-hand line. Finally, we segment an unknown object from 3D point clouds in estimated region of interest. On the basis of this proposed method, we implemented an object registration system with our mobile robot and obtained reliable experimental results.
Abstract
This paper describes how a person extracts a unknown object with pointing gesture while interacting with a robot. Using a stereo vision sensor, our proposed method consists of two stages: the detection of the operators' face, the estimation of the pointing direction, and the extraction of the pointed object. The operator's face is recognized by using the Haar-like features. And then we estimate the 3D pointing direction from the shoulder-to-hand line. Finally, we segment an unknown object from 3D point clouds in estimated region of interest. On the basis of this proposed method, we implemented an object registration system with our mobile robot and obtained reliable experimental results.
참고문헌 (15)
- Nebojsa Jojic, "Detection and Estimation of Pointing Gestures in Dense Disparity Maps", International Conference on Automatic Face and Gesture Recognition, pp.468~475 (2000)
- Yu Yamamoto, "Armpointing Gesture Interface Using Surrounded Stereo Cameras System", Proceedings of International Conference on Pattern Recognition, 4, pp.965~970 (2004)
- Sébastien Carbini, "Pointing Gesture Visual Recognition by Body Feature Detection and Tracking", Computer Vision and Graphics, pp.203~208 (2006)
- A.D. Wilson, "Recognition and Interpretation of Parametric Gesture", Intl. Conference on Computer Vision, pp.329~336 (1998)
- Kai Nickel, "Pointing Gesture Recognition based on 3DTracking of Face, Hands and Head Orientation", Fifth International Conference on Multimodal Interfaces, pp.140~146 (2003)
- Paul Viola, "Rapid Object Detection using a Boosted Cascade of Simple Features", Computer Vision and Pattern Recognition, 1, pp.511~518 (2001)
- C.G. Harris, "A combined corner and edge detector", pp.147~151 (1988), Proc. Fourth Alvey Vision Conf
- V. Paquin, "A Vision-Based Gestural Guidance Interface for Mobile Robotic Platforms", In In Proc. of the Workshop on HCI, Computer Vision in Human-Computer Interaction, pp.39~47 (2004)
- R. Kahn, "Gesture recognition using the Perseus architecture", In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp.734~741 (1996)
- J. Shi, "Normalized Cuts and Image Segmentation", IEEE Trans. Pattern Analysis and Machine Intelligence, 22(8), pp.888~905 (2000)
- Canny, J, "A Computational Approach to Edge Detection", IEEE Trans. Pattern. Analysis and Machine Intelligence, 8, pp.679~714 (1986)
- Joerg C. Wolf, "Linking Speech and Gesture in Multimodal Instruction Systems", Proc. of the 15th IEEE Intl. Symp. on Robot and Human Interactive Communication (RO-MAN06) Hatfield, pp.141~144 (2006)
- J¨org Rett, "Gesture Recognition Using a Marionette Model and Dynamic Bayesian Networks (DBNs)", ICIAR 2006, LNCS 4142, pp.69~80 (2006)
- C. Harris, "A combined corner and edge detector", In Alvey Vision Conference, pp.147~152 (1988)