화자의 긍정·부정 의도를 전달하는 실용적 텔레프레즌스 로봇 시스템의 개발
Development of a Cost-Effective Tele-Robot System Delivering Speaker’s Affirmative and Negative Intentions
0
조회
0
다운로드
0
인용
0
참고문헌
키워드
초록
A telerobot offers a more engaging and enjoyable interaction with people at a distance by communicating via audio, video, expressive gestures, body pose and proxemics. To provide its potential benefits at a reasonable cost, this paper presents a telepresence robot system for video communication which can deliver speaker’s head motion through its display stanchion. Head gestures such as nodding and head-shaking can give crucial information during conversation. We also can assume a speaker’s eye-gaze, which is known as one of the key non-verbal signals for interaction, from his/her head pose. In order to develop an efficient head tracking method, a 3D cylinder-like head model is employed and the Harris corner detector is combined with the Lucas-Kanade optical flow that is known to be suitable for extracting 3D motion information of the model. Especially, a skin color-based face detection algorithm is proposed to achieve robust performance upon variant directions while maintaining reasonable computational cost. The performance of the proposed head tracking algorithm is verified through the experiments using BU's standard data sets. A design of robot platform is also described as well as the design of supporting systems such as video transmission and robot control interfaces.
Abstract
A telerobot offers a more engaging and enjoyable interaction with people at a distance by communicating via audio, video, expressive gestures, body pose and proxemics. To provide its potential benefits at a reasonable cost, this paper presents a telepresence robot system for video communication which can deliver speaker’s head motion through its display stanchion. Head gestures such as nodding and head-shaking can give crucial information during conversation. We also can assume a speaker’s eye-gaze, which is known as one of the key non-verbal signals for interaction, from his/her head pose. In order to develop an efficient head tracking method, a 3D cylinder-like head model is employed and the Harris corner detector is combined with the Lucas-Kanade optical flow that is known to be suitable for extracting 3D motion information of the model. Especially, a skin color-based face detection algorithm is proposed to achieve robust performance upon variant directions while maintaining reasonable computational cost. The performance of the proposed head tracking algorithm is verified through the experiments using BU's standard data sets. A design of robot platform is also described as well as the design of supporting systems such as video transmission and robot control interfaces.
참고문헌 (16)
- M. Minsky, "Telepresence", pp.45~51 (1980), Omni
- S. Coradeschi, "Towards a methodology for longitudinal evaluation of social robotic telepresence for elderly", HRI 2011 Workshop on Social Robotic Telepresence (2011)
- K.M. Tsui, "Designing telepresence robot Systems for use by people with special needs", Proceedings of the International Symposiurn on Quality of Life Teclmologies (2011)
- J. H. Lee, "Trends of tele-presence technology standards", Journal of The Korean Institute of Communication Sciences, 29(12), pp.25~30 (2012)
- E. Paulos, "Social tele-embodiment: Understanding presence", Autonomous Robots, 11(1), pp.87~95 (2001)
- E. Murphy-Chutorian, "Head pose estimation in computer vision: A Survey", IEEE Trans. Pattern Analysis and Machine Intelligence, 31(4), pp.607~626 (2009)
- M.L. Cascia, "Fast, reliable head tracking under varying illumination: An Approach based on registration of texture-mapped 3D models", IEEE Trans. Pattern Analysis and Machine Intelligence, 22(4), pp.322~336 (2000)
- C. Basu, "Motion regularization for model-based head tracking", Proc. of International Conference on Pattern Recognition (1996)
- C. Harris, "A combined comer and edge detector", Proc. of 4th Alvey Vision Conference, pp.141~151 (1988)
- B.D. Lucas, "An iterative image registration technique with an application to stereo vision", Proc. of Imaging Understanding Workshop, pp.121~130 (1981)
- D.F. DeMenthon, "Model-based object pose in 25 lines of code", International Journal of Computer Vision, 15, pp.335~343 (1995)
- P. Viola, "Robust real-time face detection", International Journal of Computer Vision, 57(2), pp.137~154 (2004)
- 김안나, "Kinect센서를 이용한 물체 인식 및 자세 추정을 위한 정확도 개선 방법", 로봇학회 논문지, 10(1), pp.16~23 (2015), 한국로봇학회[DOI]
- 김주창, "바디 제스처 인식을 위한 기초적 신체 모델 인코딩과 선택적", 비동시적 입력을 갖는 병렬 상태 기계, 2013, pp.8(1), 1~7[DOI]