Hand Language Translation Using Kinect
0
조회
0
다운로드
1
인용
0
참고문헌
키워드
초록
Since hand gesture recognition was realized thanks to improved image processing algorithms, sign language translation has been a critical issue for the hearing-impaired. In this paper, we extract human hand figures from a real time image stream and detect gestures in order to figure out which kind of hand language it means. We used depth-color calibrated image from the Kinect to extract human hands and made a decision tree in order to recognize the hand gesture. The decision tree contains information such as number of fingers, contours, and the hand’s position inside a uniform sized image. We succeeded in recognizing ‘Hangul’, the Korean alphabet, with a recognizing rate of 98.16%. The average execution time per letter of the system was about 76.5msec, a reasonable speed considering hand language translation is based on almost still images. We expect that this research will help communication between the hearing-impaired and other people who don’t know hand language.
Abstract
Since hand gesture recognition was realized thanks to improved image processing algorithms, sign language translation has been a critical issue for the hearing-impaired. In this paper, we extract human hand figures from a real time image stream and detect gestures in order to figure out which kind of hand language it means. We used depth-color calibrated image from the Kinect to extract human hands and made a decision tree in order to recognize the hand gesture. The decision tree contains information such as number of fingers, contours, and the hand’s position inside a uniform sized image. We succeeded in recognizing ‘Hangul’, the Korean alphabet, with a recognizing rate of 98.16%. The average execution time per letter of the system was about 76.5msec, a reasonable speed considering hand language translation is based on almost still images. We expect that this research will help communication between the hearing-impaired and other people who don’t know hand language.
참고문헌 (13)
- Douglas Chai, "Face Segmentation Using Skin-Color Map in Videophone Applications", IEEE Transactions on circuits and systems for video technology, 9(4), pp.551~564 (1999)
- Pedro Trindade, "Hand gesture recognition using color and depth images enhanced with hand angular pose data", presented at the IEEE Conference of Multisensor Fusion and Integration for Intelligent Systems, pp.71~76 (2012)
- Yi Li, "Multi-scenario Gesture Recognition using Kinect", presented at the 17th International Conference on Computer Games, pp.126~130 (2012)
- Sanghyeok Oh, "Interactive Learning of Korean Finger Spelling using Data Glove", Proc. Spring Ann. Conference of the Korea Multimedia Society, pp.733~736 (2007)
- Seungki Min, "Optimize Data Glove-based System for Korean Finger Spelling Recognition", pp.237~241 (2007), Korea Information Science Society
- 강민지, "지화 인식을 위한 동영상 처리에 관한 연구", 한국지능시스템학회 논문지, 14(2), pp.184~189 (2004), 한국지능시스템학회
- 양희덕, "연속된 수화 인식을 위한 자동화된 수화 및 지화 적출", 정보과학회논문지 : 소프트웨어 및 응용, 38(2), pp.102~107 (2011), 한국정보과학회
- 박한훈, "Kinect 기반 손 모양 인식을 위한 손 영역 검출에 관한 연구", 방송공학회 논문지, 18(3), pp.393~400 (2013), 한국방송공학회[DOI]
- 상국초, "A Decision Tree based Real-time Hand Gesture Recognition Method using Kinect", 멀티미디어학회논문지, 16(12), pp.1393~1402 (2013), 한국멀티미디어학회[DOI]
- "National Institute of the Korean Language"[URL]