키넥트를 이용한 수화 인식
Sign Language Recognition Using Kinect
0
조회
0
다운로드
1
인용
0
참고문헌
키워드
초록
Sign language is a visual language expressed by facial expressions and body gestures, etc. The instances of signs vary in both motion and shape in three-dimensional (3D) space. In this research, 3D depth information is generated from Microsoft’s Kinect sensor and then a hierarchical conditional random field (CRF) that segments hand signs using 3D hand motions. A BoostMap embedding method is used to verify the hand shapes of the segmented signs. Experiments demonstrated that the proposed method could recognize signs at a rate of 90.4%.
Abstract
Sign language is a visual language expressed by facial expressions and body gestures, etc. The instances of signs vary in both motion and shape in three-dimensional (3D) space. In this research, 3D depth information is generated from Microsoft’s Kinect sensor and then a hierarchical conditional random field (CRF) that segments hand signs using 3D hand motions. A BoostMap embedding method is used to verify the hand shapes of the segmented signs. Experiments demonstrated that the proposed method could recognize signs at a rate of 90.4%.
참고문헌 (14)
- Yang, H.-D., "Sign language spotting with a threshold model based on conditional random fields", IEEE Trans. Pattern Anal. Mach. Intell, 31, pp.1264~1277 (2009)
- Yang, H.-D., "Simultaneous spotting of signs and fingerspellings based on hierarchical conditional random fields and boostmap embeddings", Pattern Recognition, 43, pp.2858~2870 (2010)
- Yang, H.-D., "Robust sign language recognition by combining manual and non-manual features based on conditional random field and support vector machine", Pattern Recognition Letters, 34, pp.2051~2056 (2013)
- Yang, H.-D., "Sign language recognition with the Kinect sensor based on conditional random fields", Sensors, 15(1), pp.135~147 (2015)
- Lahamy, H., "Towards real-time and rotation-invariant American Sign Language alphabet recognition using a range camera", Sensors, 12, pp.14416~14441 (2012)
- Ren, Z., "Robust part-based hand gesture recognition using kinect sensor", IEEE Trans. Multimedia, 15, pp.1110~1120 (2013)
- Palacios, J., "Human-computer interaction based on hand gestures using RGB-D sensors", Sensors, 13, pp.11842~11860 (2013)
- Zhang, S., "Low-Cost interactive whiteboard using the Kinect", Proc. of the International Conference on Image Analysis and Signal Processing, pp.1~5 (2012)
- Chang, Y.J., "A Kinect-based system for physical rehabilitation:A pilot study for young adults with motor disabilities", Res. Dev. Disabil, 32, pp.2566~2570 (2011)
- Zafrulla, Z., "American sign language recognition with the kinect", Proc. of the International Conference on Multimodal Interfaces, pp.279~286 (2011)
- Chai, X., "Sign language recognition and translation with kinect", Proc. of IEEE International Conference on Automatic Face and Gesture Recognition, pp.22~26 (2013)
- Moreira Almeida, S., "Extraction in Brazilian sign language recognition based on phonological structure and using RGB-D. sensors", Expert Syst. Appl, 41, pp.7259~7271 (2014)
- Fischler, M.A., "Random sample consensus: A paradigm for model fitting with applications to image analysis and automated cartography", Comm. ACM, 24, pp.381~395 (1981)
- Athitsos, V., "BoostMap: An embedding method for efficient nearest neighbor retrieval", IEEE Trans. on Pattern Analysis and Machine Intelligence, 30(1), pp.89~104 (2008)