영상처리 기반 숫자 수화표현 인식 알고리즘
Numeric Sign Language Interpreting Algorithm Based on Hand Image Processing
0
조회
0
다운로드
3
인용
0
참고문헌
키워드
초록
The existing auxiliary communicating aids for the hearing-impaired have an inconvenience of using additional expensive sensing devices. This paper presents a hand image detection based algorithm to interpret the sign language of the hearing-impaired. The proposed sign language recognition system exploits the hand image only captured by the camera without using any additional gloves with extra sensors. Based on the hand image processing, the system can perfectly classify several numeric sign language representations. This work proposes a simple lightweight classification algorithm to identify the hand image of the hearing-impaired to communicate with others even further in an environment of complex background. Experimental results show that the proposed system can interpret the numeric sign language quite well with an accuracy of 95.6% on average.
Abstract
The existing auxiliary communicating aids for the hearing-impaired have an inconvenience of using additional expensive sensing devices. This paper presents a hand image detection based algorithm to interpret the sign language of the hearing-impaired. The proposed sign language recognition system exploits the hand image only captured by the camera without using any additional gloves with extra sensors. Based on the hand image processing, the system can perfectly classify several numeric sign language representations. This work proposes a simple lightweight classification algorithm to identify the hand image of the hearing-impaired to communicate with others even further in an environment of complex background. Experimental results show that the proposed system can interpret the numeric sign language quite well with an accuracy of 95.6% on average.
참고문헌 (22)
- "Statistics Korea 1. (The Number of Registered Disabled Person – By City, Type, Gender) 2. (Characteristics of Hearing Disabled – Method to Communicate Who Mostly Use)", ~
- S. Glennen, "The Handbook of Augmentative and Alternative Communication" (1997), Singular Publishing Group, INC
- Joshua R. New, "A Method for Hand Gesture Recognition", Proceedings of IEEE Communication Systems and Network Technologies, pp.919~923 (2002)
- C. Dong, "American Sign Language Alphabet Recognition Using Microsoft Kinect", Proceedings of IEEE Conference on Computer Vision and Pattern Recognition, pp.44~25 (2015)
- "EnableTalk website"[URL]
- 구성민, "청각장애인을 위한 오픈 소스 하드웨어 기반의 수화통역 장갑 & 상황 인지 보조 IoT 장치", 정보과학회 컴퓨팅의 실제 논문지, 24(4), pp.204~209 (2018), 한국정보과학회[DOI]
- M. Frenando, "Low Cost Approach for Real Time Sign Language Recognition", Proceedings of IEEE Conference on Industrial and Information Systems, pp.18~20 (2013)
- S.S. Hazari, "Designing a Sign Language Translation System Using Kinect Motion Sensor Device", Proceedings of Conference on Electrical, Computer and Communication Engineering, pp.16~18 (2017)
- D.M. Capilla, "Sign Language Translator Using Microsoft Kinect XBOX 360™", Department of Electrical Engineering and Computer Science - compute Vision Lab, University of Tennessee, ~ (2012)
- A. Kumar, "Sign Language Recognition", Proceedings of Conference on Recent Advances in Information Technology (2016)
- 채수환, "노이즈에 강인한 HSV 색상 모델 기반손 윤곽 검출 시스템", 멀티미디어학회논문지, 18(10), pp.1149~1156 (2015), 한국멀티미디어학회[DOI]
- R.N. Nagashree, "Hand Gesture Recognition Using Support Vector Machine", Journal of Engineering And Science (IJES), 4(6), pp.42~46 (2015)
- T. Lindeberg, "Scale Invariant Feature Transform", Journal of Computer Sciences Computer Vision and Robotics (Autonomous Systems), 7(5), pp.10491~ (2012)
- J. Zhang, "Chinese Sign Language Recognition with Adaptive HMM", Proceedings of IEEE International Conference on Multimedia and Expo (ICME), pp.1~6 (2016)
- P. Molchanov, "Hand Gesture Recognition with 3D Convolutional Neural Networks", Proceedings of IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp.1~7 (2015)
- S. Kolkur, "Human Skin Detection Using RGB, HSV, and YCbCr Color Models", Proceedings of IEEE Conference on Acoustics, Speech and Signal Processing (2017)
- "Wikipedia document (HSL and HSV)"[URL]
- Y. Xu, "Identification of Hand Region Based on YCgCr Color Representation", Journal of Applied Engineering Research, 12(6), pp.1031~1034 (2017)
- Z. Zhengzhen, "Skin Color Detecting Unite YCgCb Color Space with YCgCr Color Space", Proceedings of Conference on Image Analysis and Signal Processing, pp.221~225 (2009)
- W.Burger, "Digital Image Processing: An Algorithmic Introduction Using Java Second Edition" (2016), Springer
- "Python library"[URL]
- A. Dhawan, "Implementation of Hand Detection based Techniques for Human Computer Interaction", International Journal of Computer Applications, 72(17), pp.6~13 (2013)