A Vision-Based Method to Find Fingertips in a Closed Hand
0
조회
0
다운로드
1
인용
0
참고문헌
키워드
초록
Hand gesture recognition is an important area of research in the field of Human Computer Interaction (HCI). The geometric attributes of the hand play an important role in hand shape reconstruction and gesture recognition. That said, fingertips are one of the important attributes for the detection of hand gestures and can provide valuable information from hand images. Many methods are available in scientific literature for fingertips detection with an open hand but very poor results are available for fingertips detection when the hand is closed. This paper presents a new method for the detection of fingertips in a closed hand using the corner detection method and an advanced edge detection algorithm. It is important to note that the skin color segmentation methodology did not work for fingertips detection in a closed hand. Thus the proposed method applied Gabor filter techniques for the detection of edges and then applied the corner detection algorithm for the detection of fingertips through the edges. To check the accuracy of the method, this method was tested on a vast number of images taken with a webcam. The method resulted in a higher accuracy rate of detections from the images. The method was further implemented on video for testing its validity on real time image capturing. These closed hand fingertips detection would help in controlling an electro-mechanical robotic hand via hand gesture in a natural way.
Abstract
Hand gesture recognition is an important area of research in the field of Human Computer Interaction (HCI). The geometric attributes of the hand play an important role in hand shape reconstruction and gesture recognition. That said, fingertips are one of the important attributes for the detection of hand gestures and can provide valuable information from hand images. Many methods are available in scientific literature for fingertips detection with an open hand but very poor results are available for fingertips detection when the hand is closed. This paper presents a new method for the detection of fingertips in a closed hand using the corner detection method and an advanced edge detection algorithm. It is important to note that the skin color segmentation methodology did not work for fingertips detection in a closed hand. Thus the proposed method applied Gabor filter techniques for the detection of edges and then applied the corner detection algorithm for the detection of fingertips through the edges. To check the accuracy of the method, this method was tested on a vast number of images taken with a webcam. The method resulted in a higher accuracy rate of detections from the images. The method was further implemented on video for testing its validity on real time image capturing. These closed hand fingertips detection would help in controlling an electro-mechanical robotic hand via hand gesture in a natural way.
참고문헌 (17)
- Chaudhary, A., "An ANN based Approach to Calculate Robotic fingers positions", Published as Book Chapter in Lecture Notes in Computer Sciences, CCIS, Springer Berlin Heidelberg, 192(3), pp.488~496 (2011)
- Chaudhary, A., "A Vision based Geometrical Method to find Fingers Positions in Real Time Hand Gesture Recognition", Journal of Software, 7 (2012), Academy Publisher
- Gastaldi G., "a man-machine communication system based on the visual analysis of dynamic gestures", International conference on image processing, Genoa, Italy, pp.397~400 (2005)
- 이웅기, "Hand Shape Recognition Using Fingertip", Fuzzy Systems and Knowledge Discovery, pp.44~48 (2008), IEEE Computer Society
- 전준철, "Manipulation of Virtual Objects in Marker-less AR System by Fingertip Tracking and Hand Gesture Recognition", The 2nd International Conference on Interaction Sciences: Information Technology, Culture and Human(ICIS 2009), pp.1110~1115 (2009), ACM, AICIT
- 이대호, "Vision-Based Remote Control System by Motion Detection and Open Finger Counting", IEEE TRANSACTIONS ON CONSUMER ELECTRONICS, 55(4), pp.2308~2313, IEEE-INST ELECTRICAL ELECTRONICS ENGINEERS INC
- Nguyen, D.D., "Fingertip Detection with Morphology and Geometric Calculation", IEEE, 2009, 1460~1465
- Nolker, C., "Visual Recognition of Continuous Hand Postures", IEEE Transactions on neural networks, 13(4), pp.983~994 (2002)
- Raheja, J.L., "Tracking of Fingertips and Centers of Palm Using KINECT", Proceedings of 3rd Internatinal Conference on Computational Intelligence, Modelling and Simulation (CIMSiM), pp.248~252 (2011)
- Sawah, A.E., "A framework for 3D hand tracking and gesture recognition using elements of genetic programming", Proceedings of 4th Canadian conference on Computer and robot vision, Montreal, Canada, pp.495~502 (2007)
- Shin, M. C., "Gesture recognition using bezier curves for visualization navigation from registered 3d data", Pattern Recognition, 37(5), pp.1011~1024 (2004)
- Zhou, H., "A Real-time Gesture Recognition Algorithm on Video Surveillance", Proceedings of 8th international conference on Signal Processing, 3 (2006)
- Raheja, J. L., "A. An Efficient Real time method of fingertip detection", Proceeding of 7th International Conference on Trends in Industrial Measurements and Automation (TIMA 2011), Chennai, INDIA, pp.447~450 (2011)
- Real-time Hand Tracking and Finger Tracking for Interaction, "Malik, S.", ~, pp.CSC2503F
- Raheja J.L., "Real-Time Robotic Hand Control using Hand Gesture", 2nd international conference on Machine Learning and Computing, Bangalore, India, pp.12~16 (2010)
- Chaudhary, A., "A Survey on Hand Gesture Recognition in context of Soft Computing", Published as Book Chapter in Advanced Computing CCIS, 133, pp.46~55 (2010), Springer Berlin Heidelberg
- Choi, J., "Morphological Gesture Recognition Algorithm, Proceeding of IEEE region", 10th international conference on Electrical and Electronic Technology, Coimbra, Portugal, pp.291~296 (2001)