Region-Based Facial Expression Recognition in Still Images
2
조회
0
다운로드
0
인용
0
참고문헌
키워드
초록
In Facial Expression Recognition Systems (FERS), only particular regions of the face are utilized for discrimination. The areas of the eyes, eyebrows, nose, and mouth are the most important features in any FERS. Applying facial features descriptors such as the local binary pattern (LBP) on such areas results in an effective and efficient FERS. In this paper, we propose an automatic facial expression recognition system. Unlike other systems, it detects and extracts the informative and discriminant regions of the face (i.e.,eyes, nose, and mouth areas) using Haar-feature based cascade classifiers and these region-based features are stored into separate image files as a preprocessing step. Then,LBP is applied to these image files for facial texture representation and a feature-vector per subject is obtained by concatenating the resulting LBP histograms of the decomposed region-based features. The one-vs.-rest SVM, which is a popular multi-classification method, is employed with the Radial Basis Function (RBF) for facial expression classification. Experimental results show that this approach yields good performance for both frontal and near-frontal facial images in terms of accuracy and time complexity. Cohn-Kanade and JAFFE, which are benchmark facial expression datasets, are used to evaluate this approach.
Abstract
In Facial Expression Recognition Systems (FERS), only particular regions of the face are utilized for discrimination. The areas of the eyes, eyebrows, nose, and mouth are the most important features in any FERS. Applying facial features descriptors such as the local binary pattern (LBP) on such areas results in an effective and efficient FERS. In this paper, we propose an automatic facial expression recognition system. Unlike other systems, it detects and extracts the informative and discriminant regions of the face (i.e.,eyes, nose, and mouth areas) using Haar-feature based cascade classifiers and these region-based features are stored into separate image files as a preprocessing step. Then,LBP is applied to these image files for facial texture representation and a feature-vector per subject is obtained by concatenating the resulting LBP histograms of the decomposed region-based features. The one-vs.-rest SVM, which is a popular multi-classification method, is employed with the Radial Basis Function (RBF) for facial expression classification. Experimental results show that this approach yields good performance for both frontal and near-frontal facial images in terms of accuracy and time complexity. Cohn-Kanade and JAFFE, which are benchmark facial expression datasets, are used to evaluate this approach.
참고문헌 (36)
- Ekman P, "Constant across cultures in the face and emotion", Journal of personality and social psychology, pp.124~129 (1971)
- Mehrabian, A, "Silent messages: Implicit communication of emotions and attributes" (1981), Wadsworth Publishing Company
- A Practical Guide to Support Vector Classification, "Hsu C. -W.", ~ (2003)
- Shan C, "Facial expression recognition based on local binary patterns: A comprehensive study", Image and Vision Computing, pp.803~816 (2009)
- Bartlett M, "Fully automatic facial action recognition in spontaneous behavior", Automatic Face and Gesture Recognition, pp.223~228 (2006)
- Giorgana G, "Facial Expression Recognition for Domestic Service Robots", Proceedings of SIMPAR 2010 Workshops, pp.251~262 (2010)
- Ryan A, "Automated Facial Expression Recognition System", in IEEE 43rd International Carnahan Conference on Security Technology, pp.172~177 (2009)
- Lu H, "Real-time facial expression recognition based on pixel- pattern-based texture feature", Electronic Letters, 43(17), pp.916~918 (2007)
- A New Scheme for Image Recognition using Higher-order Local Autocorrelation and Factor Analysis, "Nomoto N", ~ (2005)
- Kurita T, "A face recognition method using higher order local autocorrelation and multivariate analysis", Proc. 11th IAPR International Conf. on Pattern Recognition, pp.213~216 (1992)
- Kurita T, "Gesture Recognition using HLAC Features of PARCOR Images and HMM based Recognizer", IEEE Int. Conf. on Automatic Face and Gesture Recognition (1998)
- Lajevardi, S, "Automatic facial expression recognition: feature extraction and Selection", Signal, Image and Video Processing, pp.1~11 (2011)
- Kanade T, "Comprehensive Database for Facial Expression Analysis", in Fourth IEEE International Conference on Automatic Face and Gesture Recognition, pp.46~53 (2000)
- Lyons M. J, "Coding Facial Expressions with Gabor Wavelets", Third IEEE International Conference on Automatic Face and Gesture Recognition, pp.200~205 (1998)
- Viola P, "Rapid Object Detection Using a Boosted Cascade of Simple Features", proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, 1, pp.511~518 (2001)
- Lienhart R, "An extended set of haar-like features for rapid object detection", Proceedings of the IEEE International Conference o n Image Processing, 1, pp.900~903 (2002)
- Li S. Z, "FloatBoost Learning and Statistical Face Detection", PAM I, pp.1112~1123 (2004)
- Mita T, "Joint Haar-like features for face detection", Proceedings of the International Conference on Computer Vision, pp.1619~1626 (2005)
- Sri-Kaushik Pavani, "Haar-like features with optimally weighted rectangles for rapid object detection", pp.160~172 (2010), Pattern Recognition
- "Face Detection using OpenCV"[URL]
- Empirical Analysis of Detection Cascades of Boosted Classifiers for Rapid Object Detection, "Lienhart R", Intel Corporation, 297~304 (2002)
- Viola, P, "Robust real-time face detection", International Journal of Computer Vision, 57(2), pp.137~154 (2004)
- Lefkovits, S, "Assessments of building classifiers for face detection", Proceedings of International Conference on Recent Achievements in Mechatronics, Automation, Computer Sciences and Robotics MACRO, pp.175~186 (2009)
- Yin L, "A 3D facial expression database for facial behavior research", Proceedings of 7th International Conference on Automatic Face and Gesture Recognition, pp.211~216 (2006)
- Castrillon M.-Santana, "Face and facial feature detection evaluation: Performance Evaluation of Public Domain Haar Detectors for Face and Facial Feature Detection" (2008), VISAPP
- "Haar Cascades"[URL]
- Ojala T, "A comparative study of texture measures with classification based on featured distribution", Pattern Recognition, pp.51~59 (1996)
- Huang D, "Local binary patterns and its application to facial image analysis: a survey", Applications and Reviews, 41(4), pp.1~17 (2011)
- Ojala T, "Multiresolution gray-scale and rotation invariant texture classification with local binary patterns", IEEE Transactions on Pattern Analysis and Machine Intelligence, pp.971~987 (2002)
- Altun H, "New frameworks to boost feature selection algorithms in emotion detection for improved human-computer interaction", Brain Vision and Artificial Intelligent, pp.533~541 (2007)
- "The Spider"[URL]
- Feng X, "A coarse-to-fine classification scheme for facial expression recognition", Proc. Int. Conf. Image Analysis and Recognition, pp.668~675 (2004)
- Liao S, "Facial expression recognition using advanced local binary patterns, tsallis entropies and global appearance features", in Proc. IEEE Int. Conf. Image Processing, pp.665~668 (2006)
- Zhao G, "Experiments with facial expression recognition using spatiotemporal local binary patterns", in Proc. Int. Conf. Multimedia and Expo, pp.1091~1094 (2007)
- Gritti T, "Local features based facial expression recognition with face registration errors", in Proc. IEEE Int. Conf. Automatic Face and Gesture Recognition (2008)
- Hastie T, "The Elements of Statistical Learning; Data Mining, Inference, and Prediction" (2009), Springer