인간과 기계의 지능형 인터페이스를 위한 감정 인식 기술
Emotion Recognition for Intelligent Man-Machine Interface
1
조회
0
다운로드
1
인용
0
참고문헌
키워드
초록
인간과 기계의 인터페이스 연구에서는 최근 자연스러운 인터페이스 구현을 위해 사람의 감정을 인식하는 기술이 각광을 받고 있다. 기존의 인터페이스 기술이 기계가 이해하기 쉬운 입력을 사람이 제시하고 인식하는 것을 위주로 하는 기계 중심의 인터페이스였다면, 감정인식 기술은 기계가 사람의 감정을 인식하도록 하여 상황에 맞는 반응을 할 수 있도록 하는 인간 중심의 인터페이스라 할 수 있다. 본 논문에서는 최근의 감정인식 기술 동향을 소개한다. 인간의 감정에 대한 연구를 간략히 알아보고, 시각, 청각 및 생리적 신호 정보를 이용한 인식 기술을 전반적으로 알아본다. 또한 감정 인식에서 해결해야 할 앞으로의 연구 과제와 응용 분야를 제시한다.
Abstract
In recent man-machine interface researches, the technology for recognition of humans’ emotion by machines has received much attention as a way of implementing natural interfaces. While conventional interface techniques have mainly concentrated on developing machine-centered interfaces where humans should generate inputs easily understandable for machines, emotion recognition is a human-centered interface for machines’ adaptive reactions according to humans’ emotional states. This paper surveys recent advances in emotion recognition. We briefly overview psychological aspects of humans’ emotion and present the state-of-the-art technologies of emotion recognition using acoustic, visual and physiological signals. Also, we present directions for future researches and applications of emotion recognition.
참고문헌 (69)
- D. Keltner, "''Facial expression of emotion,'' in Handbook of Emotions", pp.236~249 (2000), Guilford Press
- P. Lang, "The emotion probe: Studies of motivation and attention", American Psychologist, 50(5), pp.372~385 (1995)
- A. Mehrabian, "Communication without words", Psychology Today, 2(4), pp.53~56 (1968)
- P. Ekman, "Emotion in the Human Face" (1982), Cambridge Univ. Press
- P. Ekman, "Facial Action Coding System: A Technique for the Measurement of Facial Movement" (1978), Consulting Psychologists Press
- M. H. Yang, "Detecting faces in images: A survey", IEEE Trans. Pattern Anal. Machine Intell, 24(1), pp.34~58 (2002)
- I. Essa, "Coding, analysis, interpretation and recognition of facial expressions", IEEE Trans. Pattern Anal. Machine Intell, 19(7), pp.757~763 (1997)
- M. Pantic, "Expert system for automatic analysis of facial expressions", J. Image Vision Comput, 18(11), pp.881~905 (2000)
- Y.-I. Tian, "Recognizing action units for facial expression analysis", IEEE Trans. Pattern Anal. Machine Intell, 23(2), pp.97~115 (2001)
- L. Ma, "Facial expression recognition using constructive feedforward neural networks", IEEE Trans. Syst. Man Cybern. B, 34(3), pp.1588~1595 (2004)
- X. Chen, "Facial expression recognition: A clustering-based approach", Pattern Recognit. Lett, 24(9-10), pp.1295~1302 (2003)
- Y. Chang, "Manifold based analysis of facial expression", J. Image Vision Comput, 24(6), pp.605~614 (2006)
- M. J. Lyons, "Automatic classification of single facial images", IEEE Trans. Pattern Anal. Machine Intell, 21(12), pp.1357~1362 (1999)
- S. Lucey, "Investigating spontaneous facial action recognition through AAM representations of the face, in Face Recognition", pp.275~ (2007), I-Tech Education and Publishing
- Z. Zeng, "Spontaneous emotional facial expression detection", J. Multimedia, 1(5), pp.1~8 (2006)
- J. F. Cohn, "Automatic analysis and recognition of brow actions and head motion in spontaneous facial behavior", Proc. Int. Conf. Systems, Man, Cybernetics, The Hague, The Netherlands, pp.610~616 (2004)
- Y. Chang, "Automatic 3D facial expression analysis in videos", Proc. Int. Workshop on Analysis and Modeling of Faces and Gestures, Beijing, China, pp.293~307 (2005)
- T. Otsuka, "Spotting segments displaying facial expression from image sequences using HMM", Proc. Int. Conf. Automatic Face and Gesture Recognition, Nara, Japan, pp.442~447 (1998)
- M. Black, "Recognizing facial expressions in image sequences using local parameterized models of image motion", Int. J. Computer Vision, 25(1), pp.23~48 (1997)
- J. Cohn, "Automated face coding: a computer-vision based method of facial expression analysis", Proc. European Conf. Facial Expression Measurement and Meaning, Salzburg, Austria, pp.329~333 (1997)
- M. S. Barlett, "Recognizing facial expression: machine learning and application to spontaneous behavior", Proc. IEEE Int. Conf. Computer Vision and Pattern Recognition, Osaka, Japan, pp.568~573 (2005)
- A. Lanitis, "Automatic interpretation and coding of face images using flexible models", Trans. Pattern Anal. Machine Intell, 19(7), pp.743~756 (1997)
- S. Ioannou, "Emotion recognition through facial expression analysis based on a neurofuzzy method", Neural Netw, 18, pp.423~435 (2005)
- M. Yeasin, "Recognition of facial expressions and measurement of levels of interest from video", IEEE Trans. Multimedia, 8(8), pp.500~507 (2006)
- A. Kapur, "Gesture-based affective computing on motion capture data", Proc. Int. Conf. Affective Computing and Intelligent Interaction, Beijing, China, pp.1~7 (2005)
- H. Gunes, "Bimodal-emotion recognition from expressive face and body gestures", J. Netw. Comput. Appl, 30, pp.1334~1345 (2007)
- Q. Ji, "A probabilistic framework for modeling and real-time monitoring human fatigue,'' IEEE Trans. Syst", IEEE Trans. Syst. Man Cybern. A, 36(5), pp.862~875 (2006)
- R. Van Bejooijen, "The Characteristics and Recognizability of Vocal Expressions of Emotions" (1984), Foris Publications
- I. R. Murray, "Toward the simulation of emotion in synthetic speech: A review of the literature of human vocal eemotion", J. Acoustic Soc. Amer, 93(2), pp.1097~1108 (1993)
- K. R. Scherer, "''Speech and emotional states,'' in Speech Evaluation in Psychiatry", pp.189~220 (1981), Grune and Stratton, Inc.
- D. Ververidis, "Emotional speech recognition: Resources, features, and methods", Speech Commun, 48, pp.1162~1181 (2006)
- H. M. Teager, "Evidence for Nonlinear Sound Production Mechanisms in the Vocal Tract", NATO Advanced Study Institute Series D, 15 (1990), Kluwer
- X. Huang, "Spoken Language Processing: A Guide to Theory, Algorithm, and System Development" (2001), Prentice-Hall
- J. L. Flanagan, "Speech Analysis, Synthesis and Perception" (1972), Springer-Verlag
- B. D. Womack, "Classification of speech under stress using target driven features", Speech Commun, 20, pp.131~150 (1996)
- C. M. Lee, "Toward detecting emotions in spoken dialogs", IEEE Trans. Speech Audio Process, 13(2), pp.293~303 (2005)
- B. D. Womack, "N-channel hidden Markov models for combined stressed speech classification and recognition", IEEE Trans. Speech Audio Process, 7(6), pp.668~677 (1999)
- J. Ang, "Prosody-based automatic detection of annoyance and frustration in human-computer dialog", Proc. Int. Conf. Spoken Language Processing, Denver, Colorado, USA, pp.2037~2040 (2002)
- O. W. Kwon, "Emotion recognition by speech signals", Proc. Eurospeech, Geneva, Switzerland, pp.125~128 (2003)
- T. Zhang, "Children’s emotion recognition in an intelligent tutoring scenario", Proc. Interspeech, Jeju Island, Korea, pp.1441~1444 (2004)
- D. Neiberg, "Emotion recognition in spontaneous speech using GMMs", Proc. Interspeech, Pittsburgh, Pennsylvania, USA, pp.809~812 (2006)
- J. T. Cacioppo, "Inferring psychological significance from physiological signals", American Psychologist, 45, pp.16~28 (1990)
- A. Fridlund, "Electromyographic studies of facial expressions of emotions and patterns of emotion,'' in Social Psychophysiology: A Sourcebook", pp.243~286 (1983), Guilford Press
- R. W. Picard, "Toward machine emotional intelligence: Analysis of affective physiological state", IEEE Trans. Pattern Anal. Machine Intell, 23(10), pp.1175~1191 (2001)
- M. Pantic, "Toward an affectsensitive multimodal human-computer interaction", Proc. IEEE, 91(9), pp.1370~1390 (2003)
- C. C. Chibelushi, "A review of speech-based bimodal recognition", IEEE Trans. Multimedia, 4(1), pp.23~37 (2002)
- 이종석, "시청각 음성인식을 위한 정보통합: 신뢰도 측정방식의 비교와 신경회로망을 이용한 통합 기법", Telecommunications Review, 17(3), pp.538~550 (2007), SK텔레콤
- K. Karpouzis, "Modeling naturalistic affective states via facial, vocal, and bodily expressions recognition", Proc. Int. Workshop AI for Human Computing, Hyderabad, India, pp.91~112 (2007)
- L. S. Chen, "Emotional expressions in audiovisual human computer interaction", Proc. Int. Conf. Multimedia Expo, New York City, USA, pp.423~426 (2000)
- L. C. De Silva, "Bimodal emotion recognition", Proc. Int. Conf. Automatic Face and Gesture Recognition, Grenoble, France, pp.332~335 (2000)
- M. Song, "Audio-visual based emotion recognition: A new approach", Proc. Int. Conf. Computer Vision and Pattern Recognition, Washington DC, USA, pp.1020~1025 (2004)
- G. Caridakis, "Modeling naturalistic affective states via facial and vocal expressions recognition", Proc. Int. Conf. Multimodal Interfaces, Banff, Canada, pp.146~154 (2006)
- S. Hoch, "Bimodal fusion of emotional data in an automotive environment", Proc. ICASSP, Philadelphia, USA, pp.1085~1088 (2005)
- Z. Zeng, "Audio-visual affect recognition", IEEE Trans. Multimedia, 9(2), pp.424~428 (2007)
- 이종석, "잡음에강인한시청각음성인식", 제어로봇시스템학회지, 13(3), pp.28~34 (2007)
- "2008년 1월 2일자 전자신문"[URL]
- "2007년 2월 22일자 전자신문"[URL]
- A. Hanjalic, "User-oriented affective video content analysis", Proc. IEEE Workshop Content-Based Access of Image and Video Libraries, Kauai, USA, pp.50~57 (2001)
- D. J. France, "Acoustical properties of speech as indicators of depression and suicidal risk", IEEE Trans. Biomedical Engineering, 47(7), pp.829~837 (2000)
- "2005년 12월 17일자 NewScientist"[URL]
