자연스러운 정서 반응의 범주 및 차원 분류에 적합한 음성 파라미터
Acoustic parameters for induced emotion categorizing and dimensional approach
0
조회
0
다운로드
1
인용
0
참고문헌
키워드
초록
본 연구는 음성 인식기에서 일반적으로 사용되는 음향 관련 특징인 MFCC, LPCC, 에너지, 피치 관련 파라미터들을 이용하여 자연스러운 음성의 정서를 범주 및 차원으로 얼마나 잘 인식할 수 있는지 살펴보았다. 자연스러운 정서 반응 데이터를 얻기 위해 선행 연구에서 이미 타당도와 효과성이 밝혀진 정서 유발 자극을 사용하였고, 110명의 대학생들에게 7가지 정서 유발 자극을 제시한 후 유발된 음성 반응을 녹음하여 분석에 사용하였다. 각 음성 데이터에서 추출한 파라미터들을 독립변인으로 하여 선형 판별 분석(LDA)으로 7가지 정서 범주를 분류하였고, 범주 분류의 한계를 극복하기 위해 단계별 다중회귀(stepwise multiple regression) 모형을 도출하여 4가지 정서 차원(valence, arousal, intensity, potency)을 가장 잘 예측하는 음성 특징 파라미터를 산출하였다. 7가지 정서 범주 판별율은 평균 62.7%이었고, 4 차원 예측 회귀모형들도 p<.001수준에서 통계적으로 유의하였다. 결론적으로, 본 연구 결과는 자연스러운 감정의 음성 반응을 분류하는데 유용한 파라미터들을 선정하여 정서의 범주와 차원적 접근으로 정서 분류 가능성을 보였으며 논의에 본 연구의 개선방향에 대해 기술하였다.
Abstract
This study examined that how precisely MFCC, LPCC, energy, and pitch related parameters of the speech data, which have been used mainly for voice recognition system could predict the vocal emotion categories as well as dimensions of vocal emotion. 110 college students participated in this experiment. For more realistic emotional response, we used well defined emotion-inducing stimuli. This study analyzed the relationship between the parameters of MFCC, LPCC, energy, and pitch of the speech data and four emotional dimensions (valence, arousal, intensity, and potency). Because dimensional approach is more useful for realistic emotion classification. It results in the best vocal cue parameters for predicting each of dimensions by stepwise multiple regression analysis. Emotion categorizing accuracy analyzed by LDA is 62.7%, and four dimension regression models are statistically significant, p<.001. the previous study Consequently, this result showed the possibility that the parameters could also be applied to spontaneous vocal emotion recognition.
참고문헌 (31)
- C. M. Lee, "Toward detecting emotions in spoken dialogs", IEEE Trans. Speech and Audio Process, 13(2), pp.293~303 (2005)
- Cowie R., "Describing the emotional states that are expressed in speech", Speech Communication, 40(1), pp.5~32 (2003)
- Pitch Extraction and Fundamental Frequency: History and Current Techniques, "D. Gerhard", Dept. of Computer Science, University of Regina, ~ (2003)
- D. O'Shaughnessy, "Speech Communication: Human and Machine, 2nd ed" (1999), Wiley-IEEE Press
- Ekman, P., "Universals and cultural differences in facial expressions of emotion", Proceedings of the 1971 Nebraska Symposium on Motivation, pp.207~283 (1971)
- Ekman, P., "Strong evidence for universals in facial expressions: A reply to Russell’s mistaken critique", Psychological Bulletin, 115(2), pp.268~287 (1994)
- Ekman, P., "Facial Expressions of Emotion", Annual Review of Psychology, 30, pp.527~554 (1979)
- France, D. J., "Acoustical properties of speech as indicators of depression and suicidal risk. IEEE Trans", Biomedical Engineering, 7, pp.829~837 (2000)
- F. Beritelli, "Speech Emotion Recognition Using MFCCs Extracted from a Mobile Terminal based on ETSI Front End", 8th International Conference on Signal Processing(ICSP), Beijing. Greenwald (2006)
- Greenwald, M., "Affective judgment and psychophysiological response : Dimensional covariation in the evaluation of pictorial stimuli", Journal of Psychophysiology, 3(1), pp.51~64 (1989)
- J. Ang, "Prosody-based automatic detection of annoyance and frustration in human-computer dialog", Proceedings of International Conference Spoken Language Processing (ICSLP ’02), 3, pp.2037~2040 (2002)
- J. D. Markel, "Linear Prediction of Speech" (1976), Springer-Verlag
- J. Nicholson, "Emotion Recognition in Speech using Neural Networks", Neural Computing & Appliccation, 9, pp.290~296 (2000)
- J. W. Picone, "Signal modeling techniques in speech recognition", Proc. IEEE, 8(9), pp.1215~1247 (1993)
- L. Rabiner, "Fundamentals of Speech Recognition" (1933), Prentice-Hall
- L. Rabiner, "On the Use of Autocorrelation Analysis for Pitch Detection", IEEE Transactions on acoustics, speech and signal processing, 25(1), pp.24~33 (1977)
- Mi-Sook Park, "Development of emotion-evoking stimuli to provoke spontaneous emotions", Proceedings of the Korean Society for emotion & sensibility : Emotion & Smart Interface, pp.42~43 (2011)
- Mi-Sook Park, "Development of stimuli for spontaneous emotion-evoking II", Proceedings of Korean Society for emotion & sensibility, pp.22~23 (2011)
- Patrik Juslin., "Communication of emotions in vocal expression and music performance : Different channels, same code?", Psychological Bulletin, 129(5), pp.770~814 (2005)
- Petri Laukka, "A dimensional approach to vocal expression of emotion", Cognition & Emotion, 19(5), pp.633~653 (2005)
- Petrushin, V. A., "Emotion in speech recognition and application to call centers", Proceedings of Artificial Neural Networks in Engineering (ANNIE 99), 1, pp.7~10 (1999)
- P. -Y. Oudeyer, "The production and recognition of emotions in speech: features and algorithms", Int. Journal of Human-Computer Studies, 9(1-2), pp.157~183 (2003)
- Russell JA, "Core affect, prototypical emotional episodes, and other things called emotion: dissecting the elephant", Journal of Personality and Social Psychology, 76(5), pp.805~819 (1999)
- Russell, J., "Evidence for a three-factor theory of emotions", Journal of Research in Personality, 11(3), pp.273~294 (1977)
- Schiel, F., "The Smartkom multimodal corpus at BAS", Proc. Language Resources and Evaluation (LREC ’02) (2002)
- Smith CA, "Patterns of cognitive appraisal in emotion", Journal of personality and social psychology, 48(4), pp.813~838 (1985)
- Thurid Vogt, "Comparing Feature Sets for Acted and Spontaneous Speech in View of Automatic Emotion Recognition", Proceedings of IEEE International Conference on Multimedia & Expo(ICME 2005) (2005)
- Todor Ganchev, "Comparative evaluation of various MFCC implementations on the speaker verification task", 10th International Conference on Speech and Computer, 1, pp.191~194 (2005)
- Watson, D., "Development and validation of brief measures of positive and negative affect: The PANAS scales", Journal of Personality and Social Psychology, 54(6), pp.1063~1070 (1988)
- Yixiong Pan, "Speech Emotion Recognition Using Support Vector Machine", International Journal of Smart Home, 6(2), pp.101~108 (2012)
- Zhihong Zeng, "A Survey of Affect Recognition Methods: Audio, Visual, and Spontaneous Expressions", IEEE Transactions on Pattern Analysis and Machine Intelligence, 31(1), pp.39~58 (2009)