에이전트의 표정과 목소리 정서의 교차양상지각
Crossmodal Perception of Mismatched Emotional Expressions by Embodied Agents
0
조회
0
다운로드
0
인용
0
참고문헌
키워드
초록
오늘날 가상 세계에서 인간과 인간, 컴퓨터와 인간의 상호작용을 좀 더 효율적으로 도와줄 수 있는 매개체로서 에이전트에 대한 관심이 증대되고 있다. 특히 에이전트의 정서표현도 인간의 정서 표현처럼 해석할 수 있고 그에 대해 인간의 정서표현에 반응하는 것과 마찬가지의 방식으로 반응한다는 연구들이 있어왔다. 그렇다면 에이전트의 정서표현이 표정과 목소리에서 서로 불일치한다면 어떤 쪽에 더 치중해서 에이전트의 정서를 해석할지 또는 어느 한 쪽에 치중하는 것이 아니라 두 정서 모두 조합해서 받아들일지 알아보고자 했다. 또한 만약 표정과 목소리의 두 가지 정서를 조합해서 인지한다면 표정이나 목소리에서는 표현되지 않은 제 3 의 정서를 느끼지는 않는 것인지 알아보았다. 실험은 표정(4) X 목소리(4)로 이루어졌다. 실험 결과 사람들은 에이전트의 한 가지 채널에 지배받아서 정서를 인지하는 것이 아니라 표정(시각)과 목소리(청각) 두 채널 모두를 조합해서 정서를 인지하는 것으로 나타났다. 또한 두 채널의 정서가 불일치할 때에는 혼란에 빠져 무슨 정서인지 모르게 되는 것이 아니라 또 다른 실망, 지루함, 지친, 반가운 등의 제 3의 정서를 느끼는 것으로 나타났다.
Abstract
Today an embodied agent generates a large amount of interest because of its vital role for human-human interactions and human-computer interactions in virtual world. A number of researchers have found that we can recognize and distinguish between various emotions expressed by an embodied agent. In addition many studies found that we respond to simulated emotions in a similar way to human emotion. This study investigates interpretation of mismatched emotions expressed by an embodied agent (e.g. a happy face with a sad voice); whether audio-visual channel integration occurs or one channel dominates when participants judge the emotion. The study employed a 4 (visual: happy, sad, warm, cold) X 4 (audio: happy, sad, warm, cold) within-subjects repeated measure design. The results suggest that people perceive emotions not depending on just one channel but depending on both channels. Additionally facial expression (happy face vs. sad face) makes a difference in influence of two channels; Audio channel has more influence in interpretation of emotions when facial expression is happy. People were able to feel other emotion which was not expressed by face or voice from mismatched emotional expressions, so there is a possibility that we may express various and delicate emotions with embodied agent by using only several kinds of emotions.
참고문헌 (34)
- Aronson,E, "Back to the future: retrospective review of Leon Festinger’s ‘‘A Theory of Cognitive Dissonance’’", The American Journal of Psychology, 110(1), pp.127~137 (1997)
- Bartneck,C, "Affective expressions of machines", Extended Abstracts of CHI’01 : Conference on Human Factors in Computing Systems, pp.189~190 (2001)
- Berry, D. C., "Evaluating a realistic agent in an advice-giving task", International Journal of Human-Computer Studies, 63(3), pp.304~327 (2005)
- Bickmore,T., "Establishing and maintaining long-term human-computer relationships", ACM Transactions on Computer-Human Interaction (TOCHI), 12(2), pp.293~327 (2005)
- Brave,S., "Computers that care: investigating the effects of orientation of emotion exhibited by an embodied computer agent", International Journal of Human Computer Studies, 62(2), pp.161~178 (2005)
- Burleson,W, "Affective agents: sustaining motivation to learn through failure and a state of stuck", Social and Emotional intelligence in learning environments workshop, in conjunction with the 7th International Conference on Intelligent Tutoring Systems (2004)
- Campanella, S, "Integrating face and voice in person perception", Trends in Cognitive Science, 11, pp.535~543 (2007)
- Collier,G, "Emotional Expression" (1985), Lawrence Erlbaum Associates
- Creed,C, "Using computational agents to motivate diet change. in First international conference on Persuasive Technology for human well-being", pp.100~103 (2006), Springer-Verlag
- Creed, C, "Psychological responses to simulated displays of mismatched emotional expressions", Interacting with computers, 20, pp.225~239 (2008)
- de Gelder, B, "The combined perception of emotion from voice and face: early interaction revealed by human electric brain responses", Neuroscience Letters, 260, pp.133~136 (1999)
- de Gelder, B, "The perception of emotions by ear and by eye", Cognition and emotion, 14(3), pp.289~311 (2000)
- Desmet,P, "Designing Emotions.Doctoral dissertation" (2002), Delft University of Technology
- Ekman, P, "An argument for basic emotions", Cognition and emotion, 6, pp.169~200 (1992)
- Ekman,P, "Emotions Revealed: Recognizing Faces and Feelings to Improve Communication and Emotional Life" (2004), Henry Holt & Co
- Elliot,C, "Autinimous agents as synthetic characters", AI Magazine, 19(2), pp.13~30 (1998)
- Ghazanfar,A.A., "Multisensory integration of dynamic faces and voices in rhesus monkey auditory cortex", Journal of Neuroscience, 25, pp.5004~5012 (2005)
- Gong,L, "How social is social responses to computers? The function of the degree of anthropomorphism in computer representations", Computers in Human Behavior, 24(4), pp.1494~1509 (2008)
- Haxby, J. V, "The distributed human neural system for face perception", Trends in Cognitive Science, 4, pp.223~233 (2000)
- Heine, S. J, "Is there a universal need for positive self-regard", Psychological Review, 106, pp.766~794 (1999)
- Hietanen, J. K, "Evidence for the integration of audiovisual emotional information at the perceptual level of processing", European Journal of Cognitive Psychology, 16(6), pp.769~790 (2004)
- Kilts, C. D, "Dissociable neural pathways are involved in the recognition of emotion in static and dynamic facial expressions", Neuroimage, 18, pp.156~168 (2003)
- Kreifelts, B, "Audiovisual integration of emotional signals in voice and face: an event-related fMRI study", Neuroimage, 37, pp.1445~1456 (2007)
- LaBar, K. S, "Dynamic perception of facial affect and identity in the human brain", Cerebral Cortex, 13, pp.1023~1033 (2003)
- Massaro, D. W, "Perceiving affect from the voice and the face", Psychonomic Bulletin & Review, 3(2), pp.215~221 (1996)
- Massaro, D. W, "Developing and evaluating Conversational Agents. in Embodied conversational agents", pp.287~318 (2000), MIT Press
- McGurk,H., "Hearing lips and seeing voices", Nature, 264, pp.746~748 (1976)
- Nass, C, "The effects of emotion of voice in synthesized and recorded speech", Paper presented at the Proceedings of the AAAI Symposium: Emotional and Intelligent II: The Tangled Knot of Social Cognition (2001)
- Russell,J.A, "A circumplex model of affect", Journal of personality and social psychology, 39(6), pp.1161~ (1980)
- Saldaña,H.M., "Visual influences on auditory pluck and bow judgments", Perception and Psychophysics, 54, pp.406~416 (1993)
- Schweinberger, S. R., "Hearing facial identities", The Quarterly Journal of Experimental Psychology, 60, pp.1446~1456 (2007)
- Sugihara, T, "Integration of auditory and visual communication information in the primate ventrolateral prefrontal cortex", Journal of Neuroscience, 26, pp.11138~11147 (2006)
- Thompson, W. F, "Facing the music", Psychological Science, 18, pp.756~757 (2007)
- Thompson. W. F, "Audio-visual integration of emotional cues in song", Cognition and emotion, 22(8), pp.1457~1470 (2008)