동작 기반 Autonomous Emotion Recognition 시스템: 감정 유도 자극에 따른 신체 맵 형성을 중심으로
Motion based Autonomous Emotion Recognition System: A Preliminary Study on Bodily Map according to Type of Emotional Stimuli
2
조회
0
다운로드
0
인용
0
참고문헌
키워드
초록
기존 연구에 따르면 감정은 신체 감각 및 신체 움직임과 같은 신체적 변화에 영향을 주고, 감정 자극에 따라 다르게 나타난다고 알려져 있다. 그러나, 감정의 자극에 따른 신체 감각 및 신체 움직임의 활성화 정도 및 Autonomous emotion recognition (AER) 시스템의 성능에 미치는 영향에 대한 연구는 아직 알려져 있지 않다. 본 연구에서는 20명의 피험자를 대상으로 3가지종류의 감정 자극(단어, 사진, 영상)을 활용하여 AER 시스템에 미치는 영향을 연구하였다. 측정 변인으로는 정서적 반응, 컴퓨터 기반 자가 보고, Motion Capture 장비를 통해 측정한 신체 움직임을 활용하였다. 본 연구의 결과를 통하여 영상 자극이다른 자극에 비해 더 많은 신체 움직임을 유도하는 것을 확인하고, 영상 자극을 통해 수집한 신체적 특이점이 AER을 위한 분류 정확도 역시 가장 높음을 확인하였다. 신체 움직임을 기반으로 한 감정적 특이점은 행복, 놀람, 분노, 중립 등에서 감정 유도 자극의 종류에 따라 비슷한 패턴이 나타남을 확인하였다. 본 연구의 결과는 향후 신체적 변화를 기반으로 한 AER 시스템연구에 기여할 수 있을 것으로 기대된다.
Abstract
Not only emotions affect physical sensations, but they also have an impact on physical movements. The responses to emotions vary depending on the type of emotional stimuli. However, research on the effects of emotional stimuli on the activation of bodily movements has not been rigorously examined, and these effects have not been investigated in Autonomous Emotion Recognition (AER) systems. In this study, we aimed to compare the emotional responses of 20 participants to three types of emotional stimuli (words, pictures, and videos) and investigate their activation or deactivation for the AER system. Our dependent measures included emotional responses, computer-based self-reporting methods, and bodily movements recorded using motion capture devices. The results suggested that video stimuli elicited higher levels of emotional movement, and emotional movement patterns were similar across different types of emotional stimuli for happiness, sadness, anger, and neutrality. Additionally, the findings indicated that bodily changes observed during video stimuli had the highest classification accuracy. These findings have implications for future research on the bodily changes elicited by emotional stimuli.
참고문헌 (29)
- Cacioppo J., "Emotion", Annual Review of Psychology, pp.191~214 (1999)
- Yang, H., "Facial expression recognition by de-expression residue learning", Proceedings of the IEEE conference on computer vision and pattern recognition, pp.2168~2177 (2018)
- Shan. L., "Deep Facial Expression Recognition : A Survey", IEEE Transactions on Affective Computing, pp.1195~1215 (2022)
- Gavrilescu M., "Recognizing emotions from videos by studying facial expressions, body postures and hand gestures", 2015 23rd Telecommunications Forum Telfor (TELFOR), pp.720~723 (2015)
- Nourhan E., "Emotion Recognition from Body Expressions with a Neural Network Architecture", Proceedings of the 5th International Conference on Human Agent Interaction (HAI '17), pp.143~149 (2017)
- Cho. Y., "Emotion and Body Movement : A Comparative Study of Automatic Emotion Recognition Using Body Motions", 2022 IEEE International Symposium on Mixed and Augmented Reality Adjunct (ISMAR-Adjunct), pp.768~771 (2022)
- Nummenmaa, L., "Bodily maps of emotions", Proceedings of the National Academy of Sciences, pp.646~651 (2014)
- Wallbott H., "Bodily expression of emotion", European Journal of Social Psychology, pp.879~896 (1998)
- Stephanie O., "Electrical neuroimaging reveals early generator modulation to emotional words", NeuroImage, pp.1242~1251 (2004)
- Anne K., "Congruent bodily arousal promotes the constructive recognition of emotional words", Consciousness and Cognition, pp.81~88 (2017)
- Lang P., "The International Affective Picture System(IAPS) : Technical manual and Affective Ratings", Emotion and Attention (1997)
- Bradley M., "The International Affective Picture System(IAPS)in the study of emotion and attention", Handbook of emotion elicitation and assessment, pp.29~24 (2007)
- Mikels, J., "Emotional category data on images from the International Affective Picture System", Behavior Research Methods, pp.626~630 (2005)
- Tina M., "Discrete emotions predict changes in cognition, judgment, experience, behavior, and physiology : A meta-analysis of experimental emotion elicitations", Psychological Bulletin, pp.834~855 (2011)
- Siedlecka E., "Experimental Methods for Inducing Basic Emotions : A Qualitative Review", Emotion Review, pp.87~97 (2019)
- Gross J., "Emotion elicitation using films", Cognition & Emotion, pp.87~108 (1995)
- Schaefer A., "Assessing the effectiveness of a large database of emotion-eliciting films : A new tool for emotion researchers", Cognition and Emotion, pp.1153~1172 (2010)
- Bradley M., "Measuring emotion : The selfassessment manikin and the semantic differential", Journal of Behavior Therapy and Experimental Psychiatry, pp.49~59 (1994)
- Shun L., "Emotion recognition using Kinect motion capture data of human gaits", PeerJ (2016)
- Ferdous A., "Emotion Recognition From Body Movement", IEEE Access, pp.11761~11781 (2020)
- Pollick F., "Perceiving affect from arm movement", Cognition, pp.51~61 (2001)
- Saha S., "A study on emotion recognition from body gestures using Kinect sensor", International Conference on Communication and Signal Processing, pp.56~60 (2014)
- Lundqvist D., "The Karolinska Directed Emotional Faces : KDEF CD-ROM(Karolinska Institutet, Stockholm)", Psychology (1998)
- Livingstone S., "The Ryerson Audio-Visual Database of Emotional Speech and Song(RAVDESS) : A dynamic, multimodal set of facial and vocal expressions in North American English", PLoS ONE (2018)
- Mayer J., "Mood inductions for four specific moods : A procedure employing guided imagery", Journal of Mental Imagery, pp.133~150 (1995)
- Mosher D., "Effects of committed or casual erotic guided imagery on females’ subjective sexual arousal and emotional response", Journal of Sex Research, pp.273~299 (1980)
- Clark, D., "On the induction of depressed mood in the laboratory : Evaluation and comparison of the Velten and musical procedures", Advances in Behaviour Research and Therapy, pp.27~49 (1983)
- Västfjäll, D., "Emotion induction through music : A review of the musical mood induction procedure", Musicae Scientiae, pp.173~211 (2002)
- Ed G., "Laban Movement Analysis : Charting the Ineffable Domain of human Movement", Journal of Physical Education, Recreation & Dance, pp.27~30 (1995)