심장과 호흡의 연결성을 이용한 감성인식 방법
Emotion Recognition Method Using Heart-Respiration Connectivity
2
조회
0
다운로드
3
인용
0
참고문헌
키워드
초록
감성을 인식하는데 있어 생리적 반응은 중요하다. 생리적 반응은 인체의 주요 기관들과 밀접한 관련이 있지만 감성을 인식하는데 연결성은 고려되지 않고 있다. 자율신경계는 감성과 밀접한 관련이 있는데, 심장과 폐와 같은 인체 내 주요 내장기관에 분포되어 기능적 상보작용을 통해 생리적 반응을 조절하기 때문이다. 따라서 본 연구는 심장과 호흡의 연결성을 분석하고 감성을 인식하는 중요한 연결 변수를 찾고자 하였다. 피험자 18명(남 10명, 평균 나이 24.72 ± 2.47)은 소리 자극을 이용한 감성 유발 실험에 참여하였고 심전도와 호흡 데이터를 측정하였다. 수집된 심장과 호흡 데이터는 스펙트럼 분석을 이용하여 HRV와 BRV spectrum을 구하였고, 감성에 따른 HRV와 BRV spectrum의 동기화 차이를 일원배치분산분석을 통해 통계적 유의성을 확인하였다. Tukey 검증 결과, arousal-relaxation은 HF 대역에서 심전도와 호흡의 동기화 차이로 인식 가능하였고(p=0.008, d=1.4274), negative-positive는 LF 대역에서 인식이 가능하였다(p=0.002, d=1.7377). 본 연구 결과로 심장과 호흡의 연결성을 통해 차원적 감성을 정량적으로 평가할 수 있음을 확인하였고, 복합적인 원인으로 발현되는 감성을 인식하는데 생리적 반응들의 연결성 변수의 활용도가 높을 것으로 기대된다.
Abstract
hysiological responses have been measured to recognize emotion. Although physiological responses have been interrelated between organs, their connectivities have been less considered for emotion recognizing. The connectivities have been assumed to enhance emotion recognition. Specially, autonomic nervous system is physiologically modulated by the interrelated functioning. Therefore, this study has been tried to analyze connectivities between heart and respiration and to find the significantly connected variables for emotion recognition. The eighteen subjects(10 male, age 24.72 ± 2.47) participated in the experiment. The participants were asked to listen to predetermined sound stimuli (arousal, relaxation, negative, positive) for evoking emotion. The bio-signals of heart and respiration were measured according to sound stimuli. HRV (heart rate variability) and BRV (breathing rate variability) spectrum were obtained from spectrum analysis of ECG (electrocardiogram) and RSP (respiration). The synchronization of HRV and BRV spectrum was analyzed according to each emotion. Statistical significance of relationship between them was tested by one-way ANOVA. There were significant relation of synchronization between HRV and BRV spectrum (synchronization of HF: F(3, 68)=3.605, p=0.018, =0.1372, synchronization of LF: F(3, 68)=5.075, p=0.003, =0.1823). HF difference of synchronization between ECG and RSP has been able to classify arousal from relaxation (p=0.008, d=1.4274) and LF's has negative from positive (p=0.002, d=1.7377). Therefore, it was confirmed that the heart and respiration to recognize the dimensional emotion by connectivity.
참고문헌 (31)
- 안상민, "개인화 프로세스를 적용한 실시간 감성인식 기술", 감성과학, 15(1), pp.133~140 (2012), 한국감성과학회
- Andreassi, J. L., "Psychophysiology: Human Behavior & Physiological Response" (2013), Psychology Press
- Castellano, G., "Emotion recognition through multiple modalities : face, body gesture, speech", Affect and Emotion in Human-Computer Interaction, pp.92~103 (2008)[DOI]
- Cowie, R., "Automatic statistical analysis of the signal and prosodic signs of emotion in speech", Spoken Language Fourth International Conference, 3, pp.1989~1992 (1996)
- Darwin, C., "The expression of the emotions in man and animals" (1998), Oxford University Press
- Ekman, P., "Facial action coding system: A Technique for the Measurement of Facial Movement" (1977), Consulting Psychologists Press
- Glass, L., "Theory of Heart", pp.289~312 (1991)
- JAMES J. GROSS, "The psychophysiology of crying", Psychophysiology, 31(5), pp.460~468 (1994), Wiley-Blackwell[DOI]
- Hatice Gunes, "Bi-modal emotion recognition from expressive face and body gestures", Journal of Network and Computer Applications, 30(4), pp.1334~1345 (2007), Elsevier BV[DOI]
- Hirsch, J. A., "Respiratory sinus arrhythmia in humans : how breathing pattern modulates heart rate", American Journal of Physiology-Heart and Circulatory Physiology, 241(4), pp.620~629 (1981)
- Spiros V. Ioannou, "Emotion recognition through facial expression analysis based on a neurofuzzy network", Neural Networks, 18(4), pp.423~435 (2005), Elsevier BV[DOI]
- Kamath, M. V., "Power spectral analysis of heart rate variability : a noninvasive signature of cardiac autonomic function", Critical Reviews in Biomedical Engineering, 21(3), pp.245~311 (1992)
- 강선아, "감성ICT산업의 경제적 파급효과 분석: 산업연관분석을 중심으로", 산업경제연구, 26(4), pp.1739~1764 (2013), 한국산업경제학회
- Katona, P. G., "Respiratory sinus arrhythmia : noninvasive measure of parasympathetic cardiac control", Journal of Applied Physiology, 39(5), pp.801~805 (1975)
- Stéphanie Khalfa, "Role of tempo entrainment in psychophysiological differentiation of happy and sad music?", International Journal of Psychophysiology, 68(1), pp.17~26 (2008), Elsevier BV[DOI]
- Kwon, O. W., "Emotion recognition by speech signals", Eighth European Conference on Speech Communication and Technology (2003)
- Lee, Y. J., "Emotion recognition technology for Human-machine interface (인간-기계인터페이스를 위한 감성인식 기술)", The Korean Society of Mechanical Engineers, 55(3), pp.42~46 (2015)
- Robert W. Levenson, "Autonomic Nervous System Differences among Emotions", Psychological Science, 3(1), pp.23~27 (2017), SAGE Publications[DOI]
- Philip Lieberman, "Some Aspects of Fundamental Frequency and Envelope Amplitude as Related to the Emotional Content of Speech", The Journal of the Acoustical Society of America, 34(7), pp.922~927 (1962), Acoustical Society of America (ASA)[DOI]
- A. Malliani, "Cardiovascular neural regulation explored in the frequency domain", Circulation, 84(2), pp.482~492 (1991), Ovid Technologies (Wolters Kluwer Health)[DOI]
- McCraty, R., "The coherent heart : heart-brain interactions, psychophysiological coherence, and the emergence of system-wide order", Integral Review, 5(2), pp.10~115 (2009)
- Nyklíček, I., "Cardiorespiratory differentiation of musicallyinduced emotions", Journal of Psychophysiology, 11(4), pp.304~321 (1997)
- STEPHEN W. PORGES, "Orienting in a defensive world: Mammalian modifications of our evolutionary heritage. A Polyvagal Theory", Psychophysiology, 32(4), pp.301~318 (1995), Wiley-Blackwell[DOI]
- Kenneth M Prkachin, "Cardiovascular changes during induced emotion", Journal of Psychosomatic Research, 47(3), pp.255~267 (1999), Elsevier BV[DOI]
- Pierre Rainville, "Basic emotions are associated with distinct patterns of cardiorespiratory activity", International Journal of Psychophysiology, 61(1), pp.5~18 (2006), Elsevier BV[DOI]
- Jonathan Rottenberg, "Vagal rebound during resolution of tearful crying among depressed and nondepressed individuals", Psychophysiology, 40(1), pp.1~6 (2003), Wiley-Blackwell[DOI]
- Saul, J. P., "Beat-to-beat variations of heart rate reflect modulation of cardiac autonomic outflow", Physiology, 5(1), pp.32~37 (1990)
- Tiller, W. A., "Cardiac coherence : A new, noninvasive measure of autonomic nervous system order", Alternative Therapies in Health and Medicine, 2(1), pp.52~65 (1996)
- Fumihiko Yasuma, "Respiratory Sinus Arrhythmia", Chest, 125(2), pp.683~690 (2004), Elsevier BV[DOI]
- 윤현섭, "표정별 가버 웨이블릿 주성분특징을 이용한실시간 표정 인식 시스템", 한국지능시스템학회 논문지, 19(6), pp.821~827 (2009), 한국지능시스템학회
- Zhihong Zeng, "A Survey of Affect Recognition Methods: Audio, Visual, and Spontaneous Expressions", IEEE Transactions on Pattern Analysis and Machine Intelligence, 31(1), pp.39~58 (2009), Institute of Electrical and Electronics Engineers (IEEE)[DOI]