행동 및 생리측정기반 개인 간 다중 감각정서 반응일치성
Consistency between Individuals of Affective Responses for Multiple Modalities based on Behavioral and Physiological Data
0
조회
0
다운로드
4
인용
0
참고문헌
키워드
초록
본 연구는 참가자 간 상관(Intersubject correlation: ISC)기법을 통해 정서 유발 자극에 대한 한 참가자의 반응과그 참가자를 제외한 나머지 참가자들의 반응 간 일치성이 각 정서표상 범주(지배가, 각성가, 정서가)와 다양한 감각양상(청각, 시각, 촉각)에서 어떠한 차이가 있는지 밝히고자 하였다. 참가자 간 상관을 계산하기 위해 사용된 데이터는 참가자들의 청각, 시각, 촉각 자극에 대한 생리 측정치와 정서 평정치로 구성되었으며, 한 참가자의 데이터 세트와 나머지 참가자들의 데이터 세트의 평균으로 구분한 뒤 가능한 모든 자극 쌍에 대해 상관을 구하는 방식으로 참가자 간 상관을 계산하였다. 연구 결과, 지배가를 기준으로 재정렬한 데이터 세트에 대한 참가자들의 반응 일치성은청각 감각양상 조건보다 시각 감각양상 조건에서 높은 ISC 값을 얻었다. 다음으로 각성가로 재정렬한 데이터 세트의 경우 시각 감각양상과 청각 감각양상에서 차이가 있음은 같았지만, 지배가 기준으로 재정렬한 데이터 세트와 결과가상반되었다. 마지막으로, 정서가를 기준으로 재정렬된 데이터 세트는 모든 감각양상에서 부정적인 데이터 세트들이긍정적인 데이터 세트보다 참가자들의 반응 일치성이 더 높았다. 모든 데이터 세트에서 정서표상 범주의 높고 낮음과 상관없이 촉각 감각양상에서 높은 ISC 값을 얻었다. 본 연구의 결과는 참가자 간 상관의 다양한 감각양상과 정서표상에 대한 반응의 일치성이 의미하는 바에 대한 해석을 제시하며, ISC 분석 방법이 참가자 반응의 차이에 대한패턴을 측정하는 유용한 도구가 될 가능성을 제시하였다.
Abstract
In this study, we assessed how participants represent various sensory stimuli experiences through behavioral ratings and physiological measurements. Utilizing intersubject correlation (ISC) analysis, we evaluated whether individuals' affective responses of dominance, arousal, and valence differed when stimuli of three modality conditions (auditory, visual, and haptic) were presented. ISC analyses were used to measure the similarities between one participant's responses and those of the others. To calculate the intersubject correlation, we divided the entire dataset into one subject and all other subject datasets and then correlated the two for all possible stimulus pair combinations. The results revealed that for dominance, ISCs of the visual modality condition were greater than the auditory modality condition, whereas, for arousal, the auditory condition was greater than the visual modality. Last, negative valence conditions had the greater consistency of the participants' reactions than positive conditions in each of the sensory modalities. When comparing modalities, greater ISCs were observed in haptic modality conditions than in visual and auditory modality conditions, regardless of the affective categories. We discussed three core affective representations of multiple modalities and proposed ISC analysis as a tool for examining differences in individuals` affective representations.
참고문헌 (42)
- Arnold, M. B., "Emotion and personality", ~ (1960)
- Bach, D. R., "Analytic measures for quantification of arousal from spontaneous skin conductance fluctuations", International Journal of Psychophysiology, 76(1), pp.52~55 (2010)
- Barrett, L. F., "Chapter 4affect as a psychological primitive", Advances in Experimental Social Psychology, 41, pp.167~218 (2009)
- Baucom, L. B., "Decoding the neural representation of affective states", NeuroImage, 59(1), pp.718~727 (2012)
- Ben-Yakov, A., "Loss of reliable temporal structure in event-related averaging of naturalistic stimuli", NeuroImage, 63(1), pp.501~506 (2012)
- Bracken, B. K., "Physiological synchronization is associated with narrative emotionality and subsequent behavioral response", International conference on augmented cognition, pp.3~13 (2014), Springer
- Bradley, M. M., "Measuring emotion : The self-assessment manikin and the semantic differential", Journal of Behavior Therapy and Experimental Psychiatry, 25(1), pp.49~59 (1994)
- Bradley, M. M., "Fearfulness and affective evaluations of pictures", Motivation and Emotion, 23(1), pp.1~13 (1999)
- Chen, P. H. A., "Intersubject representational similarity analysis reveals individual variations in affective experience when watching erotic movies", NeuroImage, 216, pp.116851~ (2020)
- Croy, I., "The sensory channel of presentation alters subjective ratings and autonomic responses toward disgusting stimuli—Blood pressure, heart rate and skin conductance in response to visual, auditory, haptic and olfactory presented disgusting stimuli", Frontiers in Human Neuroscience, 7, pp.510~ (2013)
- Frühholz, S., "Neural decoding of discriminative auditory object features depends on their socio-affective valence", Social Cognitive and Affective Neuroscience, 11(10), pp.1638~1649 (2016)
- Gatti, E., "Emotional ratings and skin conductance response to visual, auditory and haptic stimuli", Scientific Data, 5(1), pp.1~12 (2018)
- Gavazzeni, J., "Age effects to negative arousal differ for self-report and electrodermal activity", Psychophysiology, 45(1), pp.148~151 (2008)
- Gomez, P., "Affective and physiological responses to environmental noises and music", International Journal of Psychophysiology, 53(2), pp.91~103 (2004)
- Habes, I., "Pattern classification of valence in depression", NeuroImage : Clinical, 2(1), pp.675~683 (2013)
- Hale, J., "Are you on my wavelength? interpersonal coordination in dyadic conversations", Journal of Nonverbal Behavior, 44(1), pp.63~83 (2020)
- Han, J., "Can media synchronize our physiological responses? Skin conductance synchrony as a function of message valence, arousal, and emotional change rate", Communication Monographs, 89(1), pp.47~69 (2022)
- Hasson, U., "Intersubject synchronization of cortical activity during natural vision", Science, 303(5664), pp.1634~1640 (2004)
- Hove, M. J., "It’s all in the timing : Interpersonal synchrony increases affiliation", Social Cognition, 27(6), pp.949~960 (2009)
- Kim, I., "Measuring consistency of affective responses to ASMR stimuli across individuals using intersubject correlation", Korean Journal of Cognitive and Biological Psychology
- Kim, J., "Comparison of physiological responses to affect eliciting pictures and music", International Journal of Psychophysiology, 101, pp.9~17 (2016)
- Kim, J., "Representations of modality-general valence for videos and music derived from fMRI data", NeuroImage, 148, pp.42~54 (2017)
- Kim, J., "A study in affect : Predicting valence from fMRI data", Neuropsychologia, 143, pp.107473~ (2020)
- 김종완, "다양한 연령의 얼굴 정서 표상: 다차원척도법 연구", 감성과학, 24(3), pp.71~80 (2021), 한국감성과학회[DOI]
- Lahnakoski, J. M., "Synchronous brain activity across individuals underlies shared psychological perspectives", NeuroImage, 100, pp.316~324 (2014)
- Li, X., "Decreased intersubject synchrony in dynamic valence ratings of sad movie contents in dysphoric individuals", Scientific Reports, 11(1), pp.1~13 (2021)
- Masson, H. L., "Functional selectivity for social interaction perception in the human superior temporal sulcus during natural viewing", NeuroImage, 245, pp.118741~ (2021)
- Miles, L. K., "The rhythm of rapport : Interpersonal synchrony and social perception", Journal of Experimental Social Psychology, 45(3), pp.585~589 (2009)
- Mourão-Miranda, J., "Patient classification as an outlier detection problem : An application of the one-class support vector machine", NeuroImage, 58(3), pp.793~804 (2011)
- Mourão-Miranda, J., "Pattern recognition analyses of brain activation elicited by happy and neutral faces in unipolar and bipolar depression", Bipolar Disorders, 14(4), pp.451~460 (2012)
- Najafi, M., "Dynamics of intersubject brain networks during anxious anticipation", Frontiers in Human Neuroscience, 11, pp.552~ (2017)
- Nastase, S. A., "Measuring shared responses across subjects using intersubject correlation", Social Cognitive and Affective Neuroscience, 14(6), pp.669~687 (2019)
- Nummenmaa, L., "Emotions promote social interaction by synchronizing brain activity across individuals", Proceedings of the National Academy of Sciences of the United States of America, 109(24), pp.9599~9604 (2012)
- Nummenmaa, L., "Sharing the social world via intersubject neural synchronisation", Current Opinion in Psychology, 24, pp.7~14 (2018)
- Obrist, M., "Emotions mediated through mid-air haptics", Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems, pp.2053~2062 (2015)
- Paquette, S., "Cross-classification of musical and vocal emotions in the auditory cortex", Annals of the New York Academy of Sciences, 1423(1), pp.329~337 (2018)
- Peelen, M. V., "Supramodal representations of perceived emotions in the human brain", Journal of Neuroscience, 30(30), pp.10127~10134 (2010)
- Russell, J. A., "A circumplex model of affect", Journal of Personality and Social Psychology, 39(6), pp.1161~1178 (1980)
- Sachs, M. E., "Decoding the neural signatures of emotions expressed through sound", NeuroImage, 174, pp.1~10 (2018)
- Shinkareva, S. V., "Computational and Mathematical Methods in Medicine" (2013)
- Sigrist, R., "Augmented visual, auditory, haptic, and multimodal feedback in motor learning : A review", Psychonomic Bulletin & Review, 20(1), pp.21~53 (2012)
- Simony, E., "Dynamic reconfiguration of the default mode network during narrative comprehension", Nature Communications, 7(1), pp.1~13 (2016)