표상 유사성 분석을 이용한 감각양상에 따른 정서표상 모델과 정서가 모델의 검증
Testing Modality-Generality and Valence Models using Representational Similarity Analysis
0
조회
0
다운로드
1
인용
0
참고문헌
키워드
초록
정서표상에 대한 논의 중 첫 번째는 정서가 차원에서의 정서표상, 두 번째는 감각양상에 따른 정서표상을 설명하는 것이다. 선행연구에서는 정서표상을 설명하기 위해 정서가 모델(부호 정서가, 비부호 정서가), 감각양상에 따른 정서표상 모델(감각보편성, 감각특징성)들이 제시되었다. 본 연구에서는 최근에 등장한 ASMR을 이용하여 기존 연구에서 제시된 모델들을 비교하여 어떠한 모델이 정서표상을 잘 설명하는지 확인하고자 하였다. 본 연구에서 사용한 자료는 Kim & Kim(2022) 에서 수집한 3개의 정서유형(부정, 중립, 긍정) 및 2개의 감각양상(청각, 시청각)으로 구분된 ASMR 자극에 대한 정서평정자료를 사용하였다. 이후, 해당 자료에 대한 다차원척도법, 표상 유사성 분석 및 이원 변량분석, 다중회귀분석 및 이원 변량분석을 실시하였다. 다차원척도법 결과, 비부호 정서가에 비해 부호 정서가, 감각특징성에 비해 감각보편성에서 자극의 정서유형 간 구분이 잘 이루어졌다. 다차원척도법 결과와 유사하게, 표상 유사성 분석 및 다중회귀분석 결과 또한 비부호정서가에 비해 부호 정서가, 감각특징성에 비해 감각보편성이 유의하게 정서표상을 잘 설명하였다. 이러한 결과는 정서가모델 중 1차원의 양극단에 긍정과 부정이 위치하는 모델이 ASMR에 대한 정서표상을 잘 설명하며, 감각양상과 상관없이정서표상이 일관적임을 시사한다.
Abstract
Among the discussions on affective representation, the first is to explain the affective representation in the dimensions, and the second is to explain the affective representation according to the modality. In previous studies, to explain affective representation, valence models (signed valence, unsigned valence) and Modality-generality models (modality-general, modality-specific) were presented. In this study, we compared models presented in the previous study using the recently published ASMR to confirm which models explain affective representation well. The data used in this study were behavioral rating values collected by Kim & Kim (2022), and these were obtained for ASMR stimuli that were divided into three affective types (negative, neutral, and positive) and two modalities (auditory and audiovisual). Then, a multidimensional scaling, a representational similarity analysis with a two-way repeated measures ANOVA, and a multiple regression analysis with a two-way repeated measures ANOVA were performed. The results revealed that signed valence and modality-general distinguished between affective types of stimuli better than unsigned valence and modality-specific. Similar to the results of multidimensional scaling, the results of a representational similarity analysis and a multiple regression also showed that the signed valence and modality-general significantly explained affective representation better than the unsigned valence and the modality-specific. These results suggest that the model in which positive and negative are located at the opposite ends of the one dimension explains the affective representation of ASMR well, and that the affective representation was consistent regardless of modality.
참고문헌 (28)
- Lisa Feldman Barrett, "Chapter 4 Affect as a Psychological Primitive", Advances in Experimental Social Psychology, pp.167~218 (2009), Elsevier[DOI]
- Laura B. Baucom, "Decoding the neural representation of affective states", NeuroImage, 59(1), pp.718~727 (2012), Elsevier BV[DOI]
- Margaret M. Bradley, "Affective reactions to acoustic stimuli", Psychophysiology, 37(2), pp.204~215 (2000), Wiley[DOI]
- Junichi Chikazoe, "Population coding of affect across stimuli, modalities and individuals", Nature Neuroscience, 17(8), pp.1114~1122 (2014), Springer Science and Business Media LLC[DOI]
- Maurizio Codispoti, "Affective reactions to briefly presented pictures", Psychophysiology, 38(3), pp.474~478 (2001), Wiley[DOI]
- Jelle R. Dalenberg, "Valence processing differs across stimulus modalities", NeuroImage, 183, pp.734~744 (2018), Elsevier BV[DOI]
- D. Dellacherie, "Multidimensional scaling of emotional responses to music in patients with temporal lobe resection", Cortex, 47(9), pp.1107~1115 (2011), Elsevier BV[DOI]
- Chuanji Gao, "Modality-general and modality-specific audiovisual valence processing", Cortex, 138, pp.127~137 (2021), Elsevier BV[DOI]
- Patrick Gomez, "Respiratory responses during affective picture viewing", Biological Psychology, 67(3), pp.359~373 (2004), Elsevier BV[DOI]
- 김현중, "다차원척도법과 분류분석을 이용한 ASMR에 대한 정서표상", 감성과학, 25(3), pp.47~62 (2022), 한국감성과학회[DOI]
- 김종완, "다양한 연령의 얼굴 정서 표상: 다차원척도법 연구", 감성과학, 24(3), pp.71~80 (2021), 한국감성과학회[DOI]
- Jongwan Kim, "Comparison of physiological responses to affect eliciting pictures and music", International Journal of Psychophysiology, 101, pp.9~17 (2016), Elsevier BV[DOI]
- Jongwan Kim, "Representations of modality-general valence for videos and music derived from fMRI data", NeuroImage, 148, pp.42~54 (2017), Elsevier BV[DOI]
- Jongwan Kim, "A study in affect: Predicting valence from fMRI data", Neuropsychologia, 143, pp.107473~ (2020), Elsevier BV[DOI]
- Martin Klasen, "Supramodal Representation of Emotions", The Journal of Neuroscience, 31(38), pp.13635~13643 (2011), Society for Neuroscience[DOI]
- Nikolaus Kriegeskorte, "Representational similarity analysis – connecting the branches of systems neuroscience", Frontiers in Systems Neuroscience (2008), Frontiers Media SA[DOI]
- Jeff T. Larsen, "Effects of positive and negative affect on electromyographic activity over zygomaticus major and corrugator supercilii", Psychophysiology, 40(5), pp.776~785 (2003), Wiley[DOI]
- Kristen A. Lindquist, "The Brain Basis of Positive and Negative Affect: Evidence from a Meta-Analysis of the Human Neuroimaging Literature", Cerebral Cortex, 26(5), pp.1910~1922 (2015), Oxford University Press (OUP)[DOI]
- Samuel A. Nastase, "Attention Selectively Reshapes the Geometry of Distributed Semantic Representation", Cerebral Cortex, 27(8), pp.4277~4291 (2017), Oxford University Press (OUP)[DOI]
- Marius V. Peelen, "Supramodal Representations of Perceived Emotions in the Human Brain", The Journal of Neuroscience, 30(30), pp.10127~10134 (2010), Society for Neuroscience[DOI]
- James A. Russell, "A circumplex model of affect", Journal of Personality and Social Psychology, 39(6), pp.1161~1178 (1980), American Psychological Association (APA)[DOI]
- James A. Russell, "Multidimensional scaling of emotional facial expressions: Similarity from preschoolers to adults", Journal of Personality and Social Psychology, 48(5), pp.1290~1298 (1985), American Psychological Association (APA)[DOI]
- James A. Russell, "On the bipolarity of positive and negative affect", Psychological Bulletin, 125(1), pp.3~30 (1999), American Psychological Association (APA)[DOI]
- Svetlana V. Shinkareva, "Examining Similarity Structure: Multidimensional Scaling and Related Approaches in Neuroimaging", Computational and Mathematical Methods in Medicine, 2013, pp.1~9 (2013), Hindawi Limited[DOI]
- Svetlana V. Shinkareva, "Representations of modality-specific affective processing for visual and auditory stimuli derived from functional magnetic resonance imaging data", Human Brain Mapping, 35(7), pp.3558~3568 (2013), Wiley[DOI]
- Sandrine Vieillard, "Children’s perception and understanding of (dis)similarities among dynamic bodily", facial expressions of happiness, pleasure, anger, and irritation, 2009, pp.102(1), 78~95[DOI]
- Mikko Viinikainen, "Representation of perceived sound valence in the human brain", Human Brain Mapping, 33(10), pp.2295~2305 (2011), Wiley[DOI]
- Miriam E Weaverdyck, "Tools of the Trade Multivoxel pattern analysis in fMRI: a practical introduction for social and affective neuroscientists", Social Cognitive and Affective Neuroscience, 15(4), pp.487~509 (2020), Oxford University Press (OUP)[DOI]