본문 바로가기
KERD
논문KCI 등재

참가자 간 표상 유사성 분석을 이용한 정서 자극 반응 일치성 비교: 행동 및 생리 데이터를 기반으로

Consistency of Responses to Affective Stimuli Across Individuals using Intersubject Representational Similarity Analysis based on Behavioral and Physiological Data

김현중|김종완|장준혁
한국감성과학회 (The Korean Society For Emotion & Sensibility)|2023.09|감성과학 (Science of Emotion & Sensibility)|제26권 제3호|pp. 3-14|DOI 10.14695/KJSOS.2023.26.3.3

0

조회

0

다운로드

1

인용

0

참고문헌

키워드

정서평정Naturalistic Stimuli정서적 표상생리측정Affective RepresentationBehavioral and Physiological Data참가자 간 표상 유사성 분석자연주의적 자극Intersubject Representation Analysis
주제분류감성과학

초록

본 연구는 참가자 간 표상 유사성 분석(intersubject representation similarity analysis: IS-RSA)을 이용하여 3개의선행연구에서 얻어진 데이터의 참가자 반응 일치성 패턴을 확인하고 각 실험의 정서 조건 간 차이가 있는지 살펴보았다. 3개의 실험은 각각 ASMR 자극, 시각 및 청각 자극, 시계열적 정서 동영상 자극을 사용하였으며 각 실험의조건에 맞게 정서 평정치와 생리측정치를 측정하였다. 참가자 간 표상 유사성 분석을 계산하기 위해서 각 실험에있는 각 자극에 대한 참가자들의 측정치를 쌍별로 피어슨 상관계수를 구하였다. 실험의 조건 간 비교를 위해 분산분석과 평균을 비교하였다. 연구 결과, ASMR과 시각 및 청각 데이터의 참가자 간 반응의 일치성은 시계열적 정서동영상 참가자들 반응의 일치성에 비해 일관적이었다. ASMR 실험은 긍정 자극에서 참가자 간 반응의 일치성이 높았다. 청각 및 시각 실험은 높은 각성수준과 시각 자극에서 참가자들의 반응 일치성이 높았다. 본 연구 결과는 생리적, 행동적 반응에 대한 측정치의 IS-RSA가 다차원적인 데이터의 정보를 요약하여 제시하며 이를 하나의 분석 데이터로 변환 가능하다는 것을 확인하였다. 이를 통해, IS-RSA가 참가자들의 반응 일관성에 대한 전반적인 정보를 제시할 수 있는 새로운 분석 방법으로의 가능성을 제시하였다.

Abstract

This study used intersubject representational similarity analysis (IS-RSA) to identify participant-response consistency patterns in previously published data. Additionally, analysis of variance (ANOVA) was utilized to detect any variations in the conditions of each experiment. In each experiment, a combination of ASMR stimulation, visual and auditory stimuli, and time-series emotional video stimulation was employed, and emotional ratings and physiological measurements were collected in accordance with the respective experimental conditions. Every pair of participants’ measurements for each stimulus in each experiment was correlated using Pearson correlation coefficient as part of the IS-RSA. The results of study revealed a consistent response pattern among participants exposed to ASMR, visual, and auditory stimuli, in contrast to those exposed to time-series emotional video stimulation. Notably, the ASMR experiment demonstrated a high level of response consistency among participants in positive conditions. Furthermore, both auditory and visual experiments exhibited remarkable consistency in participants' responses, especially when subjected to high arousal levels and visual stimulation. The findings of this study confirm that IS-RSA serves as a valuable tool for summarizing and presenting multidimensional data information. Within the scope of this study, IS-RSA emerged as a reliable method for analyzing multidimensional data, effectively capturing and presenting comprehensive information pertaining to the participants.

참고문헌 (47)

  1. Dominik R. Bach, "Analytic measures for quantification of arousal from spontaneous skin conductance fluctuations", International Journal of Psychophysiology, 76(1), pp.52~55 (2010), Elsevier BV[DOI]
  2. Christopher Baldassano, "Discovering Event Structure in Continuous Narrative Perception and Memory", Neuron, 95(3), pp.709~721.e5 (2017), Elsevier BV[DOI]
  3. Lisa Feldman Barrett, "Interoceptive Sensitivity and Self-Reports of Emotional Experience.", Journal of Personality and Social Psychology, 87(5), pp.684~697 (2004), American Psychological Association (APA)[DOI]
  4. Paolo Bartolomeo, "Botallo's error, or the quandaries of the universality assumption", Cortex, 86, pp.176~185 (2017), Elsevier BV[DOI]
  5. Margaret M. Bradley, "Measuring emotion: The self-assessment manikin and the semantic differential", Journal of Behavior Therapy and Experimental Psychiatry, 25(1), pp.49~59 (1994), Elsevier BV[DOI]
  6. Margaret M. Bradley, "Fearfulness and affective evaluations of pictures", Motivation and Emotion, 23(1), pp.1~13 (1999), Springer Science and Business Media LLC[DOI]
  7. Pin-Hao A. Chen, "Intersubject representational similarity analysis reveals individual variations in affective experience when watching erotic movies", NeuroImage, 216, pp.116851~ (2020), Elsevier BV[DOI]
  8. Julien Dubois, "Building a Science of Individual Differences from fMRI", Trends in Cognitive Sciences, 20(6), pp.425~443 (2016), Elsevier BV[DOI]
  9. Emily S. Finn, "Trait paranoia shapes inter-subject synchrony in brain activity during an ambiguous social narrative", Nature Communications, 9(1) (2018), Springer Science and Business Media LLC[DOI]
  10. Emily S. Finn, "Idiosynchrony: From shared responses to individual differences during naturalistic neuroimaging", NeuroImage, 215, pp.116828~ (2020), Elsevier BV[DOI]
  11. Elia Gatti, "Emotional ratings and skin conductance response to visual, auditory and haptic stimuli", Scientific Data, 5(1) (2018), Springer Science and Business Media LLC[DOI]
  12. Sanjeev Sarmukaddam, "Nonparametric Statistical Inference", Fundamentals of Biostatistics, pp.187~187 (2006), Jaypee Brothers Medical Publishers (P) Ltd[DOI]
  13. Uri Hasson, "Reliability of cortical activity during natural stimulation", Trends in Cognitive Sciences, 14(1), pp.40~48 (2010), Elsevier BV[DOI]
  14. Uri Hasson, "Intersubject Synchronization of Cortical Activity During Natural Vision", Science, 303(5664), pp.1634~1640 (2004), American Association for the Advancement of Science (AAAS)[DOI]
  15. Uri Hasson, "A Hierarchy of Temporal Receptive Windows in Human Cortex", The Journal of Neuroscience, 28(10), pp.2539~2550 (2008), Society for Neuroscience[DOI]
  16. Elaine Hatfield, "New Perspectives on Emotional Contagion: A Review of Classic and Recent Research on Facial Mimicry and Contagion", Interpersona: An International Journal on Personal Relationships, 8(2), pp.159~179 (2014), Leibniz Institute for Psychology (ZPID)[DOI]
  17. Martin P. Hejnar, "Interparticipant correlations: A model free FMRI analysis technique", Human Brain Mapping, 28(9), pp.860~867 (2006), Wiley[DOI]
  18. Christopher J. Honey, "Slow Cortical Dynamics and the Accumulation of Information over Long Timescales", Neuron, 76(2), pp.423~434 (2012), Elsevier BV[DOI]
  19. 장준혁, "행동 및 생리측정기반 개인 간 다중 감각정서 반응일치성", 감성과학, 26(1), pp.43~54 (2023), 한국감성과학회[DOI]
  20. Kauppi, J. P., "Inter-subject correlation of brain hemodynamic responses during watching a movie : Localization in space and frequency", Frontiers in Neuroinformatics, 4, pp.5~ (2010)[DOI]
  21. Christian Keysers, "Somatosensation in social perception", Nature Reviews Neuroscience, 11(6), pp.417~428 (2010), Springer Science and Business Media LLC[DOI]
  22. Stéphanie Khalfa, "Event-related skin conductance responses to musical emotions in humans", Neuroscience Letters, 328(2), pp.145~149 (2002), Elsevier BV[DOI]
  23. 김현중, "다차원척도법과 분류분석을 이용한 ASMR에 대한 정서표상", 감성과학, 25(3), pp.47~62 (2022), 한국감성과학회[DOI]
  24. 김인익, "참가자 간 상관분석을 활용한 ASMR 자극에 대한 개인 간 정서 반응 일관성", 한국심리학회지: 인지 및 생물, 34(2), pp.121~133 (2022), 한국인지및생물심리학회[DOI]
  25. Jongwan Kim, "Comparison of physiological responses to affect eliciting pictures and music", International Journal of Psychophysiology, 101, pp.9~17 (2016), Elsevier BV[DOI]
  26. Yulia Lerner, "Topographic Mapping of a Hierarchy of Temporal Receptive Windows Using a Narrated Story", The Journal of Neuroscience, 31(8), pp.2906~2915 (2011), Society for Neuroscience[DOI]
  27. Xueqiao Li, "Decreased intersubject synchrony in dynamic valence ratings of sad movie contents in dysphoric individuals", Scientific Reports, 11(1) (2021), Springer Science and Business Media LLC[DOI]
  28. Najafi, M., "Dynamics of intersubject brain networks during anxious anticipation", Frontiers in Human Neuroscience, 11, pp.552~ (2017)[DOI]
  29. Samuel A Nastase, "Measuring shared responses across subjects using intersubject correlation", Social Cognitive and Affective Neuroscience (2019), Oxford University Press (OUP)[DOI]
  30. Lauri Nummenmaa, "Sharing the social world via intersubject neural synchronisation", Current Opinion in Psychology, 24, pp.7~14 (2018), Elsevier BV[DOI]
  31. Jane M. Richards, "Emotion regulation and memory: The cognitive costs of keeping one's cool.", Journal of Personality and Social Psychology, 79(3), pp.410~424 (2000), American Psychological Association (APA)[DOI]
  32. Nikki S. Rickard, "Intense emotional responses to music: a test of the physiological arousal hypothesis", Psychology of Music, 32(4), pp.371~388 (2004), SAGE Publications[DOI]
  33. Valorie N. Salimpoor, "The Rewarding Aspects of Music Listening Are Related to Degree of Emotional Arousal", PLoS ONE, 4(10), pp.e7487~ (2009), Public Library of Science (PLoS)[DOI]
  34. Masayuki Satoh, "Activated brain regions in musicians during an ensemble: a PET study", Cognitive Brain Research, 12(1), pp.101~108 (2001), Elsevier BV[DOI]
  35. Mark A. Schmuckler, "What Is Ecological Validity? A Dimensional Analysis", Infancy, 2(4), pp.419~436 (2001), Wiley[DOI]
  36. Mohamed L. Seghier, "Interpreting and Utilising Intersubject Variability in Brain Function", Trends in Cognitive Sciences, 22(6), pp.517~530 (2018), Elsevier BV[DOI]
  37. Karan Sharma, "A dataset of continuous affect annotations and physiological signals for emotion analysis", Scientific Data, 6(1) (2019), Springer Science and Business Media LLC[DOI]
  38. Svetlana V. Shinkareva, "Examining Similarity Structure: Multidimensional Scaling and Related Approaches in Neuroimaging", Computational and Mathematical Methods in Medicine, 2013, pp.1~9 (2013), Hindawi Limited[DOI]
  39. Erez Simony, "Dynamic reconfiguration of the default mode network during narrative comprehension", Nature Communications, 7(1) (2016), Springer Science and Business Media LLC[DOI]
  40. 신민아, "ASMR(자율 감각 쾌감 반응) 광고효과에 관한 융·복합 연구", 한국과학예술융합학회, 37(3), pp.243~253 (2019), 한국전시산업융합연구원[DOI]
  41. Tania Singer, "The Social Neuroscience of Empathy", Annals of the New York Academy of Sciences, 1156(1), pp.81~96 (2009), Wiley[DOI]
  42. Saurabh Sonkusare, "Naturalistic Stimuli in Neuroscience: Critically Acclaimed", Trends in Cognitive Sciences, 23(8), pp.699~714 (2019), Elsevier BV[DOI]
  43. Wiebke Trost, "Temporal dynamics of musical emotions examined through intersubject synchrony of brain activity", Social Cognitive and Affective Neuroscience, 10(12), pp.1705~1721 (2015), Oxford University Press (OUP)[DOI]
  44. Brandon M. Turner, "Approaches to analysis in model-based cognitive neuroscience", Journal of Mathematical Psychology, 76, pp.65~79 (2017), Elsevier BV[DOI]
  45. Jeroen M. van Baar, "The computational and neural substrates of moral strategies in social decision-making", Nature Communications, 10(1) (2019), Springer Science and Business Media LLC[DOI]
  46. Stephen C. Van Hedger, "The Aesthetic Preference for Nature Sounds Depends on Sound Object Recognition", Cognitive Science, 43(5) (2019), Wiley[DOI]
  47. Vicente, R., "Transfer entropy-a model-free measure of effective connectivity for the neurosciences", Journal of Computational Neuroscience, 30(1), pp.45~67 (2011)[DOI]

관련 논문AI추천

참가자 간 상관분석을 활용한 ASMR 자극에 대한 개인 간 정서 반응 일관성김인익, 김종완, 김현중, 장준혁한국인지및생물심리학회 · 한국심리학회지: 인지 및 생물2022 · 제34권 제2호행동 및 생리측정기반 개인 간 다중 감각정서 반응일치성김종완, 장준혁한국감성과학회 · 감성과학2023 · 제26권 제1호표상 유사성 분석을 이용한 감각양상에 따른 정서표상 모델과 정서가 모델의 검증김종완, 김현중한국감성과학회 · 감성과학2023 · 제26권 제2호정서 영상에 대한 정서표상 및 개인 간 반응 일관성김종완, 김현중, 조아란한국감성과학회 · 감성과학2023 · 제26권 제3호표상 유사성 분석을 이용한 연령별 얼굴 정서 차원 비교김종완한국감성과학회 · 감성과학2023 · 제26권 제1호ASMR 자극을 이용한 정서 및 의미론적 변인 간 관계김종완국제언어인문학회 · 인문언어2025 · 제27권 제1호

이 간행물의 다른 논문 (10건)

정서 영상에 대한 정서표상 및 개인 간 반응 일관성조아란, 김종완, 김현중pp. 15-28인간과 로봇의 도덕성 판단, 마음지각과 불멸지각의 관계신홍임pp. 29-40회복탄력성 수준에 따른 인지 정보처리 변화: P300이승율, 김진구pp. 41-52사회적 배제는 물질주의를 증가시키는가? 소속과 통제의 욕구 및 권력감의 조절된 매개 효과권혜빈, 정효림, 박지영pp. 53-68하이테크 감성 섬유패션의 교육 방향에 대한 모색나영주, 김윤희, 김춘정pp. 69-82
원문 보기