본문 바로가기
KERD
논문KCI 등재

기본정서 얼굴표정에 대한 한국인의 정서지각 특성: 자유명명과제와 확장 다지선다과제의 수렴적 결과를 중심으로

Characteristics of Koreans’ Emotion Perception of Basic Emotion Facial Expressions: Focusing on Convergent Results of Free-labeling Task and Expanded Choice-from-array Task

0

조회

0

다운로드

0

인용

0

참고문헌

키워드

주제분류심리과학

초록

진화적 정서 이론에 따르면 사람들은 몇 가지 기본정서표정에서 기쁨, 분노, 공포, 슬픔, 혐오, 놀람 등의 정서를 인종과 문화에 걸쳐 일관되게 지각한다. 이러한 문화보편성 가정은 국내외 정서 분야에 널리 수용되고 있으나, 일각에서는 정서 연구에서 사용하는 다지선다과제의 방법론적 문제점이 정서지각의 문화차를 축소시킨다는 주장이 제기된다. 본 연구는 기존 다지선다과제의 문제점을 보완하는 두 개의 과제를 실시하여 한국인, 일본인, 백인 기본정서표정을 대상으로 한국인의 정서지각을 확인하였다. 연구 1에서는 참가자가 지각한 정서를 자유롭게 응답하는 자유명명과제를 실시한 뒤 한국어 감정단어 자료집을 토대로 참가자 응답의 정서 범주를 분류하였다. 분석 결과, 공포 표정의 경우 표적 정서인 공포보다 놀람과 관련된 명칭이 더욱 자주 명명되었으며, 혐오 표정의 경우 혐오 관련 명칭과 분노 관련 명칭이 각각 유사한 빈도로 명명되는 특성이 관찰되었다. 더불어, 공포 및 혐오 표정의 경우 한국인 얼굴 자료집에서 백인/일본인 얼굴 자료집보다 표적 정서 응답률이 더욱 높은 내집단 이득이 관찰되었다. 기쁨, 슬픔, 분노, 놀람 기본정서표정의 경우 표적 정서와 관련된 명칭이 높은 빈도로 응답되었다. 연구 2에서는 자유명명과제를 통해 수집된 24개의 고빈도 명칭을 응답 선택지로 제시하는 확장 다지선다과제를 실시하여 연구 1과 동일한 분석을 수행하였다. 분석 결과, 공포 표정에서는 놀람 관련 명칭이, 혐오 표정에서는 분노 관련 명칭이 주요하게 보고되는 경향이 다시금 관찰되었으며, 혐오 표정의 경우 한국인 얼굴에서 일본인 얼굴보다 표적 정서 응답률이 더욱 높은 내집단 이득이 관찰되었다. 추가적으로, 참가자 응답에 대하여 군집분석 및 다차원척도법을 실시한 결과, 두 과제 모두에서 6가지 기본정서표정이 기쁨, 슬픔, 분노, 놀람 정서를 반영하는 4개 군집을 형성하는 특성이 관찰되었다. 본 연구의 결과는 인종과 문화에 걸쳐 각각의 기본정서표정에서 표적 정서가 지각된다는 문화보편성 가정과 달리, 한국인이 공포 및 혐오 기본정서표정을 문화보편적인 방식으로 지각하지 않음을 보여준다. 한국인은 기본정서표정을 네 가지 양상으로 범주화하며 이때 공포 표정을 놀람 표정으로, 혐오 표정을 분노 표정으로 지각하는 특징을 보인다. 더불어, 본 연구에서 참가자에게 기본정서표정에서 지각한 정서를 자유명명하게 하거나 폭넓은 정서 명칭을 선택지로 제시하자 표적 정서 이외의 정서가 더욱 주요하게 응답된 결과는 자유명명과제가 다지선다과제의 제한점을 보완하며 정서지각의 문화적 특성을 파악하는 효과적인 대안으로 사용될 수 있음을 시사한다.

Abstract

Evolutionary theories of emotion suggest that people consistently perceive emotions such as happiness, anger, fear, sadness, disgust, and surprise from several facial expressions of basic emotions across races and cultures. Although the universality hypothesis about basic emotion expressions is widely accepted in emotion fields, some argue that the methodological problems of choice-from array task commonly used in emotion research make it difficult to identify cultural differences in emotion perception. The present study examined the perception of basic emotions expressed on Korean, Japanese, and Caucasian faces by using two tasks that addressed issues with the traditional choice-from-array task. In Study 1, we conducted a free-labeling task in which participants freely generated emotion labels upon the recognition of emotional faces, and we subsequently categorized the verbal responses they produced. The results revealed that for faces expressing happiness, sadness, anger, and surprise, emotion labels were predominantly aligned with the intended target emotions. However, for faces expressing disgust, approximately half of the expressed labels belonged to the disgust category, while the other half belonged to the anger category. Verbal labels for faces expressing fear were predominantly associated with surprise rather than fear. Additionally, for facial expressions of disgust and fear, we observed an ingroup advantage, where response rates for the target emotion were higher for Korean faces compared to Caucasian and Japanese faces. In Study 2, we repeated the same analysis using an extended choice-from-array task with 24 high-frequency emotion labels collected from Study 1. The results indicated that labels related to anger were more frequently selected for expressions of disgust, and labels related to surprise were more likely to be associated with expressions of fear. An ingroup advantage was also observed for Korean faces displaying disgust compared to Japanese faces displaying disgust. Clustering analysis and multidimensional scaling revealed that the six basic emotional expressions were grouped into four separate clusters corresponding to happiness, sadness, anger, and surprise, respectively. These results suggest that, contrary to the general assumption that the six basic emotions are universally and independently perceived, Koreans tend to perceive expressions of disgust as anger and perceive expressions of fear as surprise. Taken together, our findings indicate that Koreans do not interpret disgust and fear from faces expressing those emotions in a ‘culturally universal way’. We suggest that the free-labeling task serves as an effective alternative to mitigate the methodological limitations of the choice-from-array task, particularly in identifying cultural differences in emotion perception across languages and societies.

참고문헌 (105)

  1. Adolphs, R., "Recognizing emotion from facial expressions : psychological and neurological mechanisms", Behavioral and Cognitive Neuroscience Reviews, 1(1), pp.21~62 (2002)[DOI]
  2. Ahn, S. H., "Activation dimension : A mirage in the affective space", Korean Journal of Social and Personality Psychology, 7(1), pp.107~123 (1993)
  3. Barrett, L. F., "Variety is the spice of life : A psychological construction approach to understanding variability in emotion", Cognition and Emotion, 23(7), pp.1284~1306 (2009)[DOI]
  4. Barrett, L. F., "How emotions are made: The secret life of the brain" (2017), Pan Macmillan
  5. Barrett, L. F., "Emotional expressions reconsidered : Challenges to inferring emotion from human facial movements", Psychological Science in the Public Interest, 20(1), pp.1~68 (2019)[DOI]
  6. Barrett, L. F., "Context in emotion perception", Current Directions in Psychological Science, 20(5), pp.286~290 (2011)[DOI]
  7. Barrett, L. F., "The conceptual act theory: A roadmap" (2015), The Guilford Press
  8. Benitez-Garcia, G., "Multicultural facial expression recognition based on differences of western-caucasian and east-asian facial expressions of emotions", IEICE TRANSACTIONS on Information and Systems, 101(5), pp.1317~1324 (2018)[DOI]
  9. Betz, N., "Words are a context for mental inference", Emotion, 19(8), pp.1463~1477 (2019)[DOI]
  10. Boucher, J. D., "Recognition of facial expression in three cultures", Journal of Cross-Cultural Psychology, 11(3), pp.263~280 (1980)[DOI]
  11. Biehl, M., "Matsumoto and Ekman's Japanese and Caucasian Facial Expressions of Emotion(JACFEE) : Reliability data and cross-national differences", Journal of Nonverbal behavior, 21, pp.3~21 (1997)[DOI]
  12. Busing, F., "PROXSCAL : A multidimensional scaling program for individual differences scaling with constraints", Softstat, 97, pp.67~74 (1997)
  13. Calvo, M. G., "Recognition thresholds for static and dynamic emotional faces", Emotion, 16(8), pp.1186~1200 (2016)[DOI]
  14. Calvo, M. G., "Facial expressions of emotion(KDEF) : Identification under different displayduration conditions", Behavior Research Methods, 40(1), pp.109~115 (2008)[DOI]
  15. Canal, F. Z., "A survey on facial emotion recognition techniques : A state-of-the-art literature review", Information Sciences, 582, pp.593~617 (2022)[DOI]
  16. 최해연, "한국인의 정서 구조와 측정", 한국심리학회지: 사회및성격, 30(2), pp.89~114 (2016), 한국사회및성격심리학회[DOI]
  17. Chung, K. -M., "Development and validation of the Yonsei face database(YFace DB)", Frontiers in Psychology, 10, pp.2626~ (2019)[DOI]
  18. Cordaro, D. T., "The recognition of 18 facial-bodily expressions across nine cultures", Emotion, 20(7), pp.1292~1300 (2020)[DOI]
  19. Cottrell, C. A., "Different emotional reactions to different groups: A sociofunctional threat-based approach to "prejudice"", Journal of Personality and Social Psychology, 88(5), pp.770~789 (2005)[DOI]
  20. Crivelli, C., "Recognizing spontaneous facial expressions of emotion in a small-scale society of Papua New Guinea", Emotion, 17(2), pp.337~347 (2017)[DOI]
  21. DiGirolamo, M. A., "The emotion seen in a face can be a methodological artifact : The process of elimination hypothesis", Emotion, 17(3), pp.538~546 (2017)[DOI]
  22. Du, S., "Wait, are you sad or angry? Large exposure time differences required for the categorization of facial expressions of emotion", Journal of Vision, 13(4), pp.1~14 (2013)[DOI]
  23. Ducci, L., "Emotion recognition in Ethiopia : The effect of familiarity with Western culture on accuracy of recognition", Journal of Cross-Cultural Psychology, 13(3), pp.340~351 (1982)[DOI]
  24. Ekman, P., "Nebraska Symposium on Motivation" (1971)
  25. Ekman, P., "Pictures of facial affect" (1976), Consulting Psychologists Press
  26. Ekman, P., "The face of man: Expressions of universal emotions in a New Guinea village" (1980)
  27. Ekman, P., "Handbook of cognition and emotion", pp.45~60 (1999), Wiley
  28. Ekman, P., "The repertoire of nonverbal behavior : Categories, origins, usage, and coding", Semiotica, 1(1), pp.49~98 (1969)[DOI]
  29. Ekman, P., "Constants across cultures in the face and emotion", Journal of Personality and Social Psychology, 17(2), pp.124~129 (1971)[DOI]
  30. Ekman, P., "A new pan-cultural facial expression of emotion", Motivation and Emotion, 10, pp.159~168 (1986)[DOI]
  31. Ekman, P., "Who knows what about contempt : A reply to Izard and Haynes", Motivation and Emotion, 12(1), pp.17~22 (1988)[DOI]
  32. Ekman, P., "Universals and cultural differences in the judgments of facial expressions of emotion", Journal of Personality and Social Psychology, 53(4), pp.712~717 (1987)[DOI]
  33. Ekman, P., "Pan-cultural elements in facial displays of emotion", Science, 164(3875), pp.86~88 (1969)[DOI]
  34. Elfenbein, H. A., "On the universality and cultural specificity of emotion recognition : A meta-analysis", Psychological Bulletin, 128(2), pp.203~235 (2002)[DOI]
  35. Elfenbein, H. A., "Universals and cultural differences in recognizing emotions", Current Directions in Psychological Science, 12(5), pp.159~164 (2003)[DOI]
  36. Elfenbein, H. A., "Toward a dialect theory : Cultural differences in the expression and recognition of posed facial expressions", Emotion, 7(1), pp.131~146 (2007)[DOI]
  37. Fang, X., "Seeing mixed emotions : The specificity of emotion perception from static and dynamic facial expressions across cultures", Journal of Cross-Cultural Psychology, 49(1), pp.130~148 (2018)[DOI]
  38. Frank, M. G., "The forced-choice paradigm and the perception of facial expressions of emotion", Journal of Personality and Social Psychology, 80(1), pp.75~85 (2001)[DOI]
  39. Gendron, M., "Revisiting diversity : Cultural variation reveals the constructed nature of emotion perception", Current Opinion in Psychology, 17, pp.145~150 (2017)[DOI]
  40. Gendron, M., "Universality reconsidered : Diversity in making meaning of facial expressions", Current Directions in Psychological Science, 27(4), pp.211~219 (2018)[DOI]
  41. Gendron, M., "Emotion perception in Hadza hunter-gatherers", Scientific Reports, 10(1), pp.38~67 (2020)[DOI]
  42. Goeleven, E., "The Karolinska directed emotional faces : a validation study", Cognition and Emotion, 22(6), pp.1094~1118 (2008)[DOI]
  43. 하라연, "백인과 일본인의 얼굴정서 자극에 대한 한국인의 인식 차이", Mood and Emotion, 9(1), pp.17~23 (2011), 대한우울조울병학회
  44. Hoemann, K., "Emotion words, emotion concepts, and emotional development in children : A constructionist hypothesis", Developmental psychology, 55(9), pp.1830~ (2019)[DOI]
  45. 홍영지, "정서가, 각성가 및 구체성 평정을 통한 한국어 정서단어 목록 개발", 인지과학, 27(3), pp.377~406 (2016), 한국인지과학회[DOI]
  46. Hout, M. C., "Multidimensional scaling", Wiley Interdisciplinary Reviews : Cognitive Science, 4(1), pp.93~103 (2013)[DOI]
  47. Huang, Y., "Differential judgement of static facial expressions of emotions in three cultures", Psychiatry and Clinical Neurosciences, 55(5), pp.479~483 (2001)[DOI]
  48. Izard, C. E., "The face of emotion" (1971), Appleton-Century-Crofts
  49. Izard, C. E., "Innate and universal facial expressions : Evidence from developmental and cross-cultural research", Psychological Bulletin, 115(2), pp.288~299 (1994)[DOI]
  50. Jack, R. E., "Culture and facial expressions of emotion", Visual Cognition, 21(910), pp.1248~1286 (2013)[DOI]
  51. Jack, R. E., "Facial expressions of emotion are not culturally universal", Proceedings of the National Academy of Sciences, 109(19), pp.7241~7244 (2012)[DOI]
  52. Jack, R. E., "Four not six : Revealing culturally common facial expressions of emotion", Journal of Experimental Psychology : General, 145(6), pp.708~730 (2016)[DOI]
  53. Jagtap, M., "AI-Based Interview Agent", ICT Infrastructure and Computing: Proceedings of ICT4SD 2022, pp.527~535 (2022), Springer
  54. 전미이, "심상 촉진이 공감증진에 미치는 영향", 한국심리학회지: 상담 및 심리치료, 31(4), pp.1249~1265 (2019), 한국상담심리학회[DOI]
  55. Kim, A., "A Study on Emotions to Improve the Quality of Life of South Korean Senior Patients Residing in Convalescent Hospitals", International Journal of Environmental Research and Public Health, 19(21), pp.14480~ (2022)[DOI]
  56. Kim, S. -M., "Development of the Korean facial emotion stimuli : Korea university facial expression collection 2nd edition", Frontiers in Psychology, 8, pp.769~ (2017)[DOI]
  57. Kollareth, D., "On the set of emotions with facial signals", Journal of Experimental Psychology : General, 152(2), pp.483~495 (2022)[DOI]
  58. Kollareth, D., "On evidence for a dozen new basic emotions : A methodological critique", Emotion, 21(5), pp.1074~1082 (2021)[DOI]
  59. Krumhuber, E. G., "Effects of dynamic aspects of facial expressions : A review", Emotion Review, 5(1), pp.41~46 (2013)[DOI]
  60. Kruskal, J. B., "Multidimensional scaling by optimizing goodness of fit to a nonmetric hypothesis", Psychometrika, 29(1), pp.127~ (1964)[DOI]
  61. Landis, J. R., "The measurement of observer agreement for categorical data", Biometrics, pp.159~174 (1977)
  62. Langner, O., "Presentation and validation of the Radboud Faces Database", Cognition and emotion, 24(8), pp.1377~1388 (2010)[DOI]
  63. 이재윤, "지적 구조 분석을 위한 MDS 지도 작성 방식의 비교 분석", 한국문헌정보학회지, 41(2), pp.335~357 (2007), 한국문헌정보학회
  64. Lee, E., "Is a neutral face really evaluated as being emotionally neutral?", Psychiatry research, 157(1-3), pp.77~85 (2008)[DOI]
  65. 이경욱, "Development and Standardization of Extended ChaeLee Korean Facial Expressions of Emotions", PSYCHIATRY INVESTIGATION, 10(2), pp.155~163 (2013), 대한신경정신의학회
  66. Lee, M. K., "Recent Research Trends of Facial Expression Recognition", Proceedings of the Korean Society of Broadcast Engineers Conference, pp.128~130 (2019)
  67. Levinson, S., "Natural concepts in the spatial topological domain-Adpositional meanings in crosslinguistic perspective: An exercise in semantic typology", Language, pp.485~516 (2003)
  68. Lindquist, K. A., "What's in a word? Language constructs emotion perception", Emotion Review, 5(1), pp.66~71 (2013)[DOI]
  69. (1998)[URL]
  70. Mackie, D. M., "Intergroup emotions : Explaining offensive action tendencies in an intergroup context", Journal of Personality and Social Psychology, 79(4), pp.602~616 (2000)[DOI]
  71. Martinez, B., "Advances in Face Detection and Facial Image Analysis", pp.63100~ (2016)
  72. Matsumoto, D., "Cultural influences on the perception of emotion", Journal of Cross-Cultural Psychology, 20(1), pp.92~105 (1989)[DOI]
  73. Japanese and Caucasian facial expressions of emotion (JACFEE) Intercultural and emotion research laboratory, "Matsumoto, D.", Department of Psychology, San Francisco State University, ~ (1988)
  74. Matsumoto, D., "The contribution of individualism vs. collectivism to cross‐national differences in display rules", Asian Journal of Social Psychology, 1(2), pp.147~165 (1998)[DOI]
  75. Nelson, N. L., "Universality revisited", Emotion Review, 5(1), pp.8~15 (2013)[DOI]
  76. Nelson, N. L., "Building emotion categories : Children use a process of elimination when they encounter novel expressions", Journal of Experimental Child Psychology, 151, pp.120~130 (2016)[DOI]
  77. 박인조, "한국어 감정단어의 목록과 정서 차원 탐색", 한국심리학회지: 사회및성격, 19(1), pp.109~129 (2005), 한국사회및성격심리학회
  78. Park, J., "Who likes artificial intelligence? Personality predictors of attitudes toward artificial intelligence", The Journal of Psychology, 156(1), pp.68~94 (2022)[DOI]
  79. Park, J. I., "Reliability and Validity of Ekman's Pictures of Facial Affect for Koreans", Journal of Korean Society for Depression and Bipolar Disorders, 8(2), pp.145~151 (2010)
  80. Plutchik, R., "Emotion:Theory, research, and experience: Vol. 1. Theories of emotion", pp.3~33 (1980), Academic Press
  81. 이준웅, "정서 단어 분류를 통한 정서의 구성 차원 및 위계적 범주에 관한 연구", 한국언론학보, 52(1), pp.85~116 (2008), 한국언론학회
  82. Rosenberg, E. L., "Conceptual and methodological issues in the judgment of facial expressions of emotion", Motivation and Emotion, 19(2), pp.111~138 (1995)
  83. Rozin, P., "Varieties of disgust faces and the structure of disgust", Journal of Personality and Social Psychology, 66(5), pp.870~881 (1994)
  84. Russell, J. A., "Culture and the categorization of emotions", Psychological Bulletin, 110(3), pp.426~450 (1991)[DOI]
  85. Russell, J. A., "Forced-choice response format in the study of facial expression", Motivation and Emotion, 17(1), pp.41~51 (1993)[DOI]
  86. Russell, J. A., "Is there universal recognition of emotion from facial expression? A review of the cross-cultural studies", Psychological Bulletin, 115(1), pp.102~141 (1994)[DOI]
  87. Russell, J. A., "Evidence for a three-factor theory of emotions", Journal of Research in Personality, 11(3), pp.273~294 (1977)[DOI]
  88. Russell, J. A., "Canadian, Greek, and Japanese freely produced emotion labels for facial expressions", Motivation and Emotion, 17(4), pp.337~351 (1993)[DOI]
  89. Safdar, S., "Variations of emotional display rules within and across cultures : A comparison between Canada, USA, and Japan", Canadian Journal of Behavioural Science, 2009, pp.41(1), 1~10
  90. Sato, W., "BRIEF REPORT the dynamic aspects of emotional facial expressions", Cognition and Emotion, 18(5), pp.701~710 (2004)[DOI]
  91. Shioiri, T., "Misinterpretation of facial expression : A cross-cultural study", Psychiatry and Clinical Neurosciences, 53(1), pp.45~50 (1999)[DOI]
  92. 손선주, "한국어 감정표현단어의 추출과 범주화", 감성과학, 15(1), pp.105~120 (2012), 한국감성과학회
  93. Sorenson, E. R., "The edge of the forest: Land, childhood, and change in a New Guinea protoagricultural society" (1976), Smithsonian Institution Press
  94. Tcherkassof, A., "The emotion-facial expression link : Evidence from human and automatic expression recognition", Psychological Research, 85(8), pp.2954~2969 (2021)[DOI]
  95. Tian, Y., "Handbook of Face Recognition", pp.487519~ (2011), Springer
  96. Tomkins, S., "Affect imagery consciousness: Volume I: The positive affects" (1962), Springer publishing company
  97. Tomkins, S., "Affect imagery consciousness: Volume II:The negative affects" (1963), Springer publishing company
  98. Tottenham, N., "The NimStim set of facial expressions : Judgments from untrained research participants", Psychiatry Research, 168(3), pp.242~249 (2009)[DOI]
  99. Wagner, H. L., "The accessibility of the term contempt and the meaning of the unilateral lip curl", Cognition &Emotion, 14(5), pp.689~710 (2000)[DOI]
  100. Wang, Y., "Perceptual learning and recognition confusion reveal the underlying relationships among the six basic emotions", Cognition and Emotion, 33(4), pp.754~767 (2018)[DOI]
  101. Winters, A., "Perceptions of body posture and emotion : A question of methodology", The New School Psychology Bulletin, 3(2), pp.35~45 (2005)
  102. Yang T, "Tsinghua facial expression database-A database of facial expressions in Chinese young and older women and men : Development and validation", PLoS ONE, 15(4), pp.e0231304~ (2020)[DOI]
  103. Yitzhak, N., "Gently does it : Humans outperform a software classifier in recognizing subtle, nonstereotypical facial expressions", Emotion, 17(8), pp.1187~1198 (2017)[DOI]
  104. Yun, H., "Spatial semantics, cognition, and their interaction : A comparative study of spatial categorization in English and Korean", Cognitive Science, 42(6), pp.1736~1776 (2018)[DOI]
  105. Zupan, B., "Categorising emotion words : The influence of response options", Language and Cognition, 15(1), pp.29~52 (2023)[DOI]

관련 논문AI추천

이 간행물의 다른 논문 (5건)