혼성강화학습 모형을 이용한 금전적 상황과 비금전적 상황에서의 신뢰 학습의 차이
Differences in trust learning in monetary versus non-monetary contexts using a Hybrid reinforcement learning model
0
조회
0
다운로드
0
인용
0
참고문헌
키워드
초록
본 연구는 사람 사이의 신뢰를 단순한 태도가 아닌 사람들의 경험을 통한 상호작용 행동으로써 신뢰로 가정하여 새로운 신뢰 행동과제 개발을 통해 신뢰를 관찰하고, 강화학습 모형을 이용해서 행동지표를 확인하고자 했다. 먼저 경제적 상황의 전략적 행동을 벗어나 일상적인 행동으로써 신뢰 행동을 관찰하기 위해 신뢰 정보 수집 행동을 이용하여 정직성 확인 과제를 고안하였다. 과제를 통해 얻은 자료를 의사결정 행동에서 습관적 행동 가치와 목적 지향적 행동 가치를 포괄하는 혼성강화학습 모형(Hybrid reinforcement leaning model)을 통해 상대방의 정직성과 일관성 여부 그리고 보상조건의 종류를 달리하여 각각의 신뢰 상황에서 행동 가치와 학습 특성들이 어떻게 달라지는지를 살펴보았다. 본 실험 전 예비 실험을 통해 신뢰와 불신을 형성할 때 각각 신뢰 학습에서 어떠한 차이가 있는지 확인하였다. 그 결과는 상대방을 신뢰할 수 있는 경우에 더 학습률이 높으며, 덜 탐색적으로 의사 결정하는 것으로 나타났다. 반면에 신뢰할 수 없는 경우에 상대방에 대한 신뢰성을 더 고려하여 행동 가치를 계산하는 목표지향적인 의사결정이 이루어진다는 것을 확인하였다. 본 실험은 보상물에 따라 신뢰 학습이나 행동 패턴이 달라지는 지를 확인하기 위해 금전적 조건과 비금전 조건에서 나타나는 신뢰 형성을 비교하였다. 강화학습 파라미터에서 보상물의 종류에 따른 차이는 나타나지 않았다. 이 연구는 일상적으로 쉽게 관찰 가능한 신뢰 행동을 이용하여 신뢰 과제를 고안하고 혼성강화학습 모형으로 분석하여 신뢰 연구의 범위를 확장 시킬 수 있음에 의의가 있다.
Abstract
This study hypothesizes that trust among individuals should be considered not merely as a static attitude but as an interactive behavior arising from personal experiences. To investigate this, a novel trust behavior task was developed to observe trust, and a reinforcement learning model was utilized to assess behavioral indicators. Initially, to observe trust behavior in a context beyond strategic economic actions and within everyday settings, a task focused on honesty verification through trust-related information gathering was designed. Data obtained from this task were analyzed using a Hybrid Reinforcement Learning (HRL) model, which integrates habitual and goal-oriented behavioral values in decision-making. This analysis explored how variations in the counterpart's honesty, consistency, and reward conditions affected behavioral values and learning characteristics in different trust scenarios. A preliminary experiment was conducted to identify differences in trust and distrust formation and their impact on trust learning. The results indicated that when trust in the counterpart was present, the learning rate was higher, and decision-making was less exploratory. In contrast, when trust was absent, individuals engaged in goal-oriented decision-making by placing more emphasis on assessing the counterpart’s reliability when calculating behavioral values. The main experiment compared trust formation under monetary and non-monetary reward conditions to determine if the type of reward influenced trust learning or behavioral patterns. While no significant differences were found in reinforcement learning parameters based on reward type, differences in cognitive processes during decision-making were observed based on response speed. This study is significant as it expands the scope of trust research by devising a trust task based on readily observable behaviors and analyzing it using a Hybrid Reinforcement Learning model.
참고문헌 (46)
- Alós-Ferrer, C., "Trust games and beyond", Frontiers in neuroscience, 887 (2019)
- Altuntas, S., "Relationship between nurses’ organizational trust levels and their organizational citizenship behaviors", Journal of nursing scholarship, 42(2), pp.186~194 (2010)
- Arrow, K. J., "The limits of organization" (1974), WW Norton & Company
- Balleine, B. W., "Human and rodent homologies in action control : Corticostriatal determinants of goal-directed and habitual action", Neuropsychopharmacology, 35, pp.48~69 (2010)
- Bellucci, G., "A Model of Trust", Games, 13(3), pp.39~ (2022)
- Ben-Ner, A., "Trusting and trustworthiness : What are they, how to measure them, and what affects them", Journal of Economic Psychology, 31(1), pp.64~79 (2010)
- Capra, C. M., "Attitudinal and behavioral measures of trust: A new comparison" (2008), SSRN
- Carlson, R. W., "The lateral prefrontal cortex and moral goal pursuit", Current Opinion in Psychology, 24, pp.77~82 (2018)
- Chetty, R., "The trust game does not(only)measure trust : The risk-trust confound revisited", Journal of Behavioral and Experimental Economics, 90, pp.101520~ (2021)
- Colman, A. M., "Cooperation, psychological game theory, and limitations of rationality in social interaction", Behavioral and brain sciences, 26(2), pp.139~153 (2003)
- Daw, N. D., "Uncertainty-based competition between prefrontal and dorsolateral striatal systems for behavioral control", Nature neuroscience, 8(12), pp.1704~1711 (2005)
- Delmonte, S., "Social and monetary reward processing in autism spectrum disorders", Molecular autism, 3, pp.1~13 (2012)
- Diener, E., "Very happy people", Psychological Science, 13(1), pp.81~84 (2002)
- Dimoka., A., "What does the brain tell us about trust and distrust? Evidence from a functional neuroimaging study", Mis Quarterly, pp.373~396 (2010)
- Fontanesi, L., "A reinforcement learning diffusion decision model for value-based decisions", Psychonomic bulletin & review, 26(4), pp.1099~1121 (2019)
- Gillespie, N., "17 Measuring trust in organizational contexts : an overview of survey-based measures", pp.175~ (2011), Handbook of research methods on trust
- Hackel, L. M., "Model-based and model-free social cognition : investigating the role of habit in social attitude formation and choice", Frontiers in psychology, 10, pp.2592~ (2019)
- Hackel, L. M., "Reinforcement learning in social interaction : The distinguishing role of trait inference", Journal of Experimental Social Psychology, 88, pp.103948~ (2020)
- Helliwell, J. F., "New evidence on trust and well-being" (2016)
- Huys, Q. J., "Mapping anhedonia onto reinforcement learning : a behavioural meta-analysis", Biology of mood & anxiety disorders, 3(1), pp.1~16 (2013)
- Kobayashi, K., "Common neural code for reward and information value", Proceedings of the National Academy of Sciences, 116(26), pp.13061~13066 (2019)
- Levine, T. R., "Truth-default theory(TDT)a theory of human deception and deception detection", Journal of Language and Social Psychology, 33(4), pp.378~392 (2014)
- Levinger, G., "Toward the analysis of close relationships", Journal of Experimental Social Psychology, 16(6), pp.510~544 (1980)
- Lewicki, R. J., "Developing and maintaining trust in work relationships", Trust in organizations : Frontiers of theory and research, 114(139), pp.30~ (1996)
- Lewicki, R. J., "Models of interpersonal trust development : Theoretical approaches, empirical evidence, and future directions", Journal of management, 32(6), pp.991~1022 (2006)
- Levy, D. J., "The root of all value : a neural common currency for choice", Current opinion in neurobiology, 22(6), pp.1027~1038 (2012)
- Lin, A., "Social and monetary reward learning engage overlapping neural substrates", Social cognitive and affective neuroscience, 7(3), pp.274~281 (2012)
- Matyjek, M., "A multidimensional view on social and non-social rewards", Frontiers in Psychiatry, 11, pp.818~ (2020)
- McClelland, J. L., "An interactive activation model of context effects in letter perception : I. An account of basic findings", Psychological review, 88(5), pp.375~ (1981)
- McKnight, D. H., "Reflections on an initial trust-building model" (2006), Handbook of trust research
- Mikulincer, M., "Attachment working models and the sense of trust : An exploration of interaction goals and affect regulation", Journal of Personality and Social Psychology, 74(5), pp.1209~ (1998)
- O'Doherty, J. P., "Learning, reward, and decision making", Annual review of psychology, 68, pp.73~100 (2017)
- Özcan, B, "Social trust and human development", The Journal of Socio-Economics, 40(6), pp.753~762 (2011)
- Potter, T. C., "Cognitive components underpinning the development of model-based learning", Developmental Cognitive Neuroscience, 25, pp.272~280 (2017)
- Poulin, M. J., "Growing to trust : Evidence that trust increases and sustains well-being across the life span", Social Psychological and Personality Science, 6(6), pp.614~621 (2015)
- Prezenski, S., "A cognitive modeling approach to strategy formation in dynamic decision making", Frontiers in psychology, 8, pp.1335~ (2017)
- Robbins, B. G., "What is trust? A multidisciplinary review, critique, and synthesis", Sociology compass, 10(10), pp.972~986 (2016)
- Rousseau, D. M., "Not so different after all : A cross-discipline view of trust", Academy of management review, 23(3), pp.393~404 (1998)
- Sander, D., "Reward and emotion : an affective neuroscience approach", Current Opinion in Behavioral Sciences, 39, pp.161~167 (2021)
- Saxe, R., "For love or money : a common neural currency for social and monetary reward", Neuron, 58(2), pp.164~165 (2008)
- Stephan, K. E., "Bayesian model selection for group studies", Neuroimage, 46(4), pp.1004~1017 (2009)
- Stephan, K. E., "Computational approaches to psychiatry", Current opinion in neurobiology, 25, pp.85~92 (2014)
- Thielmann, I., "Trust in me, trust in you : A social projection account of the link between personality, cooperativeness, and trustworthiness expectations", Journal of Research in Personality, 50, pp.61~65 (2014)
- Tokuda, Y., "Interpersonal trust and quality-of-life : A cross-sectional study in Japan", PLoS One, 3(12), pp.e3985~ (2008)
- van Ede, F., "Goal-directed and stimulus-driven selection of internal representations", Proceedings of the National Academy of Sciences, 117(39), pp.24590~24598 (2020)
- Weber, J. M., "Normal acts of irrational trust : Motivated attributions and the trust development process", Research in organizational behavior, 26, pp.75~101 (2004)