본문 바로가기
KERD
논문KCI 등재

부패와 사회복지정책에 관한 선행 실험연구를 통해 살펴본 실험연구 시 주의해야 할 다섯 가지 사항들

Five lessons for Experimenters from a Review of Experimental Studies on Corruption and Social Welfare

박일주|장한일
정부학연구소 (Institute of Governmental Studies)|2019.12|정부학연구 (Journal of Governmental Studies(JGS))|제25권 제3호|pp. 35-64|DOI 10.19067/jgs.2019.25.3.35

0

조회

0

다운로드

0

인용

0

참고문헌

키워드

실험연구spillover effectexperiment확산효과균형검사비순응 문제조작검사balance testnoncompliancemanipulation check
주제분류행정학

초록

우리는 한국 사회과학계에서의 실험연구 활성화에 기여하고자 다음의 두 가지를 이 논문에서 수행한다. 첫째, 한국 연구자들이 관심가질 것이라 생각되는 부패와 사회복지 정책에 관한 실험 논문 10편을 소개한다. 둘째, 소개된 논문들을 활용하여, 실험연구 시 연구자들이 주의해야 할 다섯 가지 사항들에 대해서 논의한다. 이 사항들은 (1) 관찰대상의 평균적 특질들이 실험조건들 사이에서 차이가 없음을 경험적으로 확인하는 균형검사의 중요성, (2) 관찰대상에 대해서 의도된 실험적 조작이 이루어지지 못할 때 발생하는 비순응 문제, (3) 실험적 조작이 의도된 관찰대상이 아닌 다른 대상으로 확산되는 일명 확산효과의 문제, (4) 관찰대상이 연구자가 의도한 방식으로 실험적 조작을 받아들이는지 확인하는 조작검사의 중요성, 그리고 (5) 실험적 조작에 의해 영향 받았을 수 있는 변수가 통제변수로 사용될 때의 위험성 등이다.

Abstract

To promote experimental studies among social scientists in South Korea, we introduce 10 articles that experimentally study corruption and social welfare, of which the social scientists are expected to be interested. Utilizing the articles, we then discuss five issues to which the social scientists have to pay attention while conducting experimental studies. The issues are (1) the significance of balance tests to verify no differences in the average attributes of observational units between experimental conditions, (2) noncompliance issues that emerge as experimental manipulation on observational units fails, (3) spillover effects that concern the unintended exposure of observational units to experimental manipulation, (4) the importance of manipulation checks to verify that observational units took experimental manipulation in the manner intended by the experimenters, and (5) the inappropriateness of using as a control variable a factor that is likely to have been affected by experimental manipulation.

참고문헌 (39)

  1. Abbink, Klaus, "An experimental bribery game", Journal of Law, Economics, and Organization, 18(2), pp.428~454 (2002)
  2. Abbink, Klaus, "Letting the briber go free: an experiment on mitigating harassment bribes", Journal of Public Economics, 111, pp.17~28 (2014)
  3. Anduiza, Eva, "Turning a blind eye:Experimental evidence of partisan bias in attitudes toward corruption", Comparative Political Studies, 46(12), pp.1664~1692 (2013)
  4. Angelucci, Manuela, "Indirect effects of an aid program: how do cash transfers affect ineligibles’ consumption?", American Economic Review, 99(1), pp.486~508 (2009)
  5. Armantier, Olivier, "A controlled field experiment on corruption", European Economic Review, 55(8), pp.1072~1082 (2011)
  6. Aronow, Peter M, "A note on dropping experimental subjects who fail a manipulation check", Political Analysis, 27(4), pp.572~589 (2019)
  7. Bandiera, Oriana, "Active and passive waste in government spending: Evidence from a policy experiment", American Economic Review, 99(4), pp.1278~1308 (2009)
  8. Bandiera, Oriana, "Labor markets and poverty in village economies", The Quarterly Journal of Economics, 132(2), pp.811~870 (2017)
  9. Banerjee, Abhijit, ""A multifaceted program causes lasting progress for the very poor : Evidence from six countries", Science, 348(6236), pp.1260799~ (2015)
  10. Barr, Abigail, "The effects of externalities and framing on bribery in a petty corruption experiment", Experimental Economics, 12(4), pp.488~503 (2009)
  11. Bertrand, Marianne, "Obtaining a driver’s license in India: an experimental approach to studying corruption", The Quarterly Journal of Economics, 122(4), pp.1639~1676 (2007)
  12. Cappelen, Alexander. W, "Social preferences in the lab: A comparison of students and a representative population", The Scandinavian Journal of Economics, 117(4), pp.1306~1326 (2015)
  13. Cameron, Lisa, "Propensities to engage in and punish corrupt behavior: Experimental evidence from Australia, India, Indonesia and Singapore", Journal of Public Economics, 93(7-8), pp.843~851 (2009)
  14. Chong, Alberto, "Does corruption information inspire the fight or quash the hope? A field experiment in Mexico on voter turnout, choice, and party identification", The Journal of Politics, 77(1), pp.55~71 (2014)
  15. Cleave, Blair L, "Is there selection bias in laboratory experiments? The case of social and risk preferences", Experimental Economics, 16(3), pp.372~382 (2013)
  16. Druckman, James N, "Cambridge Handbook of Experimental Political Science", pp.41~57 (2011)
  17. Dubois, Pierre, "Effects on school enrollment and performance of a conditional cash transfer program in Mexico", Journal of Labor Economics, 30(3), pp.555~589 (2012)
  18. Falk, Armin, "Lab experiments are a major source of knowledge in the social sciences", Science, 326(5952), pp.535~538 (2009)
  19. Falk, Armin, "Do lab experiments misrepresent social preferences? The case of self-selected student samples", Journal of the European Economic Association, 11(4), pp.839~852 (2013)
  20. Fisman, Raymond, "Tax rates and tax evasion: Evidence from “Missing imports” in China", Journal of Political Economy, 112(2), pp.471~496 (2004)
  21. Fortin, Bernard, "Welfare benefits and the duration of welfare spells: evidence from a natural experiment in Canada", Journal of Public Economics, 88(7-8), pp.1495~1520 (2004)
  22. Gerber, Alan S, "The Oxford handbook of political science" (2011), Oxford Press
  23. Harrison, Glenn W, "Risk attitudes, randomization to treatment, and self-selection into experiments", Journal of Economic Behavior & Organization, 70(3), pp.498~507 (2009)
  24. Horiuchi, Yusaku, "Designing and analyzing randomized experiments: Application to a Japanese election survey experiment", American Journal of Political Science, 51(3), pp.669~687 (2007)
  25. Kam, Cindy D, "Who toes the party line? Cues, values, and individual differences", Political Behavior, 27(2), pp.163~182 (2005)
  26. King, Gary, "The Dangers of Extreme Counterfactuals", Political Analysis, 14(2), pp.131~159 (2006)
  27. Labonne, Julien, "The local electoral impacts of conditional cash transfers: Evidence from a field experiment", Journal of Development Economics, 104, pp.73~88 (2013)
  28. Michalopoulos, Charles, "When financial work incentives pay for themselves: evidence from a randomized social experiment for welfare recipients", Journal of Public Economics, 89(1), pp.5~29 (2005)
  29. Montgomery, Jacob M, "How conditioning on posttreatment variables can ruin your experiment and what to do about it", American Journal of Political Science, 62(3), pp.760~775 (2018)
  30. Morton, Rebecca B., "Experimental political science and the study of causality: From nature to the lab" (2010), Cambridge University Press
  31. Muralidharan, Karthik, "Building state capacity: Evidence from biometric smartcards in India", American Economic Review, 106(10), pp.2895~2929 (2016)
  32. Olken, Benjamin A, "Monitoring corruption: evidence from a field experiment in Indonesia", Journal of Political Economy, 115(2), pp.200~249 (2007)
  33. Powell, Benjamin, "Does mass immigration destroy institutions? 1990s Israel as a natural experiment", Journal of Economic Behavior & Organization, 141, pp.83~95 (2017)
  34. Robinson, Amanda Lea, "Who is targeted in corruption? Disentangling the effects of wealth and power on exposure to bribery", Quarterly Journal of Political Science, 13(3), pp.313~331 (2018)
  35. Sinclair, Betsy, "Detecting spillover effects: Design and analysis of multilevel experiments", American Journal of Political Science, 56(4), pp.1055~1069 (2012)
  36. Taubman, Sarah L, "Medicaid increases emergency-department use: evidence from Oregon’s Health Insurance Experiment", Science, 343(6168), pp.263~268 (2014)
  37. Transue, John E, "Treatment spillover effects across survey experiments", Political Analysis, 17(2), pp.143~161 (2009)
  38. Zizzo, Daniel John, "Experimenter demand effects in economic experiments", Experimental Economics, 13(1), pp.75~98 (2010)
  39. 안도경, "정치학과 실험", 평화연구, 22(2), pp.326~359 (2014), 평화와 민주주의연구소

관련 논문AI추천

국제적 부패 관련 경험적 연구의 한계와 개선방안: 부패지수를 중심으로이상환한국세계지역학회 · 세계지역연구논총2004 · 제22권 제1호청년 기본소득 실험 설계: 모형 및 방법론적 쟁점반가운, 정이윤, 최현수정부학연구소 · 정부학연구2019 · 제25권 제1호사회보장급여 부정수급 관리 정책: 호주의 경험과 시사점정용문한국사회정책학회 · 한국사회정책2022 · 제29권 제3호Secondary Benefits of Manipulation Checks: Three Illustrations From Behavioral Public Administration박주형, 안승호, Jourdan Davis, Kenneth Meier서울대학교행정대학원 · Journal of Policy Studies2023 · 제38권 제4호고용주와 근로자 간의 선물교환: 현장실험을 통한 분석김세움한국경제학회 · 경제학연구2012 · 제60권 제3호심리학을 활용한 공공정책의 개발과 적용 방안박상희, 박영옥한국심리학회 · 한국심리학회지:일반2020 · 제39권 제1호

이 간행물의 다른 논문 (8건)

연구자의 역할과 담론적 사례연구: 행정학자들의 사례연구 논문 검토를 중심으로윤견수pp. 1-34국가와 행복: 국부, 불평등, 정부역할에 대한 실증연구의 경향 및 쟁점김서용pp. 65-107한국 행정학 연구에서 사회적 약자 대상 연구 경향의 분석황설화, 이병량pp. 109-137공공가치 추구 행태의 영향요인 탐색: 공직자의 혁신성향에 따른 집단 비교최흥석, 한승주pp. 139-178정책의제설정에서의 정부의 역할: 산업보호와 집단주의가 미치는 영향정지수pp. 179-218
원문 보기