Looking Inside the Black Box: The Importance of Causal Mechanism and Treatment Effect Heterogeneity in Experimentally Evaluated Criminal Justice Interventions
1
조회
0
다운로드
0
인용
0
참고문헌
키워드
초록
This paper discusses limitations of the “black-box” experimental archetype by highlighting the narrowness of outcome-focused approaches. For a more complete understanding of the nuanced implications of policies and programs, this study calls for an investigation of causal mechanism and treatment effect heterogeneity in experimentally evaluated interventions. This study draws on two distinct but closely related empirical studies, one undertaken by Na and Paternoster (2012) and the other by Na, Loughran, and Paternoster (2015), that go beyond the estimation of a population average treatment effect by adopting more recent methodological advancements that are still underappreciated and underutilized in evaluation research.
Abstract
This paper discusses limitations of the “black-box” experimental archetype by highlighting the narrowness of outcome-focused approaches. For a more complete understanding of the nuanced implications of policies and programs, this study calls for an investigation of causal mechanism and treatment effect heterogeneity in experimentally evaluated interventions. This study draws on two distinct but closely related empirical studies, one undertaken by Na and Paternoster (2012) and the other by Na, Loughran, and Paternoster (2015), that go beyond the estimation of a population average treatment effect by adopting more recent methodological advancements that are still underappreciated and underutilized in evaluation research.
참고문헌 (33)
- Angrist, J. D., "Treatment effect heterogeneity in theory and practice", Economic Journal, 114(494), pp.C52~C83 (2004), Royal Economic Society
- Berk, R., "Statistical inference after model selection", Journal of Quantitative Criminology, 26(2), pp.217~236 (2010)
- Bollen, K. A., "Structural equations with latent variables" (1989), Wiley
- Burt, C., "Self-control through emerging adulthood:Instability, multidimensionality, and criminological significance", Criminology, 52(3), pp.450~487 (2014)
- Clear, T. R., "Policy and evidence: The challenge to the American Society of Criminology", Criminology, 48(1), pp.1~25 (2010)
- Cook, P., "Calibrating effect size", 12th Annual Jerry Lee Crime Prevention Symposium (2012)
- Gottfredson, M. R., "A General Theory of Crime" (1990), Stanford University Press
- Hay, C., "The development of self-control: Examining self-control theory’s stability thesis", Criminology, 44(4), pp.739~774 (2006)
- Heckman, J. J., "Haavelmo and the birth of modern econometrics: A review of the history of econometric ideas by Mary Morgan", Journal of Economic Literature, 30(2), pp.876~886 (1992)
- Heckman, J. J., "Assessing the case for social experiments", Journal of Economic Perspectives, 9(2), pp.85~110 (1995)
- Hirschi, T., "Handbook of self-regulation: Research, theory, and applications", pp.537~552 (2004), Guilford Press
- Imai, K., "Experimental design for identifying causal mechanisms", Journal of the Royal Statistical Society, 176(1), pp.5~51 (2013)
- Kravitz, R. L., "Evidence-based medicine, heterogeneity of treatment effects, and the trouble with averages", Milbank Quarterly, 82(4), pp.661~687 (2004)
- Kreuter, F., "Analyzing criminal trajectory profiles: Bridging multilevel and group-based approaches using growth mixture modeling", Journal of Quantitative Criminology, 24(1), pp.1~31 (2008)
- Muthén, B. O., "New developments and techniques in structural equation modeling", pp.1~33 (2001), Lawrence Erlbaum
- Muthén, B. O., "General growth mixture modeling for randomized preventive interventions", Biostatistics, 3(4), pp.459~475 (2002)
- Na, C., "On the importance of treatment effect heterogeneity in experimentally-evaluated criminal justice interventions", Journal of Quantitative Criminology, 31(2), pp.289~310 (2015)
- Na, C., "Can self-control change substantially over time? Rethinking the relationship between self- and social control", Criminology, 50(2), pp.427~462 (2012)
- Nagin, D. S., "Group-based modeling of development over the life course" (2005), Harvard University Press
- Nagin, D. S., "Using the group-based trajectory modeling to study crime over the life course", Journal of Criminal Justice Education, 21(2), pp.105~116 (2010)
- Neyman, J., "Statistical problems in agricultural experiments", Journal of the Royal Statistical Society, 2(2), pp.107~180 (1935)
- Pratt, T. C., "The empirical status of Gottfredson and Hirschi’s general theory of crime: A meta-analysis", Criminology, 38(3), pp.931~964 (2000)
- Raudenbush, S. W., "Hierarchical linear models" (2002), Sage Publications
- Rubin, D. B., "Estimating causal effects of treatment in randomized and nonrandomized studies", Journal of Educational Psychology, 66(5), pp.688~701 (1974)
- Rubin, D. B., "Assignment to treatment groups on the basis of a covariate", Journal of Educational Statistics, 2(1), pp.1~26 (1977)
- Rubin, D. B., "Bayesian inference for causal effects: The role of randomization", Annals of Statistics, 6(1), pp.34~58 (1978)
- Sampson, Robert J., "Gold standard myths: Observations on the experimental turn in quantitative criminology", Journal of Quantitative Criminology, 26(4), pp.489~500 (2010)
- Sampson, R. J., "When prediction fails: From crime-prone boys to heterogeneity in adulthood", The Annals of the American Academy of Political and Social Science, 602, pp.73~81 (2005)
- Sherman, L. W., "The power few: Experimental criminology and the reduction of harm", Journal of Experimental Criminology, 3(4), pp.299~321 (2007)
- Sherman, L. W., "Evidence and liberty: The promise of experimental criminology", Criminology and Criminal Justice, 9(1), pp.5~28 (2009)
- Tittle, C. R., "Capacity for self-control and individuals’interest in exercising self-control", Journal of Quantitative Criminology, 20(2), pp.143~172 (2004)
- Weisburd, David, "Justifying the use of non-experimental methods and disqualifying the use of randomized controlled trials: Challenging folklore in evaluation research in crime and justice", Journal of Experimental Criminology, 6(2), pp.209~227 (2010)
