구조방정식 모형의 전반적인 평가 및 효과크기와 연속성에 대한 숙고
Overall evaluation of structural equation models and reflection on effect size and continuity
1
조회
0
다운로드
0
인용
0
참고문헌
키워드
초록
잠재변수 간 관련성을 설명하는데 활발히 사용되고 있는 구조방정식 모형은 적합도를 통하여 그 유용성을 판단할 수 있다. 모형 적합도의 통계적 유의성을 평가하는 검정과 실질적 유의성을 평가하는 적합도 효과크기 지수는 각각 이분법적 해석과 연속적 해석 방식을 이용하여 모형의 유용성을 평가한다. 실질적 유의성의 경우 적합도의 수준을 연속적으로 평가하는 것이 목적이지만, 이를 위해 사용되는 효과크기 지수는 현재 대다수의 연구에서 이분법적으로 해석되고 있다. 본 연구는 모형 적합도의 실질적 유의성을 평가하기 위하여 효과크기 지수의 관점에서 적합도의 수준을 연속적으로 해석하는 방법과 올바른 가이드라인의 사용에 대해 다룬다. 먼저 검정을 이용한 통계적 유의성 평가의 의의에 대해 간단히 설명한 뒤, 구조방정식 모형의 맥락에서 효과크기의 개념을 정의한다. 이후 다양한 종류의 적합도 효과크기 지수를 소개하며, 해당 지수들의 해석에 사용되는 가이드라인의 특징에 대해 설명한다. 마지막으로, 추정된 효과크기 지수 값을 연속적으로 해석하고자 할 때 참고하기에 적절한 가이드라인의 올바른 예시를 제공하며, 연속성이 반영되지 않았을 때의 잘못된 모형 평가 사례와 가이드라인을 근소하게 만족하지 못하는 모형에 대한 올바른 해석 방식에 대해 논의한다.
Abstract
Structural equation model, which is widely used to describe the relationship between latent variables, can be judged by its goodness of fit. The test for statistical significance and the effect size index for practical significance of model fit use dichotomous and continuous interpretation approach to evaluate the usefulness of the model, respectively. However, despite the fact that the level of fit is represented on a continuum for practical significance, the calculated effect size index is interpreted dichotomously by using the guideline as an absolute standard. The present study discusses the process of assessing the practical significance of fit in terms of the effect size index and the correct use of guidelines so that researchers evaluating the fit of a model can interpret the level of fit on a continuum. We begin with a brief discussion of the importance of assessing statistical significance using test, and then define the concept of effect size in the context of structural equation models. We then introduce the different types of goodness of fit effect size indices and describe the characteristics of the guidelines used to interpret them. Finally, we provide examples of appropriate guidelines for interpreting calculated effect size index values on a continuum and discuss examples of incorrect model evaluation when continuity is not reflected, as well as the correct interpretation of models with marginal fit.
참고문헌 (94)
- 김진숙, "인지행동적 요인과부부 불만족도 사이의 관계", 한국심리학회지 : 일반, 29(2), pp.265~288 (2010)
- 연수진, "이성관계에서 안정애착이 갈등해결전략과 관계만족도에 미치는 영향 : 자기효과와 상대방효과", 한국심리학회지 : 일반, 32(2), pp.411~428 (2013)
- 조은영, "자아해석과 주관적안녕감 및 우울간의 관계 : 인지적 유연성, 자기개념 명확성의 매개효과와 자기복잡성의 조절효과", 한국심리학회지 : 일반, 31(2), pp.493~519 (2012)
- Anderson, J. C., "The effect of sampling error on convergence, improper solutions, and goodness-of-fit indices for maximum likelihood confirmatory factor analysis", Psychometrika, 49(2), pp.155~173 (1984)[DOI]
- Asparouhov, T., "SRMR in Mplus", ~ (2018)
- Bagozzi, R., "On the Evaluation of Structural Equation Models", Journal of the Academy of Marketing Sciences, 16(1), pp.74~94 (1988)[DOI]
- Barrett, P., "Structural equation modelling : Adjudging model fit", Personality and Individual Differences, 42(5), pp.815~824 (2007)[DOI]
- Bentler, P. M., "Significance tests and goodness of fit in the analysis of covariance structures", Psychological Bulletin, 88(3), pp.588~606 (1980)[DOI]
- Bentler, P. M., "Comparative fit indexes in structural models", Psychological Bulletin, 107(2), pp.238~246 (1990)[DOI]
- Bollen, K. A., "Structural equations with latent variables" (1989), John Wiley & Sons
- Boomsma, A., "Reporting Analyses of Covariance Structure", Structural Equation Modeling : A Multidisciplinary Journal, 7(3), pp.461~483 (2000)[DOI]
- Brosseau-Liard, P. E., "Adjusting Incremental Fit Indices for Nonnormality", Multivariate Behavioral Research, 49(5), pp.460~470 (2014)[DOI]
- Browne, M. W., "Testing structural equation models", pp.136~162 (1993), Sage
- Chen, F., "An Empirical Evaluation of the Use of Fixed Cut-Off Points in RMSEA Test Statistic in Structural Equation Models", Sociological Methods and Research, 36(4), pp.462~494 (2008)[DOI]
- Cheng, C., "Confidence Intervals of Fit Indexes by Inverting a Bootstrap Test", Structural Equation Modeling : A Multidisciplinary Journal, 24(6), pp.870~880 (2017)[DOI]
- Cohen, J., "Statistical Power Analysis for the Behavioral Sciences" (1988), Lawrence Erlbaum Associates, Publishers
- Curran, P. J., "Finite Sampling Properties of the Point Estimates and Confidence Intervals of the RMSEA", Sociological Methods & Research, 32(2), pp.208~252 (2003)[DOI]
- Ding, L., "Effects of Estimation Methods, Number of Indicators per Factor, and Improper Solutions on Structural Equation Modeling Fit Indices", Structural Equation Modeling : A Multidisciplinary Journal, 2(2), pp.119~143 (1995)[DOI]
- Fan, X., "Statistical Significance and Effect Size in Education Research : Two Sides of a Coin", The Journal of Educational Research, 94(5), pp.275~282 (2001)
- Fan, X., "Effects of sample size, estimation methods, and model specification on structural equation modeling fit indexes", Structural Equation Modeling : A Multidisciplinary Journal, 6(1), pp.56~83 (1999)[DOI]
- Gerpott, F. H., "Stop and Go, Where is My Flow? How and When Daily Aversive Morning Commutes are Negatively Related to Employees’ Motivational States and Behavior at Work", Journal of Applied Psychology (2021), Advance online publication[DOI]
- Goffin, R. D., "A comparison of two new indices for the assessment of fit of structural equation models", Multivariate Behavioral Research, 28(2), pp.205~214 (1993)[DOI]
- Goffin, R. D., "Assessing the adequacy of structural equation models : Golden rules and editorial policies", Personality and Individual Differences, 42(5), pp.831~839 (2007)[DOI]
- Gomer, B., "New effect size measures for structural equation modeling", Structural Equation Modeling : A Multidisciplinary Journal, 26(3), pp.371~389 (2019)[DOI]
- Hayduk, L. A., "Structural equation modeling with LISREL: Essentials and advances" (1987), Johns Hopkins University Press
- Hayduk, L., "Testing! Testing! One, two, three-Testing the theory in structural equation models!", Personality and Individual Differences, 42(5), pp.841~850 (2007)[DOI]
- Heene, M., "Sensitivity of SEM fit indexes with respect to violations of uncorrelated errors", Structural Equation Modeling : A Multidisciplinary Journal, 19(1), pp.36~50 (2012)[DOI]
- Heller, A. S., "The distribution of daily affect distinguishes internalizing and externalizing spectra and subfactors", Journal of Abnormal Psychology, 130(4), pp.319~332 (2021)[DOI]
- Helmstadter, G. C, "Principles of psychological measurement" (1964), Appleton-Century-Crofts
- Herzog, W., "The model-size effect on traditional and modified tests of covariance structures", Structural Equation Modeling : A Multidisciplinary Journal, 14(3), pp.361~390 (2007)[DOI]
- Hooper, D., "Structural Equation Modelling : Guidelines for Determining Model Fit", The Electronic Journal of Business Research Methods, 6(1), pp.53~60 (2008)[DOI]
- Hu, L. -T., "Structural equation modeling: Concepts, issues, and applications", pp.76~99 (1995), Sage Publications, Inc
- Hu, L. -T., "Fit indices in covariance structure modeling : Sensitivity to underparameterized model misspecification", Psychological Methods, 3(4), pp.424~453 (1998)[DOI]
- Hu, L. -T., "Cutoff criteria for fit indexes in covariance structure analysis : Conventional criteria versus new alternatives", Structural Equation Modeling : A Multidisciplinary Journal, 6(1), pp.1~55 (1999)[DOI]
- Jansen, M., "Dimensional comparison effects on(gendered)educational choices", Journal of Educational Psychology, 113(2), pp.330~350 (2021)[DOI]
- Johnson, A., "Preschool executive control predicts social information processing in early elementary school", Journal of Applied Developmental Psychology, 71, pp.101195~ (2020)[DOI]
- Jöreskog, K. G., "LISREL V : Analysis of linear structural relationships by maximum likelihood and least squares methods" (1981), International Educational Services
- Jöreskog, K. G., "Advances in factor analysis and structural equation models" (1984), Rowman & Littlefield Publishers
- Jöreskog, K. G., "A general approach to confirmatory maximum likelihood factor analysis", Psychometrika, 34(2, Pt. 1), pp.183~202 (1969)[DOI]
- Kenny, D. A., "Effect of the number of variables on measures of fit in structural equation modeling", Structural Equation Modeling : A Multidisciplinary Journal, 10(3), pp.333~351 (2003)[DOI]
- Kenny, D. A., "The Performance of RMSEA in Models With Small Degrees of Freedom", Sociological Methods & Research, 44(3), pp.486~507 (2015)[DOI]
- "Measuring model fit" (2020)[URL]
- Kirk, R. E., "Practical significance : A concept whose time has come", Educational and Psychological Measurement, 56(5), pp.746~759 (1996)[DOI]
- Kline, R. B., "Principles and Practice of Structural Equation Modeling" (2016), The Guilford Press
- van Laar, S., "Caught off Base : A Note on the Interpretation of Incremental Fit Indices", Structural Equation Modeling : A Multidisciplinary Journal, 29(6), pp.935~943 (2022)[DOI]
- Lai, K., "A simple analytic confidence interval for CFI given nonnormal data", Structural Equation Modeling : A Multidisciplinary Journal, 26(5), pp.757~777 (2019)[DOI]
- Lai, K., "The problem with having two watches : Assessment of fit when RMSEA and CFI disagree", Multivariate Behavioral Research, 51(2-3), pp.220~239 (2016)[DOI]
- Lin, S.-H., "Positive family events facilitate effective leader behaviors at work : A within-individual investigation of family-work enrichment", Journal of Applied Psychology, 106(9), pp.1412~1434 (2021)[DOI]
- MacCallum, R. C., "Model modifications in covariance structure analysis : the problem of capitalization on chance", Psychological Bulletin, 111(3), pp.490~504 (1992)[DOI]
- MacCallum, R., "Specification searches in covariance structure modeling", Psychological Bulletin, 100(1), pp.107~120 (1986)[DOI]
- MacCallum, R. C., "Power analysis and determination of sample size for covariance structure modeling", Psychological Methods, 1(2), pp.130~149 (1996)[DOI]
- Maiti, S. S., "Two new goodness-of-fit indices for covariance matrices with linear structures", British Journal of Mathematical and Statistical Psychology, 44(1), pp.153~180 (1991)[DOI]
- Markland, D., "The golden rule is that there are no golden rules : A commentary on Paul Barrett's recommendations for reporting model fit in structural equation modelling", Personality and Individual Differences, 42(5), pp.851~858 (2007)[DOI]
- Marsh, H. W., "Goodness of fit in confirmatory factor analysis : The effects of sample size and model parsimony", Quality and Quantity, 28(2), pp.185~217 (1994)[DOI]
- Marsh, H. W., "Assessing Goodness of Fit : Is Parsimony Always Desirable", The Journal of Experimental Education, 64(4), pp.364~390 (1996)[DOI]
- Marsh, H. W., "Goodness-of-fit indexes in confirmatory factor analysis : The effect of sample size", Psychological Bulletin, 103(3), pp.391~410 (1988)[DOI]
- Marsh, H. W., "Is more ever too much? The number of indicators per factor in confirmatory factor analysis", Multivariate Behavioral Research, 33(2), pp.181~220 (1998)[DOI]
- Marsh, H. W., "In Search of Golden Rules : Comment on Hypothesis-Testing Approaches to Setting Cutoff Values for Fit Indexes and Dangers in Overgeneralizing Hu and Bentler's(1999)Findings", Structural Equation Modeling : A Multidisciplinary Journal, 11(3), pp.320~341 (2004)[DOI]
- Marsh, H. W., "Contemporary psychometrics: A festschrift for Roderick P. McDonald", pp.275~340 (2005), Lawrence Erlbaum Associates Publishers
- Maydeu-Olivares, A., "Effect sizes of model misfit in structural equation models: Standardized residual covariances and residual correlations", Methodology: European Journal of Research Methods for the Behavioral and Social Sciences, 13(1), pp.23~30 (2017)[DOI]
- Maydeu-Olivares, A., "Assessing the size of model misfit in structural equation models", Psychometrika, 82(3), pp.533~558 (2017)[DOI]
- Maydeu-Olivares, A., "Assessing fit in structural equation models : a Monte-Carlo evaluation of RMSEA versus SRMR confidence intervals and tests of close fit", Structural Equation Modeling : A Multidisciplinary Journal, 25(3), pp.389~402 (2018)[DOI]
- McDonald, R. P., "Principles and practice in reporting structural equation analyses", Psychological Methods, 7(1), pp.64~82 (2002)[DOI]
- McDonald, R. P., "Choosing a multivariate model : Noncentrality and goodness of fit", Psychological Bulletin, 107(2), pp.247~255 (1990)[DOI]
- McDonald, R. P., "An index of goodness-of-fit based on noncentrality", Journal of Classification, 6(1), pp.97~103 (1989)[DOI]
- Meehl, P. E., "Theory-Testing in Psychology and Physics : A Methodological Paradox", Philosophy of Science, 34(2), pp.103~115 (1967)[DOI]
- Moshagen, M., "The model size effect in SEM : Inflated goodness-of-fit statistics are due to the size of the covariance matrix", Structural Equation Modeling : A Multidisciplinary Journal, 19(1), pp.86~98 (2012)[DOI]
- Pavlov, G., "Using the Standardized Root Mean Squared Residual(SRMR)to Assess Exact Fit in Structural Equation Models", Educational and Psychological Measurement, 81(1), pp.110~130 (2021)[DOI]
- Rau, R., "What is the structure of perceiver effects? On the importance of global positivity and trait-specificity across personality domains and judgment contexts", Journal of Personality and Social Psychology, 120(3), pp.745~764 (2021)[DOI]
- Rojas, N. M., "Preschool teachers' use of discourse practices with Spanish-speaking dual language learners", Journal of Applied Developmental Psychology, 69, pp.101158~ (2020)[DOI]
- Rosen C. C., "When challenges hinder : An investigation of when and how challenge stressors impact employee outcomes", Journal of Applied Psychology, 105(10), pp.1181~1206 (2020)[DOI]
- Schermelleh-Engel, K., "Evaluating the Fit of Structural Equation Models : Tests of Significance and Descriptive Goodness-of-Fit Measures", Methods of Psychological Research, 8(2), pp.23~74 (2003)
- Schreiber, J. B., "Reporting Structural Equation Modeling and Confirmatory Factor Analysis Results : A Review", The Journal of Educational Research, 99(6), pp.323~337 (2006)[DOI]
- Shi, D., "The Relationship Between the Standardized Root Mean Square Residual and Model Misspecification in Factor Analysis Models", Multivariate Behavior Research, 53(5), pp.676~694 (2018)[DOI]
- Shi, D., "Understanding the Model Size Effect on SEM Fit Indices", Educational and Psychological Measurement, 79(2), pp.310~334 (2019)[DOI]
- Shi, D., "The relationship between the standardized root mean square residual and model misspecification in factor analysis models", Multivariate Behavioral Research, 53(5), pp.676~694 (2018)[DOI]
- Sivo, S. A., "The search for"optimal"cutoff properties : Fit index criteria in structural equation modeling", Journal of Experimental Education, 74(3), pp.267~288 (2006)[DOI]
- Steiger, J. H., "EzPATH: A supplementary module for SYSTAT and SYGRAPH" (1989), Systat, Inc
- Taasoobshirazi, G., "The performance of the SRMR, RMSEA, CFI, and TLI : An examination of sample size, path size, and degrees of freedom", Journal of Applied Quantitative Methods, 11(3), pp.31~40 (2016)
- Tanaka, J. S., "A general coefficient of determination for covariance structure models under arbitrary GLS estimation", British Journal of Mathematical and Statistical Psychology, 42(2), pp.233~239 (1989)[DOI]
- Tanaka, J. S., "Testing Structural Equation Models", pp.10~39 (1993), Sage
- Thomsen, T., "Children's emotion regulation repertoire and problem behavior : A latent cross-lagged panel study", Journal of Applied Developmental Psychology, 71, pp.101198~ (2020)[DOI]
- Thompson, B., "AERA editorial policies regarding statistical significance testing : Three suggested reforms", Educational Researcher, 25(2), pp.26~30 (1996)[DOI]
- Thompson P. S., "No obligation? How gender influences the relationship between perceived organizational support and organizational citizenship behavior", Journal of Applied Psychology, 105(11), pp.1338~1350 (2020)[DOI]
- Tukey, J. W., "The Philosophy of Multiple Comparisons", Statistical Science, 6(1), pp.100~116 (1991)
- Tyler, C. P., "Critical consciousness in late adolescence : Understanding if, how, and why youth act", Journal of Applied Developmental Psychology, 70, pp.101165~ (2020)[DOI]
- West, S. G., "Handbook of structural equation modeling", pp.209~231 (2012), The Guilford Press
- Williams, A. L., "Neuroticism and the longitudinal trajectories of anxiety and depressive symptoms in older adolescents", Journal of Abnormal Psychology, 130(2), pp.126~140 (2021)[DOI]
- Williams, L. J., "Condition 9 and 10 tests of model confirmation: A review of James, Mulaik, and Brett (1982) and contemporary alternatives", Organizational Research Methods, 23, pp.6~29 (2020)[DOI]
- Wilkerson, M., "Misconceptions about sample size, statistical significance, and treatment effect", The Journal of Psychology : Interdisciplinary and Applied, 131(6), pp.627~631 (1997)[DOI]
- Ximénez, C., "Assessing Cutoff Values of SEM Fit Indices : Advantages of the Unbiased SRMR Index and Its Cutoff Criterion Based on Communality", Structural Equation Modeling : A Multidisciplinary Journal, 29(3), pp.368~380 (2022)[DOI]
- Yang, P. J., "Commonalities and specificities of positive youth development in the US and Taiwan", Journal of Applied Developmental Psychology, 73(1), pp.101251~ (2021)[DOI]
- Yuan, K. H., "A new measure of misfit forcovariance structure models", Behaviormetrika, 31(1), pp.7~90 (2004)[DOI]
- Zhang, X., "Bootstrapping confidence intervals for fit indexes in structural equation modeling", Structural Equation Modeling : A Multidisciplinary Journal, 23(3), pp.392~408 (2016)[DOI]
