다차원 펴기 모형과 자료의 특성: 순위자료와 평정자료의 비교
Multidimensional unfolding and characteristics of data: Comparison of ranking and rating data
0
조회
0
다운로드
0
인용
0
참고문헌
키워드
초록
본 연구는 순위자료와 평정자료를 이용하여 판단자와 판단대상을 하나의 도면에 시각화하는 분석기법인펴기모형을적용한후그결과를비교하였다. 펴기모형을비롯한다차원척도 법 모형들은 통계적 가정에서 비교적 자유로운 분석으로 소집단 연구나 개인차에 관심을 가 지는 연구자들에게 유용한 도구가 될 수 있다. 분석에 사용된 자료는 33개 행동을 비난가능 성 차원에서 측정하기 위해 수집된 37명의 자료로, 33개 행동에 대해 두 가지 방법으로 수집 된 자료였다. 33개 행동을 두 개씩 짝비교한 자료는 순위자료로 변환하고, 평정자료는 원자료 를 그대로 사용하였다. 순위자료와 평정자료의 관계를 파악하기 위하여 두 자료의 순위 상관 계수를 산출하고, 두 자료에서 산출된 33개 행동들의 상관계수 행렬을 비교하였다. 그 결과 두 자료는 서로 관련이 없는 것으로 나타났으며, 상관계수 행렬도 매우 다른 양상으로 나타 났다. 펴기분석을 수행한 결과, 평정자료보다 순위자료를 이용하였을 때 판단대상들의 배치가 더 분산되었으며, 판단대상과 판단자의 관계를 시각적으로 파악하는 데 더 유용할 것으로 판 단할 수 있었다. 본 연구는 판단대상과 판단자가 동일한 순위자료와 평정자료의 펴기분석 결 과가 다르다는 것을 보여줌으로써 개인차 연구에서 유용하게 활용될 수 있는 펴기 모형을 적 용하기 위해 연구자들이 고려해야 할 점을 확인하였다.
Abstract
This study compared the results of unfolding analyses, a technique to visualize judges and judged objects in a single figure, using ranking and rating data. Multidimensional scaling models, such as the unfolding model, are relatively free from statistical assumptions and can be advantageous tools for researchers interested in small groups or individual differences. The data used in the analysis were from 37 participants who were asked to measure 33 behaviors on the blameworthiness dimension, and the data were collected in two ways for each of the 33 behaviors. The data from paired comparison method was converted into ranked data, and the rated data was used as raw data. To understand the relationship between the ranking and rating data, we calculated the rank correlation coefficient (rho) between the aggregated statistics of the two data, and compared the correlation matrices of the 33 behaviors from the two data. The results showed that the two data were not related to each other, and the correlation matrices were not similar. As a result of the unfolding analysis, the placement of the behaviors was more distributed when using the ranking data than the rating data. Therefore, the author concluded that ranking data would be more useful to visually understand the relationship between the judgment objects and the judges. This study showed that the results of the unfolding analysis of ranking and rating data from the same judges are different. The current study suggested that, when applying the unfolding model, researchers should consider which type of data can be useful for the individual difference study.
참고문헌 (36)
- Duane F. Alwin, "The Measurement of Values in Surveys: A Comparison of Ratings and Rankings", Public Opinion Quarterly, 49(4), pp.535~ (1985), Oxford University Press (OUP)[DOI]
- Ingwer Borg, "Does the Value Circle Exist Within Persons or Only Across Persons?", Journal of Personality, 85(2), pp.151~162 (2015), Wiley[DOI]
- Borg, I., "Applied Multidimensional Sacling and Unfolding" (2018), Springer
- Ulf Böckenholt, "Comparative Judgments as an Alternative to Ratings: Identifying the Scale Origin.", Psychological Methods, 9(4), pp.453~465 (2004), American Psychological Association (APA)[DOI]
- Frank M.T.A. Busing, "Avoiding degeneracy in metric unfolding by penalizing the intercept", British Journal of Mathematical and Statistical Psychology, 59(2), pp.419~427 (2006), Wiley[DOI]
- Raymond B. Cattell, "Psychological measurement: normative, ipsative, interactive.", Psychological Review, 51(5), pp.292~303 (1944), American Psychological Association (APA)[DOI]
- WAI CHAN, "The Covariance Structure Analysis of Ipsative Data", Sociological Methods & Research, 22(2), pp.214~247 (1993), SAGE Publications[DOI]
- Seung Youn Yonnie Chyung, "Evidence-Based Survey Design: The Use of Continuous Rating Scales in Surveys", Performance Improvement, 57(5), pp.38~48 (2018), International Society for Performance Improvement[DOI]
- Clyde H. Coombs, "Psychological scaling without a unit of measurement.", Psychological Review, 57(3), pp.145~158 (1950), American Psychological Association (APA)[DOI]
- Antonio D’Ambrosio, "Avoiding Degeneracies in Ordinal Unfolding Using Kemeny-Equivalent Dissimilarities for Two-Way Two-Mode Preference Rank Data", Multivariate Behavioral Research, 57(4), pp.679~699 (2021), Informa UK Limited[DOI]
- Jan de Leeuw, "Multidimensional Scaling Using Majorization: SMACOF in<i>R<", i>, 2009, pp.31(3), ~[DOI]
- Timothy W. Elig, "Measuring causal attibutions for success and failure.", Journal of Personality and Social Psychology, 37(4), pp.621~634 (1979), American Psychological Association (APA)[DOI]
- Luigi Fabbris, "Measurement Scales for Scoring or Ranking Sets of Interrelated Items", Survey Data Collection and Integration, pp.21~43 (2012), Springer Berlin Heidelberg[DOI]
- N. T. Feather, "The measurement of values: Effects of different assessment procedures", Australian Journal of Psychology, 25(3), pp.221~231 (1973), Informa UK Limited[DOI]
- Green, P. E., "Applied multidimensional scaling" (1972), Holt, Rinehart and Winston
- Groves, R. M., "Surveys by telephone: A national comparison with personal interviews" (1979), Academic Press
- Airo Hino, "Ranking and Rating: Neglected Biases in Factor Analysis of Postmaterialist Values", International Journal of Public Opinion Research, 31(2), pp.368~381 (2018), Oxford University Press (OUP)[DOI]
- Natalia Jaworska, "A Review of Multidimensional Scaling (MDS) and its Utility in Various Psychological Domains", Tutorials in Quantitative Methods for Psychology, 5(1), pp.1~10 (2009), The Quantitative Methods for Psychology[DOI]
- Minjeong Jeon, "Mapping Unobserved Item–Respondent Interactions: A Latent Space Item Response Model with Interaction Map", Psychometrika, 86(2), pp.378~403 (2021), Springer Science and Business Media LLC[DOI]
- JIN WENJIE, "피해자다움 평가를 위한 심리적 차원의 탐색: 개인차척도법과 다차원 펴기의 적용", 한국심리학회지: 사회및성격, 37(2), pp.159~187 (2023), 한국사회및성격심리학회[DOI]
- Krosnick, "Measures of political attitudes: Volume 2 of measures of social psychological attitudes", pp.37~57 (1999), Academic Press
- J. B. Kruskal, "Multidimensional scaling by optimizing goodness of fit to a nonmetric hypothesis", Psychometrika, 29(1), pp.1~27 (1964), Springer Science and Business Media LLC[DOI]
- Likert, R., "A technique for the measurement of attitudes", Archives of Psychology, 22(140), pp.1~55 (1932)
- Mair, P., "Goodness-of-fit assessment in multidimensional scaling and unfolding", Multivariate behavioral research, 51(6), pp.772~789 (2016)
- Patrick Mair, "More on multidimensional scaling and unfolding in R: smacof version 2", Journal of Statistical Software, 102(10) (2022), Foundation for Open Access Statistic[DOI]
- J. Michael Munson, "Developing Practical Procedures for the Measurement of Personal Values in Cross-Cultural Marketing", Journal of Marketing Research, 16(1), pp.48~ (1979), JSTOR[DOI]
- Phillips, D. L., "Abandoning Method" (1973), Jossey-Bass Publishers
- William L. Rankin, "A comparison of ranking and rating procedures for value system measurement", European Journal of Social Psychology, 10(3), pp.233~246 (1980), Wiley[DOI]
- Thomas J. Reynolds, "Measuring Personal Values: An Evaluation of Alternative Methods", Journal of Marketing Research, 17(4), pp.531~ (1980), JSTOR[DOI]
- Milton Rokeach, "Rokeach Value Survey", PsycTESTS Dataset (1973), American Psychological Association (APA)[DOI]
- P. A. Russell, "Ranking or rating? Some data and their implications for the measurement of evaluative response", British Journal of Psychology, 85(1), pp.79~92 (1994), Wiley[DOI]
- Ian Spence, "Monte Carlo studies in nonmetric scaling", Psychometrika, 43(1), pp.115~117 (1978), Springer Science and Business Media LLC[DOI]
- Warren S. Torgerson, "Multidimensional scaling: I. Theory and method", Psychometrika, 17(4), pp.401~419 (1952), Springer Science and Business Media LLC[DOI]
- Torgerson, W. S., "Theory and methods of scaling" (1958), Wiley
- Hester van Herk, "Insight into the relative merits of rating and ranking in a cross-national context using three-way correspondence analysis", Food Quality and Preference, 18(8), pp.1096~1105 (2007), Elsevier BV[DOI]
- DAWN M. VANLEEUWEN, "A Note on the Reliability of Ranked Items", Sociological Methods & Research, 31(1), pp.87~105 (2002), SAGE Publications[DOI]