연관성 기반 비유사성을 활용한 범주형 자료 군집분석
Categorical Data Clustering Analysis Using Association-based Dissimilarity
1
조회
0
다운로드
1
인용
0
참고문헌
키워드
초록
Purpose: The purpose of this study is to suggest a more efficient distance measure taking into account the relationship between categorical variables for categorical data cluster analysis. Methods: In this study, the association-based dissimilarity was employed to calculate the distance between two categorical data observations and the distance obtained from the association-based dissimilarity was applied to the PAM cluster algorithms to verify its effectiveness. The strength of association between two different categorical variables can be calculated using a mixture of dissimilarities between the conditional probability distributions of other categorical variables, given these two categorical values. In particular, this method is suitable for datasets whose categorical variables are highly correlated. Results: The simulation results using several real life data showed that the proposed distance which considered relationships among the categorical variables generally yielded better clustering performance than the Hamming distance. In addition, as the number of correlated variables was increasing, the difference in the performance of the two clustering methods based on different distance measures became statistically more significant. Conclusion: This study revealed that the adoption of the relationship between categorical variables using our proposed method positively affected the results of cluster analysis.
Abstract
Purpose: The purpose of this study is to suggest a more efficient distance measure taking into account the relationship between categorical variables for categorical data cluster analysis. Methods: In this study, the association-based dissimilarity was employed to calculate the distance between two categorical data observations and the distance obtained from the association-based dissimilarity was applied to the PAM cluster algorithms to verify its effectiveness. The strength of association between two different categorical variables can be calculated using a mixture of dissimilarities between the conditional probability distributions of other categorical variables, given these two categorical values. In particular, this method is suitable for datasets whose categorical variables are highly correlated. Results: The simulation results using several real life data showed that the proposed distance which considered relationships among the categorical variables generally yielded better clustering performance than the Hamming distance. In addition, as the number of correlated variables was increasing, the difference in the performance of the two clustering methods based on different distance measures became statistically more significant. Conclusion: This study revealed that the adoption of the relationship between categorical variables using our proposed method positively affected the results of cluster analysis.
참고문헌 (18)
- Burnaby, T. P, "On a method for character weighting a similarity coefficient, employing the concept of information", Journal of the International Association for Mathematical Geology, 2(1), pp.25~38 (1970)
- Cha, S. H, "Comprehensive survey on distance", similarity measures between probability density functions, 2007, pp.1(2), 1~
- Chakraborty, D. D, "Statistical decision theory. estimation, testing and selection", Investigación Operacional, 29(2), pp.184~185 (2008)
- Classical resemblance measures. Analysis of Symbolic Data. Exploratory methods for extracting statistical information from complex data, "Esposito, F.", 139~152 (2000)
- Goodall, D. W, "A new similarity index based on probability", Biometrics, pp.882~907 (1966)
- Hamming, R. W, "Error detecting and error correcting codes", Bell System technical journal, 29(2), pp.147~160 (1950)
- Jia, H., "A new distance metric for unsupervised learning of categorical data", IEEE transactions on neural networks and learning systems, 27(5), pp.1065~1079 (2016)
- Kaufman, L., "Clustering by means of medoids" (1987), North-Holland
- Kullback, S., "On information and sufficiency", The annals of mathematical statistics, 22(1), pp.79~86 (1951)
- Le, S. Q., "An association-based dissimilarity measure for categorical data", Pattern Recognition Letters, 26(16), pp.2549~2557 (2005)
- 임용빈, "품질경영학회 50주년 특별호: 통계적 기법 분야 연구 리뷰", 품질경영학회지, 44(2), pp.221~244 (2016), 한국품질경영학회[DOI]
- Lin, D, "An information-theoretic definition of similarity", Icml, 98(1998), pp.296~304 (1998)
- Lin, J, "Divergence measures based on the Shannon entropy", IEEE Transactions on Information theory, 37(1), pp.145~151 (1991)
- Mahalanobis, P. C., "On the generalized distance in statistics" (1936), National Institute of Science of India
- Rand, W. M, "Objective criteria for the evaluation of clustering methods", Journal of the American Statistical association, 66(336), pp.846~850 (1971)
- 서명교, "군집기반 열간조압연설비 상태모니터링과 진단", 품질경영학회지, 45(1), pp.25~38 (2017), 한국품질경영학회[DOI]
- Smirnov, E. S, "On exact methods in systematics", Systematic Biology, 17(1), pp.1~13 (1968)
- Suh, C. J., "Introduction to Management Quality" (2013), Parkyong