기계학습방법을 이용한 순서형 결측자료 대체의 성능비교
Performance Comparison of Imputation Methods Using Machine Learning Techniques for Ordinal Missing Data
0
조회
0
다운로드
0
인용
0
참고문헌
키워드
초록
Objectives: When missing values occur, complete case analysis can cause biased results. In this paper, we discuss imputation methods using machine learning techniques when missing values occurred in ordinal variables. Methods: We consider two machine learning techniques, the ordinal decision tree and the random forest, for the imputation of missing values. We use the ordinal decision tree treating variables as ordinal, and the random forest as nominal. In addition, we apply the cumulative logistic model. The results are compared with complete case analysis using empirical bias, empirical mean squared error and accuracy. The same methods are applied using the Korea National Health and Nutrition Examination Survey. Results: In the case of five ordinal categories, machine learning techniques yield better performance than the cumulative logistic and complete case. The ordinal decision shows lower bias while random forest shows higher accuracy. In the case of 3 categories, random forest produces better performance in all respects. In the case study, biased results are also identified if we use complete case analysis. Random forest shows the best performance, and the parametric method shows similar performance to the ordinal decision tree. Conclusions: Missing imputation using machine learning techniques can reduce bias and improve per- formance. If possible, it is recommended to use the ordinal decision tree to impute missing values that reflects the meaning of order. If it is not possible, it is recommended to treat them at least as nominal variables and then impute.
Abstract
Objectives: When missing values occur, complete case analysis can cause biased results. In this paper, we discuss imputation methods using machine learning techniques when missing values occurred in ordinal variables. Methods: We consider two machine learning techniques, the ordinal decision tree and the random forest, for the imputation of missing values. We use the ordinal decision tree treating variables as ordinal, and the random forest as nominal. In addition, we apply the cumulative logistic model. The results are compared with complete case analysis using empirical bias, empirical mean squared error and accuracy. The same methods are applied using the Korea National Health and Nutrition Examination Survey. Results: In the case of five ordinal categories, machine learning techniques yield better performance than the cumulative logistic and complete case. The ordinal decision shows lower bias while random forest shows higher accuracy. In the case of 3 categories, random forest produces better performance in all respects. In the case study, biased results are also identified if we use complete case analysis. Random forest shows the best performance, and the parametric method shows similar performance to the ordinal decision tree. Conclusions: Missing imputation using machine learning techniques can reduce bias and improve per- formance. If possible, it is recommended to use the ordinal decision tree to impute missing values that reflects the meaning of order. If it is not possible, it is recommended to treat them at least as nominal variables and then impute.
참고문헌 (12)
- Little RJ, "Statistical analysis with missing data" (2019), John Wiley & Sons
- Sterne JAC, "Multiple imputation for missing data in epidemiological and clinical research : potential and pitfalls", BMJ, 338, pp.b2393~ (2009)[DOI]
- Wang L, "Serum bilirubin and the risk of hypertension", Int J Epidemiol, 44(1), pp.142~152 (2014)[DOI]
- Aris IM, "Patterns of body mass index milestones in early life and cardiometabolic risk in early adolescence", Int J Epidemiol, 48(1), pp.157~167 (2019)[DOI]
- Emmanuel T, "A survey on missing data in machine learning", J Big Data, 8(1), pp.140~ (2021)[DOI]
- James G, "An introduction to statistical learning" (2013), Springer
- Kunzmann K, "Imputation of ordinal outcomes : a comparison of approaches in traumatic brain injury", J Neurotrauma, 38(4), pp.455~463 (2021)[DOI]
- Jonsson P, "An evaluation of k-nearest neighbour imputation using likert data", 10th International Symposium on Software Metrics (2004), IEEE
- Podolsky S, "Ordinal variable imputation for health survey data: a comparison between machine learning and non-machine learning methods", ~ (2021)
- Galimberti G, "Classification trees for ordinal responses in R : the rpartScore package", J Stat Softw, 47, pp.1~25 (2012)[DOI]
- Ture M, "Determining of complexity parameter for recursive partitioning trees by simulation of survival data and an application on breast cancer data", J Stat Manage Syst, 21(1), pp.125~138 (2018)[DOI]
- Cutler A, "Ensemble machine learning: methods and applications", pp.157~175 (2012), Springer
