보건정보 자료를 이용한 나무구조회귀모형의 시각화에 대한 고찰
Visualization with Various Tree-based Regression Results in Health Information Data
1
조회
0
다운로드
0
인용
0
참고문헌
키워드
초록
Objectives: Among machine learning techniques, a tree-based regression model is widely used as easy to interpret and easy to use results. Methods: In this study, we examine the characteristics of regression models using various tree structures implemented in R, and apply them to public health data for visual representation and analysis to enhance understanding of the models and data. Results: We also look at the random forest, gradient boosting model, and xgboost that incorporate the results of various tree-structured model estimates using bagging and boosting, and visualize these estimation processes to compare the results of the model estimates. It also compares the performance of various tree-structured models using various public health data. It visually examines that the performance of the tree-structured models may vary depending on the characteristics of the data. Conclusions: Through this study, we apply the tree-structured models to public health data to enhance understanding of the data and to help identify and visualize the mechanism of the data.
Abstract
Objectives: Among machine learning techniques, a tree-based regression model is widely used as easy to interpret and easy to use results. Methods: In this study, we examine the characteristics of regression models using various tree structures implemented in R, and apply them to public health data for visual representation and analysis to enhance understanding of the models and data. Results: We also look at the random forest, gradient boosting model, and xgboost that incorporate the results of various tree-structured model estimates using bagging and boosting, and visualize these estimation processes to compare the results of the model estimates. It also compares the performance of various tree-structured models using various public health data. It visually examines that the performance of the tree-structured models may vary depending on the characteristics of the data. Conclusions: Through this study, we apply the tree-structured models to public health data to enhance understanding of the data and to help identify and visualize the mechanism of the data.
참고문헌 (36)
- Malehi AS, "Enhanced Expert Systems" (2019), Intech Open
- Fonarow GC, "Risk stratification for in-hospital mortality in acutely decompensated heart failure : classification and regression tree analysis", JAMA, 293(5), pp.572~580 (2005)[DOI]
- Cheng Z, "Evaluation of classification and regression tree(CART)model in weight loss prediction following head and neck cancer radiation therapy", Adv Radiat Oncol, 3(3), pp.346~355 (2017)[DOI]
- Karafin MS, "The impact of recipient factors on the lower than expected hemoglobin increment in transfused outpatients with hematologic diseases", Transfusion, 59(8), pp.2544~2550 (2019)[DOI]
- Loh WY, "A regression tree approach to identifying subgroups with differential treatment effects", Stat Med, 34(11), pp.1818~1833 (2015)[DOI]
- Loh WY, "Identification of subgroups with differential treatment effects for longitudinal and multiresponse variables", Stat Med, 35(26), pp.4837~4855 (2016)[DOI]
- Dusseldorp E, "The regression trunk approach to discover treatment covariate interaction", Psychometrika, 69(3), pp.355~374 (2004)[DOI]
- Dusseldorp E, "Combining an additive and tree-based regression model simultaneously : STIMA", J Comput Graph Stat, 19(3), pp.514~530 (2010)
- Morgan JN, "Problems in the analysis of survey data, and a proposal", J Am Stat Assoc, 58(302), pp.415~434 (1963)
- Einhorn HJ, "Alchemy in the behavioral sciences", Public Opin Q, 36(3), pp.367~378 (1972)
- Doyle P, "The use of automatic interaction detector and similar search procedures", J Oper Res Soc, 24(3), pp.465~467 (1973)
- Breiman L, "Classification and regression trees", pp.1984, Chapman & Hall
- Quinlan JR, "Learning with continuous classes", 5th Australian Joint Conference on Artificial Intelligence, pp.343~348 (1992), World Scientific
- Wang Y, "Induction of model trees for predicting continuous classes", Poster papers of the 9th European Conference on Machine Learning (1996), Springer
- Torgo L, "Functional models for regression tree leaves", ICML, pp.385~393 (1997)
- Chaudhuri P, "Piecewise-polynomial regression trees", Stat Sinica, 4(1), pp.143~167 (1994)
- Loh WY, "Regression tress with unbiased variable selection and interaction detection", Stat Sinica, 12(2), pp.361~386 (2002)
- Hothorn T, "Unbiased recursive partitioning: a conditional inference framework", J Comput Graph Stat, 15(3), pp.651~674 (2006)[DOI]
- Kim H, "Visualizable and interpretable regression models with good prediction power", IIE Transactions, 39(6), pp.565~579 (2007)[DOI]
- Loh WY, "Handbook of Data Visualization", pp.447~469 (2008), Springer
- Garcia AL, "Improved prediction of body fat by measuring skinfold thickness, circumferences, and bone breadths", Obes Res, 13(3), pp.626~634 (2005)[DOI]
- Hothorn T, "ctree: Conditional inference trees", The Comprehensive R Archive Network, pp.1~34 (2015)
- Breiman L, "Bagging predictors", Mach Learn, 24(2), pp.123~140 (1996)[DOI]
- Friedman JH, "Additive logistic regression: a statistical view of boosting", Ann Stat, 28(2), pp.337~374 (2000)
- Breiman L, "Random forests", Mach Learn, 45(1), pp.5~32 (2001)[DOI]
- Friedman JH, "Greedy function approximation : a gradient boosting machine", Ann Stat, 29(5), pp.1189~1232 (2001)
- Friedman JH, "Stochastic gradient boosting", Comput Stat Data Anal, 38(4), pp.367~378 (2002)[DOI]
- Chen T, "XGBoost: a scalable tree boosting system", 22nd SIGKDD Conference on Knowledge Discovery and Data Mining (2016)
- Ridgeway G, "Generalized boosted models: a guide to the gbm package", ~ (2007)
- Chen T, "Xgboost: extreme gradient boosting", R package version 0.4-2, ~ (2015)
- Chipman HA, "BART : Bayesian additive regression trees", Ann Appl Stat, 4(1), pp.266~298 (2010)[DOI]
- Kapelner A, "bartMachine : machine learning with Bayesian additive regression Trees", J Stat Softw, 70(4), pp.1~40 (2016)[DOI]
- Biecek P, "DALEX : explainers for complex predictive models in R", J Mach Learn Res, 19(1), pp.3245~3249 (2018)
- Gosiewska A, "auditor: an R Package for Model-Agnostic Visual Validation and Diagnostic", arXiv 2018; preprint arXiv:1809.07763, ~
- Kenkel DS, "The effect of physician advice on alcohol consumption : count regression with an endogenous treatment effect", J Appl Econ, 16(2), pp.165~184 (2001)
- Hilbe JM, "Negative binomial regression" (2011), Cambridge University Press
