A Study of Model Selection for Electric Data using Cross Validation Approach
0
조회
0
다운로드
0
인용
0
참고문헌
키워드
초록
In this paper, the appropriate model is selected for the risk assessment of the electric utility pole data with the help of cheat sheets and k-fold cross validation. In order to analyze, predict and forecast the data, the appropriate model has to be selected. The major issue is the declination of the accuracy in the model fitting, which may result in poor model selection. There are different type of machine learning algorithm, which makes it difficult to conclude the model selection. To ensure the proper selection of the model, we undergo a two-step process. Firstly, the basic model is selected with the existing model selection cheat sheets named as Scikit learn and Microsoft azure, by understanding the available input and required output of the data. After getting through the multiple question, the respective models such as Generalized Additive Model, Generalized Linear Model, Linear Regression and Support Vector Machine are obtained. In order to attain the appropriate model, we perform k-fold cross validation to estimate the risk of the algorithms, by comparing 2-fold, 8-fold and 10-fold cross validation. Between the three set, the 10-cross fold validation of generalized additive model is selected with the least risk error. Using k-fold cross validation, we estimate the accuracy of the model that is suitable for the data, by using the electric power data set.
Abstract
In this paper, the appropriate model is selected for the risk assessment of the electric utility pole data with the help of cheat sheets and k-fold cross validation. In order to analyze, predict and forecast the data, the appropriate model has to be selected. The major issue is the declination of the accuracy in the model fitting, which may result in poor model selection. There are different type of machine learning algorithm, which makes it difficult to conclude the model selection. To ensure the proper selection of the model, we undergo a two-step process. Firstly, the basic model is selected with the existing model selection cheat sheets named as Scikit learn and Microsoft azure, by understanding the available input and required output of the data. After getting through the multiple question, the respective models such as Generalized Additive Model, Generalized Linear Model, Linear Regression and Support Vector Machine are obtained. In order to attain the appropriate model, we perform k-fold cross validation to estimate the risk of the algorithms, by comparing 2-fold, 8-fold and 10-fold cross validation. Between the three set, the 10-cross fold validation of generalized additive model is selected with the least risk error. Using k-fold cross validation, we estimate the accuracy of the model that is suitable for the data, by using the electric power data set.
참고문헌 (16)
- R. S. Michalski, "Machine learning: An artificial intelligence approach" (2013), Springer Science & Business Media
- C. M. Bishop, "Pattern recognition and machine learning (information science and statistics)" (2006), springer-verlag new york. Inc
- D. J. Hand, "Principles of data mining" (2001), MIT press
- A. K. Jain, "Statistical pattern recognition: A review", IEEE Transactions on pattern analysis and machine intelligence, 22(1), pp.4~37 (2000)
- T. O. Ayodele, "New advances in machine learning" (2010), InTech
- A survey of cross-validation procedures for model selection, "S. Arlot", 40~79 (2010)
- B. Gu, "A new generalized error path algorithm for model selection", International Conference on Machine Learning, pp.2549~2558 (2015)
- R. R. Bies, "A genetic algorithm-based, hybrid machine learning approach to model selection", Journal of Pharmacokinetics and Pharmacodynamics, 33(2), pp.195~221 (2006)
- F. Pedregosa, "Scikit-learn: Machine learning in Python", Journal of Machine Learning Research, 12, pp.2825~2830 (2011)
- S. Mund, "Microsoft azure machine learning" (2015), Packt Publishing Ltd
- S. Chatterjee, "Regression analysis by example" (2015), John Wiley & Sons
- D. Michie, "Machine learning, neural and statistical classification" (1994)
- S. B. Kotsiantis, "Supervised machine learning: A review of classification techniques" (2007)
- T. Kanungo, "An efficient k-means clustering algorithm:Analysis and implementation", IEEE transactions on pattern analysis and machine intelligence, 24(7), pp.881~892 (2002)
- F. Pedregosa, "Scikit-learn: Machine learning in Python", Journal of Machine Learning Research, 12, pp.2825~2830 (2011)
- "Microsoft Azure" (2017)[URL]