대용량 자료에 대한 밀도 적응 격자 기반의 k-NN 회귀 모형
Density Adaptive Grid-based k-Nearest Neighbor Regression Model for Large Dataset
0
조회
0
다운로드
2
인용
0
참고문헌
키워드
초록
Purpose: This paper proposes a density adaptive grid algorithm for the k-NN regression model to reduce the computation time for large datasets without significant prediction accuracy loss. Methods: The proposed method utilizes the concept of the grid with centroid to reduce the number of reference data points so that the required computation time is much reduced. Since the grid generation process in this paper is based on quantiles of original variables, the proposed method can fully reflect the density information of the original reference data set. Results: Using five real-life datasets, the proposed k-NN regression model is compared with the original k-NN regression model. The results show that the proposed density adaptive grid-based k-NN regression model is superior to the original k-NN regression in terms of data reduction ratio and time efficiency ratio, and provides a similar prediction error if the appropriate number of grids is selected. Conclusion: The proposed density adaptive grid algorithm for the k-NN regression model is a simple and effective model which can help avoid a large loss of prediction accuracy with faster execution speed and fewer memory requirements during the testing phase.
Abstract
Purpose: This paper proposes a density adaptive grid algorithm for the k-NN regression model to reduce the computation time for large datasets without significant prediction accuracy loss. Methods: The proposed method utilizes the concept of the grid with centroid to reduce the number of reference data points so that the required computation time is much reduced. Since the grid generation process in this paper is based on quantiles of original variables, the proposed method can fully reflect the density information of the original reference data set. Results: Using five real-life datasets, the proposed k-NN regression model is compared with the original k-NN regression model. The results show that the proposed density adaptive grid-based k-NN regression model is superior to the original k-NN regression in terms of data reduction ratio and time efficiency ratio, and provides a similar prediction error if the appropriate number of grids is selected. Conclusion: The proposed density adaptive grid algorithm for the k-NN regression model is a simple and effective model which can help avoid a large loss of prediction accuracy with faster execution speed and fewer memory requirements during the testing phase.
참고문헌 (21)
- Alcalá-Fdez, J., "Keel Data-mining Software Tool: Data Set Repository, Integration of Algorithms and Experimental Analysis Framework", Journal of Multiple-Valued Logic & Soft Computing, 17 (2011)
- Al-Qahtani, F. H., "August. Multivariate k-nearest Neighbour Regression for Time Series Data—A Novel Algorithm for Forecasting UK Electricity Demand", The 2013 International Joint Conference on Neural Networks (IJCNN), pp.1~8 (2013), IEEE
- Arnaiz-González, Á., "Fusion of Instance Selection Methods in Regression Tasks", Information Fusion, 30, pp.69~79 (2016)
- Bhanu, C. V. K., "Day-Ahead Electricity Price Forecasting Using Wavelets and Weighted Nearest Neighborhood", 2008 Joint International Conference on Power System Technology and IEEE Power India Conference, pp.1~4 (2008), IEEE
- Chen, P., "Virtual Metrology: A Solution for Wafer to Wafer Advanced Process Control", Proc. IEEE Int. Symp. on Semiconductor Manufacturing (ISSM 2005), pp.155~157 (2005)
- Chen, Y. -T., "Multivariate Simulation Assessment for Virtual Metrology", Proc. IEEE Int. Conf. on Robotics and Automation(ICRA 2006), pp.1048~1053 (2006)
- Dimri, A. P., "Precipitation Forecast over Western Himalayas Using k‐nearest Neighbour Method", International Journal of Climatology : A Journal of the Royal Meteorological Society, 28(14), pp.1921~1931 (2008)
- Eronen, A. J., "Music Tempo Estimation With k-NN Regression", IEEE Transactions on Audio, Speech, and Language Processing, 18(1), pp.50~57 (2009)
- Fernandez-Rodrıguez, F., "Exchange-Rate Forecasts with Simultaneous Nearest-Neighbour Methods : Evidence from the EMS", International Journal of Forecasting, 15(4), pp.383~392 (1999)
- Guillén, A., "New Method for Instance or Prototype Selection Using Mutual Information in Time Series Prediction", Neurocomputing, 73(10-12), pp.2030~2038 (2010)
- Hastie, T., "The Elements of Statistical Learning: Data Mining, Inference, and Prediction" (2009), Springer Science & Business Media
- Jayawardena, A. W., "Neighbourhood Selection for Local Modelling and Prediction of Hydrological Time Series", Journal of Hydrology, 258(1-4), pp.40~57 (2002)
- Khan, A. A., "An Approach for Factory-wide Control Utilizing Virtual Metrology", IEEE Transactions on Semiconductor Manufacturing, 20(4), pp.364~375 (2007)
- Lin, T. -H., "A Virtual Metrology Scheme for Predicting CVD Thickness in Semiconductor Manufacturing", Proc. IEEE Int. Conf. on Robotics and Automation (ICRA 2006), pp.1054~1059 (2006)
- Lora, A. T., "Influence of kNN-Based Load Forecasting Errors on Optimal Energy Production", Portuguese Conference on Artificial Intelligence, pp.189~203 (2003), Springer
- Lora, A. T., "Electricity Market Price Forecasting Based on Weighted Nearest Neighbors Techniques", IEEE Transactions on Power Systems, 22(3), pp.1294~1301 (2007)
- Rodríguez-Fdez, I., "An Instance Selection Algorithm for Regression and its Application in Variance Reduction", 2013 IEEE International Conference on Fuzzy Systems (FUZZ-IEEE), pp.1~8 (2013), IEEE
- She, D., "A New Adaptive Local Linear Prediction Method and its Application in Hydrological Time Series", Mathematical Problems in Engineering, pp.2010~ (2010)
- Song, Y., "An Efficient Instance Selection Algorithm for k Nearest Neighbor Regression", Neurocomputing, 251, pp.26~34 (2017)
- Su, A. -J., "Control Relevant Issues in Semiconductor Manufacturing : Overview with Some New Results", Control Engineering Practice, 15(10), pp.1268~1279 (2007)
- Yang, S., "Regression Nearest Neighbor in Face Recognition", 18th International Conference on Pattern Recognition (ICPR'06), 3, pp.515~518 (2006), IEEE