Forecasting KOSPI Return Using a Modified Stochastic AdaBoosting
0
조회
0
다운로드
0
인용
0
참고문헌
키워드
초록
AdaBoost tweaks the sample weight for each training set used in the iterative process, however, it is demonstrated that it provides more correlated errors as the boosting iteration proceeds if models’ accuracy is high enough. Therefore, in this study, we propose a novel way to improve the performance of the existing AdaBoost algorithm by employing heterogeneous models and a stochastic twist. By employing the heterogeneous ensemble, it ensures different models that have a different initial assumption about the data are used to improve on diversity. Also, by using a stochastic algorithm with a decaying convergence rate, the model is designed to balance out the trade-off between model prediction performance and model convergence. The result showed that the stochastic algorithm with decaying convergence rate’s did have a improving effect and outperformed other existing boosting techniques.
Abstract
AdaBoost tweaks the sample weight for each training set used in the iterative process, however, it is demonstrated that it provides more correlated errors as the boosting iteration proceeds if models’ accuracy is high enough. Therefore, in this study, we propose a novel way to improve the performance of the existing AdaBoost algorithm by employing heterogeneous models and a stochastic twist. By employing the heterogeneous ensemble, it ensures different models that have a different initial assumption about the data are used to improve on diversity. Also, by using a stochastic algorithm with a decaying convergence rate, the model is designed to balance out the trade-off between model prediction performance and model convergence. The result showed that the stochastic algorithm with decaying convergence rate’s did have a improving effect and outperformed other existing boosting techniques.
참고문헌 (11)
- Bai, J., "Boosting Diffusion Indices", Journal of Applied Econometrics, 24(4), pp.607~629 (2009)
- Boser, B. E., "A Traning Algorithm for Optimal Margin Classifiers", Paper presented at COLT ’92: Proceedings of 15th Annual Workshop on Computational Learning Theory, pp.144~152 (1992)
- Chen, T., "XGBoost: A Scalable Tree Boosting System", KDD ’16: Proceedings of the 22nd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining (2016)
- Freund, Y., "A Decision-theoretic Generalization of On-line Learning and an Application to Boosting", Journal of Computer and System Sciences, 55(1), pp.119~139 (1997)
- Guyon, I., "Feature Extraction: Foundations and Applications", pp.207~ (2006), Springer
- Hsu, K.-W., "Heterogeneous AdaBoost with Stochastic Algorithm Selection", IMCOM ’17: Proceedings of the 11th Internaitonal Confernce on Ubiquitous Information Management and Communication (2017)
- Huang, G., "Densely Connected Convolutional Networks", Proceedings of the 2017 IEEE Conference on Computer Vision and Pattern Recognition (2017)
- Li, X., "AdaBoost with SVM-based Component Classifiers", Engineering Applications of Artificial Intelligence, 21(5), pp.785~795 (2008)
- McCracken, M. W., "FRED-MD: A Monthly Database for Macroeconomic Research", Journal of Business & Economic Statistics, 34(4), pp.574~589 (2016)
- Ng, S, "Viewpoint: Boosting Recessions", Canadian Journal of Economics, 47(1), pp.1~34 (2014)
- Zhong, X., "Predicting the Daily Return Direction of the Stock Market Using Hybrid Machine Learning Algorithms", Financial Innovation, 5 (2019)