Improving the Error Back-Propagation Algorithm for Imbalanced Data Sets
0
조회
0
다운로드
0
인용
0
참고문헌
키워드
초록
Imbalanced data sets are difficult to be classified since most classifiers are developed based on the assumption that class distributions are well-balanced. In order to improve the error back-propagation algorithm for the classification of imbalanced data sets, a new error function is proposed. The error function controls weight-updating with regards to the classes in which the training samples are. This has the effect that samples in the minority class have a greater chance to be classified but samples in the majority class have a less chance to be classified. The proposed method is compared with the two-phase, threshold-moving, and target node methods through simulations in a mammography data set and the proposed method attains the best results.
Abstract
Imbalanced data sets are difficult to be classified since most classifiers are developed based on the assumption that class distributions are well-balanced. In order to improve the error back-propagation algorithm for the classification of imbalanced data sets, a new error function is proposed. The error function controls weight-updating with regards to the classes in which the training samples are. This has the effect that samples in the minority class have a greater chance to be classified but samples in the majority class have a less chance to be classified. The proposed method is compared with the two-phase, threshold-moving, and target node methods through simulations in a mammography data set and the proposed method attains the best results.
참고문헌 (14)
- H. Zhao, "Instance Weighting versus Threshold Adjusting for Cost-Sensitive Classification", Knowledge and Information Systems, 15, pp.321~334 (2008)
- Y.-M. Huang, "Evaluation of Neural Networks and Data Mining Methods on a Credit Assessment Task for Class Imbalance Problem", Nonlinear Analysis, 7, pp.720~747 (2006)
- R. Bi, "Predicting gene ontology functions based on support vector machines and statistical significance estimation", Neurocomputing, 70, pp.718~725 (2007)
- N. V. Chawla, "SMOTE: Synthetic Minority Over-sampling Technique", J. Artificial Intelligence Research, 16, pp.321~357 (2002)
- F. Provost, "Robust Classification for Imprecise Environments", Machine Learning, 42, pp.203~231 (2001)
- D. E. Rumelhart, "Parallel Distributed Processing" (1986)
- P. Kang, "EUS SVMs: ensemble of under-sampled SVMs for data imbalance problem", Proc. ICONIP’06, pp.837~846 (2006)
- L. Bruzzone, "Classification of Remote-Sensing Data by Neural Networks", Pattern Recognition Letters, 18, pp.1323~1328 (1997)
- Z.-H. Zhou, "Training Cost-Sensitive Neural Networks with Methods Addressing the Class Imbalance Problem", IEEE Trans. Know. and Data Eng., 18(1), pp.63~77 (2006)
- S.-H. Oh, "Improving the Error Back-Propagation Algorithm with a Modified Error Function", IEEE Trans. Neural Networks, 8, pp.799~803 (1997)
- S.-H. Oh, "Error Back-Propagation Algorithm for Classification of Imbalanced Data", Neurocomputing, 74, pp.1058~1061 (2011)
- H. White, "Learning in Artificial Neural Networks: A Statistical Perspective", Neural Computation, 1(4), pp.425~464 (1989)
- 오상훈, "A Statistical Perspective of Neural Networks for Imbalanced Data Problems", International Journal of Contents, 7(3), pp.1~5 (2011), 한국콘텐츠학회
- A. van Ooyen, "Improving the convergence of the backpropagation algorithm", Neural Networks, 5, pp.465~471 (1992)