불균형 데이터 분류를 위한 딥러닝 기반 오버샘플링 기법
A Deep Learning Based Over-Sampling Scheme for Imbalanced Data Classification
0
조회
0
다운로드
11
인용
0
참고문헌
키워드
초록
분류 문제는 주어진 입력 데이터에 대해 해당 데이터의 클래스를 예측하는 문제로, 자주 쓰이는 방법 중의 하나는 주어진 데이터셋을 사용하여 기계학습 알고리즘을 학습시키는 것이다. 이런 경우 분류하고자 하는 클래스에 따른 데이터의 분포가 균일한 데이터셋이 이상적이지만, 불균형한 분포를 가지고 경우 제대로 분류하지 못하는 문제가 발생한다. 이러한 문제를 해결하기 위해 본 논문에서는 Conditional Generative Adversarial Networks(CGAN)을 활용하여 데이터 수의 균형을 맞추는 오버샘플링 기법을 제안한다. CGAN은 Generative Adversarial Networks(GAN)에서 파생된 생성 모델로, 데이터의 특징을 학습하여 실제 데이터와 유사한 데이터를 생성할 수 있다. 따라서 CGAN이 데이터 수가 적은 클래스의 데이터를 학습하고 생성함으로써 불균형한 클래스 비율을 맞추어 줄 수 있으며, 그에 따라 분류 성능을 높일 수 있다. 실제 수집된 데이터를 이용한 실험을 통해 CGAN을 활용한 오버샘플링 기법이 효과가 있음을 보이고 기존 오버샘플링 기법들과 비교하여 기존 기법들보다 우수함을 입증하였다.
Abstract
Classification problem is to predict the class to which an input data belongs. One of the most popular methods to do this is training a machine learning algorithm using the given dataset. In this case, the dataset should have a well-balanced class distribution for the best performance. However, when the dataset has an imbalanced class distribution, its classification performance could be very poor. To overcome this problem, we propose an over-sampling scheme that balances the number of data by using Conditional Generative Adversarial Networks (CGAN). CGAN is a generative model developed from Generative Adversarial Networks (GAN), which can learn data characteristics and generate data that is similar to real data. Therefore, CGAN can generate data of a class which has a small number of data so that the problem induced by imbalanced class distribution can be mitigated, and classification performance can be improved. Experiments using actual collected data show that the over-sampling technique using CGAN is effective and that it is superior to existing over-sampling techniques.
참고문헌 (30)
- R. O’Brien, "A random forests quantile classifier for class imbalanced data", Pattern Recognition, 90, pp.232~249 (2019)
- G. Haixiang, "Learning from class-imbalanced data : Review of methods and applications", Expert Systems with Applications, 73, pp.220~239 (2017)
- S. J. Salvatore, "Cost-based modeling for fraud and intrusion detection : Results from the JAM project", Pro ceedings of the DARPA Information Survivability Conference and Exposition, pp.130~144 (2000)
- C. X. Ling, "Data mining for direct marketing:Problems and solutions", Proceedings of the Fourth International Conference on Knowledge Discovery and Data Mining, pp.73~79 (1998)
- J. Van Hulse, "Experimental perspectives on learning from imbalanced data", Proceedings of the ACM International Conference on Machine Learning, pp.935~942 (2007)
- X. Y. Liu, "Exploratory undersampling for class-imbalance learning", IEEE Transactions on Systems, Man, and Cybernetics, 39(2), pp.539~550 (2009)
- N. V. Chawla, "SMOTE : synthetic minority oversampling technique", Journal of Artificial Intelligence Research, 16, pp.321~357 (2002)
- H. He, "ADASYN: Adaptive synthetic sampling approach for imbalanced learning", Proceedings of the IEEE International Joint Conference on Neural Networks, pp.1322~1328 (2008)
- H. Han, "Borderline-SMOTE:a new over-sampling method in imbalanced data sets learning", Proceedings of the International Conference on Intelligent Computing, pp.878~887 (2005)
- M. Mirza, "Conditional generative adversarial nets", arXiv preprint arXiv:1411.1784, ~ (2014)
- I. J. Goodfellow, "Generative adversarial nets", Proceedings of the Neural Information Processing Systems, pp.2672~2680 (2014)
- H. M. Nguyen, "Borderline Over-Sampling for Imbalanced Data Classification", International Journal of Knowledge Engineering and Soft Data Paradigms, 3(1), pp.4~21 (2011)
- C. Cortes, "Support-vector networks", Machine learning, 20(3), pp.273~297 (1995)
- T. Jo, "Class Imbalances versus Small Disjuncts", ACM Special Interest Group on Knowledge Discovery in Data, 6, pp.40~49 (2004)
- N. Macia, "A.Preliminary Approach in Synthetic Data Sets Generation based on Class Separability Measure", Proceedings of the International Conference on Pattern Recognition, pp.1~4 (2008)
- H. Y. Wang, "Combination Approach of SMOTE and Biased-SVM for Imbalanced Datasets", Proceedings of the International Joint Conference on Neural Networks, pp.228~231 (2008)
- C. H. Hoi, "Biased support vector machine for relevance feedback in image retrieval", Proceedings of the IEEE International Joint Conference on Neural Networks (2004)
- G. E. Batista, "A Study of the Behavior of Several Methods for Balancing Machine Learning Training Data", ACM SIGKDD Explorations Newsletter, 6(1), pp.20~29 (2004)
- D. L. Wilson, "Asymptotic Properties of Nearest Neighbor Rules Using Edited Data", IEEE Transactions on Systems Man and Communications(SMC), 3, pp.408~421 (1972)
- I. Tomek, "Two Modifications of CNN", IEEE Transactions on Systems Man and Communications(SMC), 6, pp.769~772 (1976)
- Y. Liu, "Boosting Prediction Accuracy on Imbalanced Datasets with SVM Ensembles", Proceedings of the Tenth Pacific-Asia Conference on Knowledge Discovery and Data Mining, pp.107~118 (2006)
- Adaptive machine learning for credit card fraud detection, "A. Dal Pozzolo", ~ (2015)
- "MineThatData"[URL]
- S. Moro, "A data-driven approach to predict the success of bank telemarketing", Decision Support Systems, 62, pp.22~31 (2014)
- A. Liaw, "Classification and regression by randomForest", R News, 2(3), pp.18~22 (2002)
- S. S. Haykin, "Neural networks and learning machines, Vol. 3" (2009), Pearson
- V. Nair, "Rectified linear units improve restricted boltzmann machines", Proceedings of the 27th international conference on machine learning (ICML-10), pp.807~814 (2010)
- D. P. Kingma, "Adam: A method for stochastic optimization", Proceedings of 3rd International Conference on Learning Representations (2014)
- I. Jolliffe, "International Encyclopedia of Statistical Science", pp.1094~1096 (2011), Springer
- G. W. Corder, "Nonparametric Statistics for Non-Statisticians: A Step-by-Step Approach" (2014), John Wiley & Sons