A Comparison of Oversampling Methods on Imbalanced Topic Classification of Korean News Articles
0
조회
0
다운로드
2
인용
0
참고문헌
키워드
초록
Machine learning has progressed to match human performance, including the field of text classification. However, when training data are imbalanced, classifiers do not perform well. Oversampling is one way to overcome the problem of imbalanced data and there are many oversampling methods that can be conveniently implemented. While comparative researches of oversampling methods on non-text data have been conducted, studies comparing oversampling methods under a unifying framework on text data are scarce. This study finds that while oversampling methods generally improve the performance of classifiers, similarity is an important factor that influences the performance of classifiers on imbalanced and resampled data.
Abstract
Machine learning has progressed to match human performance, including the field of text classification. However, when training data are imbalanced, classifiers do not perform well. Oversampling is one way to overcome the problem of imbalanced data and there are many oversampling methods that can be conveniently implemented. While comparative researches of oversampling methods on non-text data have been conducted, studies comparing oversampling methods under a unifying framework on text data are scarce. This study finds that while oversampling methods generally improve the performance of classifiers, similarity is an important factor that influences the performance of classifiers on imbalanced and resampled data.
참고문헌 (37)
- Aggarwal, C. C., "Mining Text Data", pp.163~222 (2013), Springer US
- Ailab, "Evaluation: from Precision, Recall and F-measure to Roc, Informedness, Markedness & Correlation", Journal of Machine Learning Technologies, 2(1), pp.37~63 (2011)
- Aridas, C. K., "Imbalanced-learn: A Python Toolbox to Tackle the Curse of Imbalanced Datasets in Machine Learning", Computing Research Repository, abs, 2016
- Bai, Y., "ADASYN : Adaptive synthetic sampling approach for imbalanced learning", 2008 IEEE International Joint Conference on Neural Networks(IEEE World Congress on Computational Intelligence), pp.1322~1328 (2008)
- Barua S., "Neural Information Processing. ICONIP 2011. Lecture Notes in Computer Science, vol 7063" (2011), Springer
- Barua, S., "MWMOTE--Majority Weighted Minority Oversampling Technique for Imbalanced Data Set Learning", IEEE Transactions on Knowledge and Data Engineering, 26, pp.405~425 (2014)
- Batuwita, R., "Efficient resampling methods for training support vector machines with imbalanced datasets", The 2010 International Joint Conference on Neural Networks (IJCNN), pp.1~8 (2010), IEEE
- Blondel, M., "Scikit-learn : Machine Learning in Python", Journal of Machine Learning Research, 12, pp.2825~2830 (2011)
- Buckley, C., "Pivoted Document Length Normalization", SIGIR (1996)
- Cai, Y., "Oversampling Method for Imbalanced Classification", Computing and Informatics, 34, pp.1017~1037 (2015)
- Chawla, N. V, "SMOTE : Synthetic Minority Over-sampling Technique", Journal of Artificial Intelligence Research, 16, pp.321~357 (2002)
- Chawla, N. V, "The Data Mining and Knowledge Discovery Handbook", pp.853~867 (2005), Springer
- Chawla, N. V., "Editorial: special issue on learning from imbalanced data sets", Special Interest Group on Knowledge Discovery and Data Mining Explorations, 6, pp.1~6 (2004)
- Estabrooks, A., "A multiple resampling method for learning from imbalanced data sets", Computational intelligence, 20(1), pp.18~36 (2004)
- Fawcett, T., "Robust Classification for Imprecise Environments", Machine Learning, 42, pp.203~231 (2001)
- Friedman, J. H., "The elements of statistical learning: data mining, inference, and prediction" (2009), Springer series in statistics
- Han, H., "Borderline-SMOTE: A New Over-Sampling Method in Imbalanced Data Sets Learning", ICIC 2005, Part I, pp.878~887 (2005)
- Learning from Imbalanced Data Sets: A Comparison of Various Strategies, "Japkowicz, N", Association for the Advancement of Artificial Intelligence, ~ (2000)
- Japkowicz, N., "The class imbalance problem : A systematic study", Intelligent data analysis, 6(5), pp.429~449 (2002)
- Joachims, T, "Text categorization with support vector machines : Learning with many relevant features", Machine learning: ECML-98, pp.137~142 (1998)
- "Lexical facts" (2013)[URL]
- Jones, K, "A statistical interpretation of term specificity and its application in retrieval", Journal of Documentation, 28(1), pp.11~21 (1972)
- 김은나, "목표 범주가 희귀한 자료의 과대표본추출에 대한 연구", 응용통계연구, 24(3), pp.477~484 (2011), 한국통계학회
- Krawczyk, Bartosz, "Learning from Imbalanced Data : Open Challenges and Future Directions", Progress in Artificial Intelligence, 5(4), pp.221~232 (2016)
- Kubat, M., "Addressing the Curse of Imbalanced Training Sets: One-Sided Selection", International Conference on Machine Learning, pp.179~186 (1997)
- Lee, W., "Comparison of data pre-processing techniques for relaxing class imbalance problem", Proceedings from the Korean Institute Of Industrial Engineers Conference 2014, pp.2373~2383 (2014)
- Ling, C., "Data Mining for Direct Marketing Problems and Solutions", Proceedings of the Fourth International Conference on Knowledge Discovery and Data Mining (KDD-98) (1998), AAAI Press
- Liu, X., "A Re-Examination of Text Categorization Methods" (1999), Special Interest Group on Information Retrieval
- López, V., "An insight into classification with imbalanced data : Empirical results and current trends on using data intrinsic characteristics", Information Sciences, 250, pp.113~141 (2013)
- Marr, D, "Vision", pp.22~ (1982), MIT Press
- Martins, A. C. R, "Probability biases as Bayesian inference", Judgement and Decision Making, 1(2), pp.108~117 (2006)
- Nguyen, H., "Borderline Over-sampling for Imbalanced Data Classification", Fifth International Workshop on Computational Intelligence & Applications, 11&12 (2009), IEEE SMC Hiroshima Chapter, Hiroshima University
- Park, Eunjeong L., "KoNLPy: Korean natural language processing in Python", Proceedings of the 26th Annual Conference on Human & Cognitive Language Technology (2014)
- Provost, F. J., "Learning When Training Data are Costly: The Effect of Class Distribution on Tree Induction", J. Artif. Intell. Res. (JAIR), 19, pp.315~354 (2003)
- Sebastiani, F, "Machine learning in automated text categorization", ACM Computer Survey, 34, pp.1~47 (2002)
- Sun, A., "On strategies for imbalanced text classification using SVM : A comparative study", Decision Support Systems, 48(1), pp.191~201 (2009)
- Tsoumakas, G, "Multi Label Classification: An Overview", International Journal of Data Warehouse and Mining, 3, pp.1~13 (2007)