가우시안 기반 Hyper-Rectangle 생성을 이용한 효율적 단일 분류기
An Efficient One Class Classifier Using Gaussian-based Hyper-Rectangle Generation
0
조회
0
다운로드
1
인용
0
참고문헌
키워드
초록
In recent years, imbalanced data is one of the most important and frequent issue for quality control in industrial field. As an example, defect rate has been drastically reduced thanks to highly developed technology and quality management, so that only few defective data can be obtained from production process. Therefore, quality classification should be performed under the condition that one class (defective dataset) is even smaller than the other class (good dataset). However, traditional multi-class classification methods are not appropriate to deal with such an imbalanced dataset, since they classify data from the difference between one class and the others that can hardly be found in imbalanced datasets. Thus, one-class classification that thoroughly learns patterns of target class is more suitable for imbalanced dataset since it only focuses on data in a target class. So far, several one-class classification methods such as one-class support vector machine, neural network and decision tree there have been suggested. One-class support vector machine and neural network can guarantee good classification rate, and decision tree can provide a set of rules that can be clearly interpreted. However, the classifiers obtained from the former two methods consist of complex mathematical functions and cannot be easily understood by users. In case of decision tree, the criterion for rule generation is ambiguous. Therefore, as an alternative, a new one-class classifier using hyper-rectangles was proposed, which performs precise classification compared to other methods and generates rules clearly understood by users as well. In this paper, we suggest an approach for improving the limitations of those previous one-class classification algorithms. Specifically, the suggested approach produces more improved one-class classifier using hyper-rectangles generated by using Gaussian function. The performance of the suggested algorithm is verified by a numerical experiment, which uses several datasets in UCI machine learning repository.
Abstract
In recent years, imbalanced data is one of the most important and frequent issue for quality control in industrial field. As an example, defect rate has been drastically reduced thanks to highly developed technology and quality management, so that only few defective data can be obtained from production process. Therefore, quality classification should be performed under the condition that one class (defective dataset) is even smaller than the other class (good dataset). However, traditional multi-class classification methods are not appropriate to deal with such an imbalanced dataset, since they classify data from the difference between one class and the others that can hardly be found in imbalanced datasets. Thus, one-class classification that thoroughly learns patterns of target class is more suitable for imbalanced dataset since it only focuses on data in a target class. So far, several one-class classification methods such as one-class support vector machine, neural network and decision tree there have been suggested. One-class support vector machine and neural network can guarantee good classification rate, and decision tree can provide a set of rules that can be clearly interpreted. However, the classifiers obtained from the former two methods consist of complex mathematical functions and cannot be easily understood by users. In case of decision tree, the criterion for rule generation is ambiguous. Therefore, as an alternative, a new one-class classifier using hyper-rectangles was proposed, which performs precise classification compared to other methods and generates rules clearly understood by users as well. In this paper, we suggest an approach for improving the limitations of those previous one-class classification algorithms. Specifically, the suggested approach produces more improved one-class classifier using hyper-rectangles generated by using Gaussian function. The performance of the suggested algorithm is verified by a numerical experiment, which uses several datasets in UCI machine learning repository.
참고문헌 (18)
- "UCI machine learning repository"[URL]
- Baehrens, D., "How to explain individual classification decisions", The Journal of Machine Learning Research, 11, pp.1803~1831 (2010)
- Barakat, N., "Rule extraction from support vector machines : a review", Neurocomputing, 74(1-3), pp.178~190 (2010)[DOI]
- Cortes, C., "Support-vector networks", Machine Learning, 20(3), pp.273~297 (1995)
- De Comite, F., "Positive and unlabeled examples help learning", Proceedings of International Conference on Algorithmic Learning Theory, pp.219~230 (1999)
- De Ridder, D., "An experimental comparison of one-class classification methods", 4th Annual Conference of the Advanced School for Computing and Imaging (1998)
- Desir, C., "A random forest based approach for one class classification in medical imaging", Machine Learning in Medical Imaging, Lecture Notes in Computer Science, 7588, pp.250~257 (2012)
- Hempstalk, K., "One-class classification by combining density and class probability estimation", Joint European Conference on Machine Learning and Knowledge Discovery in Databases, pp.505~519 (2008)
- 정인교, "Hyper-Rectangles를 이용한 단일 분류기 설계", 대한산업공학회지, 41(5), pp.439~446 (2015), 대한산업공학회[DOI]
- Juszczak, P., "Minimum spanning tree based one-class classifier", Neurocomputing, 72(7-9), pp.1859~1869 (2009)[DOI]
- 강범수, "융합 인공벌군집 데이터 클러스터링 방법", 한국산업경영시스템학회지, 40(4), pp.203~210 (2017), 한국산업경영시스템학회
- Letouzey, F., "Learning from positive and unlabeled examples", Proceedings of 10th International Conference on Algorithmic Learning Theory, pp.71~85 (2000)
- 박영재, "다중 클래스 SVM을 이용한 트래픽의 이상패턴 검출", 한국산학기술학회논문지, 14(4), pp.1942~1950 (2013), 한국산학기술학회[DOI]
- Scholkopf, B., "Support vector method for novelty detection", Advances in Neural Information Processing Systems, 12, pp.582~588 (2000)
- Tarassenko, L., "Novelty detection for the identification of masses in mammograms", 4th International Conference on Artificial Neural Networks, pp.442~447 (1995)
- Tax, D.M.J., "Data domain description using support vectors", Proceedings of European Symposium on Artificial Neural Networks, pp.251~256 (1999)
- Tax, D.M.J., "Support vector domain description", Pattern Recognition Letters, 20, pp.1191~1199 (1999)[DOI]
- Tax, D.M.J., "One-class Classification", pp.2001