A Feature Selection-based Ensemble Method for Arrhythmia Classification
1
조회
0
다운로드
0
인용
0
참고문헌
키워드
초록
In this paper, a novel method is proposed to build an ensemble of classifiers by using a feature selection schema. The feature selection schema identifies the best feature sets that affect the arrhythmia classification. Firstly, a number of feature subsets are extracted by applying the feature selection schema to the original dataset. Then classification models are built by using the each feature subset. Finally, we combine the classification models by adopting a voting approach to form a classification ensemble. The voting approach in our method involves both classification error rate and feature selection rate to calculate the score of the each classifier in the ensemble. In our method,the feature selection rate depends on the extracting order of the feature subsets. In the experiment, we applied our method to arrhythmia dataset and generated three top disjointed feature sets. We then built three classifiers based on the top-three feature subsets and formed the classifier ensemble by using the voting approach. Our method can improve the classification accuracy in high dimensional dataset. The performance of each classifier and the performance of their ensemble were higher than the performance of the classifier that was based on whole feature space of the dataset. The classification performance was improved and a more stable classification model could be constructed with the proposed approach.
Abstract
In this paper, a novel method is proposed to build an ensemble of classifiers by using a feature selection schema. The feature selection schema identifies the best feature sets that affect the arrhythmia classification. Firstly, a number of feature subsets are extracted by applying the feature selection schema to the original dataset. Then classification models are built by using the each feature subset. Finally, we combine the classification models by adopting a voting approach to form a classification ensemble. The voting approach in our method involves both classification error rate and feature selection rate to calculate the score of the each classifier in the ensemble. In our method,the feature selection rate depends on the extracting order of the feature subsets. In the experiment, we applied our method to arrhythmia dataset and generated three top disjointed feature sets. We then built three classifiers based on the top-three feature subsets and formed the classifier ensemble by using the voting approach. Our method can improve the classification accuracy in high dimensional dataset. The performance of each classifier and the performance of their ensemble were higher than the performance of the classifier that was based on whole feature space of the dataset. The classification performance was improved and a more stable classification model could be constructed with the proposed approach.
참고문헌 (21)
- Schapire RE, "Boosting the margin: A new explanation for the effectiveness of voting methods", pp.1651~1686 (1998), Statistics
- Alexey Tsymbal, "Feature selection for Simple Bayesian Classifiers", pp.592~600 (2002), ISSU
- Eugene Tuv, "Feature selection with Ensembles, Artificial variables, and Redundancy elimination", Journal of Machine Learning Research, 10, pp.1341~1366 (2009)
- Ching Wei Bang, "New Ensemble Machine Learning Method for Classification and Prediction on Gene Expression Data", pp.3478~3481 (2006), IEEE
- Mohamed Ezzeldin A.Bashir, "Nested Ensemble Technique for Excellence Real time cardiac Health Monitoring" (2010), BIOCOMP
- S. Oh, "Ensemble learning with active example selection for imbalanced biomedical data classification", IEEE, 2011, pp.8(2), ~
- Thara Soman, "Classification of Arrhythmia Using Machine Learning Techniques", WSEAS Transactions on computers, 4, pp.548~552 (2005)
- Mohd Fauzi bin Othman, "Comparison of Different Classification Techniques Using WEKA for Breast cancer", IFMBE Proceedings, 15, pp.520~523 (2007)
- Asha Gowda Karegowda, "Feature Subset Selection Problem using Wrapper Approach in Supervised learning", International journal of Computer applications, 1(7), pp.13~17 (2010)
- Pengy Yang, "A Review of Ensemble Methods in Bioinformatics", Current Bioinformatics, 5(4), pp.296~308 (2010)
- Ching Wei Bang, "New Ensemble Machine Learning Method for Classification and Prediction on Gene Expression Data", pp.3478~3481 (2006), IEEE
- "Machine Learning Repository"[URL]
- "Weka web site"[URL]
- F. Yaghouby, "Classification of Cardiac Abnormalities Using Reduced Features of Heart Rate Variability Signal", World Applied Sciences Journal, 6, pp.1547~1554 (2009)
- M. R. Homaeinezhad, "Combination of Different Classifiers for cardiac Arrhythmia Recognition", World Academy of Science, Engiinering and technology, pp.1189~1200 (2011)
- Zhi Hua Zhou, "Ensemble Learning, In Encyclopedia of Bioinformatics", pp.270~273 (2009)
- Ho Sun Shon, "Feature Selection Method using WF-LASSO for Gene Expression Data analysis", pp.522~525 (2011), ACM-BCM
- Jon Atli Benediktsson, "Ensemble Methods for Classification of Hyperspectral Data", pp.62~65 (2008), IEEE
- Dymitr Ruta, "Classifier selection for majority voting", Information fusion, 6, pp.63~81 (2005)
- Guangrong Li, "A Novel Unsupervised feature Selection Method for Bioinformatics Data Sets through Feature Clustering", pp.41~47 (2008), IEEE
- Lior Rokach, "A Methodology for Improving the Performance of Non-ranker Feature Selection Filters", International Journal Pattern Recognition and Artificial Intelligence, pp.1~20 (2007)