ECBFMBP: Design of an Ensemble deep learning Classifier with Bio-inspired Feature Selection for high-efficiency Multidomain Bug Prediction
1
조회
0
다운로드
0
인용
0
참고문헌
키워드
초록
Prediction of software bugs from process logs, temporal access logs, behavior analysis, etc. requires estimation of a wide variety of high-density feature sets. Extracted feature sets must be able to classify these logs into different bug categories with high accuracy, and low complexity. To perform these tasks, a wide variety of Machine Learning Models (MLMs) are proposed by researchers, and each of them varies in terms of their performance-level nuances, functional advantages, contextual limitations, and application-specific future scopes. Upon analyzing these characteristics, it was observed that existing models are highly context-specific, and cannot be applied to multidomain bug analysis datasets. Moreover, existing models do not incorporate a dynamic feature selection method, which limits their accuracy performance under multiple bug classification applications. To overcome these issues, this paper proposes design of a novel Ensemble deep learning Classifier with Feature Selection for high-efficiency Multidomain Bug Prediction under different use cases. The proposed model improves bug representation performance by combining multiple feature extraction methods, including GWO-based novel feature selection techniques. The ensemble classification model, which combines Deep Random Forest, k Nearest Neighbor, Logistic Regression, Multilayer Perceptron, Support Vector Machine, and 1D Convolutional Neural Network classifiers, achieves higher accuracy, precision, recall, and low delay compared to existing models. The model also shows faster classification speeds than existing models and can be deployed for various real-time applications. This accuracy performance was compared with various state-of-the-art models, and it was observed that the proposed model showcases 4.5% higher accuracy, 3.2% better precision, 3.9% higher recall, and 5.5% faster classification performance, which was possible due to integration of intelligent feature selection process with high efficiency classification models under multidomain scenarios.
Abstract
Prediction of software bugs from process logs, temporal access logs, behavior analysis, etc. requires estimation of a wide variety of high-density feature sets. Extracted feature sets must be able to classify these logs into different bug categories with high accuracy, and low complexity. To perform these tasks, a wide variety of Machine Learning Models (MLMs) are proposed by researchers, and each of them varies in terms of their performance-level nuances, functional advantages, contextual limitations, and application-specific future scopes. Upon analyzing these characteristics, it was observed that existing models are highly context-specific, and cannot be applied to multidomain bug analysis datasets. Moreover, existing models do not incorporate a dynamic feature selection method, which limits their accuracy performance under multiple bug classification applications. To overcome these issues, this paper proposes design of a novel Ensemble deep learning Classifier with Feature Selection for high-efficiency Multidomain Bug Prediction under different use cases. The proposed model improves bug representation performance by combining multiple feature extraction methods, including GWO-based novel feature selection techniques. The ensemble classification model, which combines Deep Random Forest, k Nearest Neighbor, Logistic Regression, Multilayer Perceptron, Support Vector Machine, and 1D Convolutional Neural Network classifiers, achieves higher accuracy, precision, recall, and low delay compared to existing models. The model also shows faster classification speeds than existing models and can be deployed for various real-time applications. This accuracy performance was compared with various state-of-the-art models, and it was observed that the proposed model showcases 4.5% higher accuracy, 3.2% better precision, 3.9% higher recall, and 5.5% faster classification performance, which was possible due to integration of intelligent feature selection process with high efficiency classification models under multidomain scenarios.
참고문헌 (29)
- Ahmed, H. A., "Capbug-a framework for automatic bug categorization and prioritization using nlp and machine learning algorithms", IEEE Access, 9, pp.50496~50512 (2021)
- Ai, J., "What ruined your cake : impacts of code modifications on bug distribution", IEEE Access, 8, pp.84020~84036 (2020)
- Bao, L., "A large scale study of long-time contributor prediction for GitHub projects", IEEE Transactions on Software Engineering, 47(6), pp.1277~1298 (2019)
- Chen, J., "Coverage prediction for accelerating compiler testing", IEEE Transactions on Software Engineering, 47(2), pp.261~278 (2018)
- Chouhan, S. S., "Generative adversarial networksbased imbalance learning in software aging-related bug prediction", IEEE Transactions on Reliability, 70(2), pp.626~642 (2021)
- Fan, Y., "The impact of mislabeled changes by szz on just-in-time defect prediction", IEEE transactions on software engineering, 47(8), pp.1559~1586 (2019)
- Fang, S., "Effective prediction of bugfixing priority via weighted graph convolutional networks", IEEE Transactions on Reliability, 70(2), pp.563~574 (2021)
- Gong, L., "Conditional domain adversarial adaptation for heterogeneous defect prediction", IEEE Access, 8, pp.150738~150749 (2020)
- Iqbal, S., "Determining bug prioritization using feature reduction and clustering with classification", IEEE Access, 8, pp.215661~215678 (2020)
- Khan, F., "Hyper-parameter optimization of classifiers, using an artificial immune network and its application to software bug prediction", IEEE Access, 8, pp.20954~20964 (2020)
- Kumar, H., "Software Fault Prediction using Wrapper based Feature Selection Approach employing Genetic Algorithm", 2022OPJU International Technology Conference on Emerging Technologies for Sustainable Development (OTCON), pp.1~7 (2023), IEEE
- Lee, S. Y., "Software fault-proneness analysis based on composite developer-module networks", IEEE Access, 9, pp.155314~155334 (2021)
- Lee, Y., "Continual prediction of bug-fix time using deep learning-based activity stream embedding", IEEE Access, 8, pp.10503~10515 (2020)
- Li, Y., "V-fuzz : Vulnerability prediction-assisted evolutionary fuzzing for binary programs", IEEE Transactions on Cybernetics, 52(5), pp.3745~3756 (2020)
- Li, Z., "Cross-project defect prediction via landmark selection-based kernelized discriminant subspace alignment", IEEE Transactions on Reliability, 70(3), pp.996~1013 (2021)
- Lin, J., "Semantic feature learning via dual sequences for defect prediction", IEEE Access, 9, pp.13112~13124 (2021)
- Mehmood, I., "A Novel Approach to Improve Software Defect Prediction Accuracy Using Machine Learning" (2023), IEEE Access
- Miholca, D. L., "An in-Depth Analysis of the Software Features’ Impact on the Performance of Deep Learning-Based Software Defect Predictors", IEEE Access, 10, pp.64801~64818 (2022)
- Qu, Y., "Using k-core decomposition on class dependency networks to improve bug prediction model's practical performance", IEEE Transactions on Software Engineering, 47(2), pp.348~366 (2019)
- Rodriguez-Perez, G., "Watch out for extrinsic bugs! A case study of their impact in just-in-time bug prediction models on the openstack project", IEEE Transactions on Software Engineering, 48(4), pp.1400~1416 (2020)
- Tu, H., "Better data labelling with emblem(and how that impacts defect prediction)", IEEE Transactions on Software Engineering, 48(1), pp.278~294 (2020)
- Wang, A., "Heterogeneous Defect Prediction Based on Federated Prototype Learning" (2023), IEEE Access
- Wang, S., "Deep semantic feature learning for software defect prediction", IEEE Transactions on Software Engineering, 46(12), pp.1267~1293 (2018)
- Wen, M., "How well do change sequences predict defects? Sequence learning from software changes", IEEE Transactions on Software Engineering, 46(11), pp.1155~1175 (2018)
- Xie, X., "MULA : A just-intime multi-labeling system for issue reports", IEEE Transactions on Reliability, 71(1), pp.250~263 (2021)
- Xu, J., "Defect prediction with semantics and context features of codes based on graph representation learning", IEEE Transactions on Reliability, 70(2), pp.613~625 (2020)
- Xu, Z., "Effortaware just-in-time bug prediction for mobile apps via cross-triplet deep feature embedding", IEEE Transactions on Reliability, 71(1), pp.204~220 (2021)
- Yang, S., "Software Bug Number Prediction Based on Complex Network Theory and Panel Data Model", IEEE Transactions on Reliability, 71(1), pp.162~177 (2022)
- Zhang, S., "A novel ultrathin elevated channel low-temperature poly-Si TFT", IEEE Electron Device Letters, 20(11), pp.569~571 (1999)