Improved binary differential evolution with dimensionality reduction mechanism and binary stochastic search for feature selection
Article
Ahadzadeh, Behrouz, Abdar, Moloud, Safara, Fatemeh, Aghaei, Leyla, Mirjalili, Seyedali, Khosravi, Abbas, García, Salvador, Karray, Fakhri and Acharya, U. Rajendra. 2024. "Improved binary differential evolution with dimensionality reduction mechanism and binary stochastic search for feature selection." Applied Soft Computing. 151. https://doi.org/10.1016/j.asoc.2023.111141
Article Title | Improved binary differential evolution with dimensionality reduction mechanism and binary stochastic search for feature selection |
---|---|
ERA Journal ID | 17759 |
Article Category | Article |
Authors | Ahadzadeh, Behrouz, Abdar, Moloud, Safara, Fatemeh, Aghaei, Leyla, Mirjalili, Seyedali, Khosravi, Abbas, García, Salvador, Karray, Fakhri and Acharya, U. Rajendra |
Journal Title | Applied Soft Computing |
Journal Citation | 151 |
Article Number | 111141 |
Number of Pages | 26 |
Year | 2024 |
Publisher | Elsevier |
Place of Publication | Netherlands |
ISSN | 1568-4946 |
1872-9681 | |
Digital Object Identifier (DOI) | https://doi.org/10.1016/j.asoc.2023.111141 |
Web Address (URL) | https://www.sciencedirect.com/science/article/pii/S1568494623011596 |
Abstract | Computer systems store massive amounts of data with numerous features, leading to the need to extract the most important features for better classification in a wide variety of applications. Poor performance of various machine learning algorithms may be caused by unimportant features that increase the time and memory required to build a classifier. Feature selection (FS) is one of the efficient approaches to reducing the unimportant features. This paper, therefore, presents a new FS, named BDE-BSS-DR, that utilizes Binary Differential Evolution (BDE), Binary Stochastic Search (BSS) algorithm, and Dimensionality Reduction (DR) mechanism. The BSS algorithm increases the search capability of the BDE by escaping from local optimal points and exploring the search space. The DR mechanism then reduces the dimensions of the search space gradually. As a result of using DR, the local optima of the search space and the problem of wrong removal of important features before starting the search process are reduced. The algorithm's efficiency is evaluated on 20 different medical datasets. The obtained outcomes indicate that the BDE-BSS-DR outperforms the BDE and BDE-BSS algorithms significantly. Furthermore, the effectiveness of the proposed algorithms in selecting the most important features of the heart disease data, several cancer diseases, and COVID-19 are also compared with several other state-of-the-art methods. Our results show that the BDE-BSS-DR with SVM classifier has a significant advantage over other methods with an average classification accuracy of 95.05% in heart disease and 99.40% in COVID-19 disease. In addition, the comparisons made with KNN and SVM classification prove the efficiency of the DR and BSS in generating a subset of optimal and informative features. |
Keywords | Binary stochastic search; Feature selection ; Evolutionary computation ; Differential evolution ; Dimensionality reduction ; Gene selection ; Optimization |
Contains Sensitive Content | Does not contain sensitive content |
ANZSRC Field of Research 2020 | 400306. Computational physiology |
Byline Affiliations | Islamic Azad University, Iran |
Deakin University | |
Torrens University | |
Obuda University, Hungary | |
University of Granada, Spain | |
University of Waterloo, Canada | |
Mohamed bin Zayed University of Artificial Intelligence, United Arab Emirates | |
School of Mathematics, Physics and Computing |
Permalink -
https://research.usq.edu.au/item/z5q7w/improved-binary-differential-evolution-with-dimensionality-reduction-mechanism-and-binary-stochastic-search-for-feature-selection
Download files
70
total views16
total downloads1
views this month0
downloads this month