EXAMINING THE IMPACT OF FEATURE SELECTION TECHNIQUES ON MACHINE AND DEEP LEARNING MODELS FOR THE PREDICTION OF COVID 19

Authors

• Hafiza Zoya Mojahid, College of Computing, Informatics and Mathematics, University Teknologi MARA, 40450 Shah Alam, Selangor, MalaysiaFollow
• Jasni Mohamad Zain, College of Computing, Informatics and Mathematics, University Teknologi MARA, 40450 Shah Alam, Selangor, Malaysia Institute for Big Data Analytics and Artificial Intelligence(IBDAAI), Kompleks Al-Khawarizmi, Universiti Teknologi MARA, 40450 Shah Alam, Selangor, MalaysiaFollow
• Marina Yusoff, College of Computing, Informatics and Mathematics, University Teknologi MARA, 40450 Shah Alam, Selangor, Malaysia Institute for Big Data Analytics and Artificial Intelligence(IBDAAI), Kompleks Al-Khawarizmi, Universiti Teknologi MARA, 40450 Shah Alam, Selangor, MalaysiaFollow
• Abdul Basit, College of Computing, Informatics and Mathematics, University Teknologi MARA, 40450 Shah Alam, Selangor, MalaysiaFollow
• Abdul Kadir Jumaat, College of Computing, Informatics and Mathematics, University Teknologi MARA, 40450 Shah Alam, Selangor, Malaysia Institute for Big Data Analytics and Artificial Intelligence(IBDAAI), Kompleks Al-Khawarizmi, Universiti Teknologi MARA, 40450 Shah Alam, Selangor, MalaysiaFollow
• Mushtaq Ali, Riphah International University, 7th Avenue, Sector G- 7/4, 44000 Islamabad, PakistanFollow

Abstract

Feature selection is a vital preprocessing step for identifying the most informative features in complex datasets, enhancing the efficiency and accuracy of machine learning models. Its applications extend across various domains, including big data analytics, finance, chemometrics, medical diagnostics, biological research, intrusion detection systems, and renewable energy solutions. In medical contexts, feature selection serves a dual purpose: it reduces dimensionality while simultaneously improving the comprehension of disease etiology. This study delves into key variable selection methods—specifically Recursive Feature Elimination (RFE), Principal Component Analysis (PCA) and Least Absolute Shrinkage and Selection Operator (LASSO). We evaluate the interaction of these methods with Support Vector Machines (SVM), Logistic Regression (LR), and eXtreme Gradient Boosting (XGBoost) for COVID-19 prediction. Key performance metrics, including F1-score, precision, recall, and accuracy. LASSO with SVM performed the best overall in terms of accuracy = 0.7679 and precision=0.8236, but PCA outperformed RFE with XGBoost, underscoring the importance of matching feature selection methods to model types. In addition, we employ a deep learning Feature Selection method based on Extreme Learning Machine (FSELM) and compare its effectiveness against the established feature selection techniques. Our work reveals that Lactate Dehydrogenase (LDH) is the most relevant feature while predicting COVID-19. This research aims to provide insights into the optimal integration of feature selection techniques with advanced machine learning models for accurate prediction of COVID-19 virus.

Digital Object Identifier (DOI)

10.24191/mjoc.v10i1.4475

Publication Date

4-1-2025

Volume

10

Issue

1

Recommended Citation

Mojahid, Hafiza Zoya; Mohamad Zain, Jasni; Yusoff, Marina; Basit, Abdul; Jumaat, Abdul Kadir; and Ali, Mushtaq (2025) "EXAMINING THE IMPACT OF FEATURE SELECTION TECHNIQUES ON MACHINE AND DEEP LEARNING MODELS FOR THE PREDICTION OF COVID 19," Malaysian Journal of Computing (MJoC): Vol. 10: Iss. 1, Article 12.

Available at: https://mjoc.researchcommons.org/journal/vol10/iss1/12