Spam Feature Selection Using Firefly Metaheuristic Algorithm

Mosleh M Abualhaj, Mohammad O Hiari, Adeeb Alsaaidah, Mahran Al-Zyoud, Sumaya Al-Khatib

Abstract


This paper presents a novel method for improving spam detection by utilizing the Firefly Algorithm (FA) for feature selection. The FA, a bio-inspired metaheuristic optimization algorithm, is applied to identify the most relevant features from the ISCX-URL2016 dataset, which contains 72 features. By balancing exploration (searching for new solutions) and exploitation (focusing on the best solutions), FA is able to effectively reduce the feature space from 72 to 31 features. This reduction improves model efficiency without sacrificing performance, as only the most impactful features are retained for the classification task. The selected features were then used to train three machine learning classifiers: Decision Tree (DT), Gradient Boost Tree (GBT), and Naive Bayes (NB). Each classifier's performance was evaluated based on accuracy, with DT achieving the highest accuracy of 99.81%, GBT achieving 99.70%, and NB scoring 90.33%. The superior performance of the DT algorithm is attributed to its ability to handle non-linear relationships and high-dimensional data, making it particularly well-suited for the FA-selected features. This combination of FA for feature selection and DT for classification demonstrates significant improvements in spam detection performance, highlighting the importance of selecting the most relevant features. The results show that by reducing the dimensionality of the dataset, the FA algorithm not only accelerates the classification process but also enhances detection accuracy.

Keywords


Spam; Machine learning; feature selection; Firefly algorithm.

Full Text:

PDF

References


J. Wei, X. Chen, J. Wang, X. Hu and J. Ma, "Enabling (End-to-End) Encrypted Cloud Emails With Practical Forward Secrecy," in IEEE Transactions on Dependable and Secure Computing, vol. 19, no. 4, pp. 2318-2332, 1 July-Aug. 2022, doi: 10.1109/TDSC.2021.3055495.

L. Ceci, "Number of e-mails per day worldwide 2017-2026," Statista, Aug. 22, 2023. [Online]. Available: https://www.statista.com/statistics/456500/daily-number-of-e-mails-worldwide/. [Accessed: July 5, 2024].

M. Kolhar, F. Al-Turjman, A. Alameen and M. M. Abualhaj, "A Three Layered Decentralized IoT Biometric Architecture for City Lockdown During COVID-19 Outbreak," in IEEE Access, vol. 8, pp. 163608-163617, 2020, doi: 10.1109/ACCESS.2020.3021983.

G. Kambourakis, G. D. Gil and I. Sanchez, "What Email Servers Can Tell to Johnny: An Empirical Study of Provider-to-Provider Email Security," in IEEE Access, vol. 8, pp. 130066-130081, 2020, doi: 10.1109/ACCESS.2020.3009122.

A. Petrosyan, "Spam: share of global email traffic 2011-2023," Statista, Mar. 7, 2024. [Online]. Available: https://www.statista.com/statistics/420400/spam-email-traffic-share-annual/. [Accessed: July 5, 2024].

A. AlMahmoud, E. Damiani, H. Otrok and Y. Al-Hammadi, "Spamdoop: A Privacy-Preserving Big Data Platform for Collaborative Spam Detection," in IEEE Transactions on Big Data, vol. 5, no. 3, pp. 293-304, 1 Sept. 2019, doi: 10.1109/TBDATA.2017.2716409.

M. M. Abualhaj, Ahmad Adel Abu-Shareha, Qusai Shambour, Adeeb Alsaaidah, S. N. Al-Khatib, and M. Anbar, “Customized K-nearest neighbors’ algorithm for malware detection,” International journal of data and network science, vol. 8, no. 1, pp. 431–438, Jan. 2024, doi: https://doi.org/10.5267/j.ijdns.2023.9.012.

Al Saaidah, A., Abualhaj, M.M., Shambour, Q.Y. et al. Enhancing malware detection performance: leveraging K-Nearest Neighbors with Firefly Optimization Algorithm. Multimed Tools Appl (2024). https://doi.org/10.1007/s11042-024-18914-5.

K. Dev, P. K. R. Maddikunta, T. R. Gadekallu, S. Bhattacharya, P. Hegde and S. Singh, "Energy Optimization for Green Communication in IoT Using Harris Hawks Optimization," in IEEE Transactions on Green Communications and Networking, vol. 6, no. 2, pp. 685-694, June 2022, doi: 10.1109/TGCN.2022.3143991.

M. M. Abualhaj, Ahmad Adel Abu-Shareha, M. O. Hiari, Yousef Alrabanah, Mahran Al-Zyoud, and M. A. Alsharaiah, “A Paradigm for DoS Attack Disclosure using Machine Learning Techniques,” International Journal of Advanced Computer Science and Applications, vol. 13, no. 3, pp. 192-200, Jan. 2022, doi: https://doi.org/10.14569/ijacsa.2022.0130325.

H. Xu and B. Yu, “Automatic thesaurus construction for spam filtering using revised back propagation neural network,” Expert Syst. Appl., vol. 37, no. 1, pp. 18–23, Jan. 2010.

I. Idris, A. Selamat, and S. Omatu, “Hybrid email spam detection model with negative selection algorithm and differential evolution,” Eng. Appl. Artif. Intell., vol. 28, pp. 97–110, Feb. 2014.

I. Idris and A. Selamat, “Improved email spam detection model with negative selection algorithm and particle swarm optimization,” Appl. Soft Comput., vol. 22, pp. 11–27, 2014.

K. Debnath and N. Kar, "Email Spam Detection using Deep Learning Approach," 2022 International Conference on Machine Learning, Big Data, Cloud and Parallel Computing (COM-IT-CON), Faridabad, India, 2022, pp. 37-41, doi: 10.1109/COM-IT-CON54601.2022.9850588.

A. Wijaya and A. Bisri, "Hybrid decision tree and logistic regression classifier for email spam detection," 2016 8th International Conference on Information Technology and Electrical Engineering (ICITEE), Yogyakarta, Indonesia, 2016, pp. 1-4, doi: 10.1109/ICITEED.2016.7863267.

R. Aloufi and A. R. Alharbi, "K-means and Principal Components Analysis Approach For Clustering Malicious URLs," 2023 3rd International Conference on Computing and Information Technology (ICCIT), Tabuk, Saudi Arabia, 2023, pp. 359-364, doi: 10.1109/ICCIT58132.2023.10273923.

M. S. I. Mamun, M. A. Rathore, A. H. Lashkari, N. Stakhanova, and A. A. Ghorbani, "Detecting malicious urls using lexical analysis." In Network and System Security: 10th International Conference, NSS 2016, Taipei, Taiwan, September 28-30, 2016, Proceedings 10, pp. 467-482. Springer International Publishing, 2016. DOI: 10.1007/978-3-319-46298-1_30.

A. Hussein and Qusai Shambour, “A Trust-enhanced Recommender System for Patient-Doctor Matchmaking in Online Healthcare Communities,” International journal of intelligent engineering and systems, vol. 16, no. 6, pp. 684–694, Dec. 2023, doi: https://doi.org/10.22266/ijies2023.1231.57.

F. Liu et al., "Nonconvex Compressed Sensing by Nature-Inspired Optimization Algorithms," in IEEE Transactions on Cybernetics, vol. 45, no. 5, pp. 1042-1053, May 2015, doi: 10.1109/TCYB.2014.2343618.

K. Sharma and Rajesh Doriya, “Path planning for robots: an elucidating draft,” International journal of intelligent robotics and applications, vol. 4, no. 3, pp. 294–307, May 2020, doi: https://doi.org/10.1007/s41315-020-00129-0.

R. Turner, D. Eriksson, M. McCourt, J. Kiili, E. Laaksonen, Z. Xu, and I. Guyon, "Bayesian optimization is superior to random search for machine learning hyperparameter tuning: Analysis of the black-box optimization challenge 2020," in NeurIPS 2020 Competition and Demonstration Track, Aug. 2021, pp. 3-26, PMLR.

H. M. Al-Mimi, N. A. Hamad, M. M. Abualhaj, S. N. Al-Khatib, and M. O. Hiari, "Improved Intrusion Detection System to Alleviate Attacks on DNS Service," Journal of Computer Science, vol. 19, no. 12, pp. 1549-1560, Nov. 2023.

M. M. Abualhaj and S. N. Al-Khatib, “Using decision tree classifier to detect Trojan Horse based on memory data,” Telkomnika, vol. 22, no. 2, pp. 393–393, Apr. 2024, doi: https://doi.org/10.12928/telkomnika.v22i2.25753.

Monica and P. Agrawal, "A Survey on Hyperparameter Optimization of Machine Learning Models," 2024 2nd International Conference on Disruptive Technologies (ICDT), Greater Noida, India, 2024, pp. 11-15, doi: 10.1109/ICDT61202.2024.10489732.

H. Yi and K. -H. N. Bui, "An Automated Hyperparameter Search-Based Deep Learning Model for Highway Traffic Prediction," in IEEE Transactions on Intelligent Transportation Systems, vol. 22, no. 9, pp. 5486-5495, Sept. 2021, doi: 10.1109/TITS.2020.2987614.

Q. Y. Shambour, M. M. Al-Zyoud, A. H. Hussein, and Q. M. Kharma, “A doctor recommender system based on collaborative and content filtering,” International Journal of Electrical and Computer Engineering (IJECE), vol. 13, no. 1, p. 884, Feb. 2023, doi: https://doi.org/10.11591/ijece.v13i1.pp884-893.




DOI: https://doi.org/10.47738/jads.v5i4.336

Refbacks

  • There are currently no refbacks.



Barcode

Journal of Applied Data Sciences

ISSN:2723-6471 (Online)
Publisher:Bright Publisher
Website:http://bright-journal.org/JADS
Email:taqwa@amikompurwokerto.ac.id (principal contact)
  support@bright-journal.org (technical issues)

This work is licensed under a Creative Commons Attribution-ShareAlike 4.0