Congestion Predictive Modelling on Network Dataset Using Ensemble Deep Learning

Purnawansyah Purnawansyah, Aji Prasetya Wibawa, Triyanna Widiyaningtyas, Haviluddin Haviluddin, Roesman Ridwan Raja, Herdianti Darwis, Andrew Nafalski

Abstract


Network congestion arises from factors like bandwidth misallocation and increased node density leading to issues such as reduced packet delivery ratios and energy efficiency, increased packet loss and delay, and diminished Quality of Service and Quality of Experience. This study highlights the potential of deep learning and ensemble learning for network congestion analysis, which has been less explored compared to packet-loss based, delay-based, hybrid-based, and machine learning approaches, offering opportunities for advancement through parameter tuning, data labeling, architecture simulation, and activation function experiments, despite challenges posed by the scarcity of labeled data due to the high costs, time, computational resources, and human effort required for labeling. In this paper, we investigate network congestion prediction using deep learning and observe the results individually, as well as analyze ensemble learning outcomes using majority voting, from data that we recorded and clustered using K-Means. We leverage deep learning models including BPNN, CNN, LSTM, and hybrid LSTM-CNN architectures on 12 scenarios formed out of the combination of level datasets, normalization techniques, and number of recommended clusters and the results reveal that ensemble methods, particularly those integrating LSTM and CNN models (LSTM-CNN), consistently outperform individual deep learning models, demonstrating higher accuracy and stability across diverse datasets. Besides that, it is preferably recommended to use the QoS level dataset and the combinations of 3 clusters due to the most consistent evaluation results across different configurations and normalization strategies. The ensemble learning evaluation results show consistently high performance across various metrics, with accuracy, Matthews Correlation Coefficient, and Cohen's Kappa values nearing 100%, indicates excellent predictive capability and agreement. Hamming Loss remains minimal highlighting the low misclassification rates. Notably, this study advances predictive modeling in network management, offering strategies to enhance network efficiency and reliability amidst escalating traffic demands for more sustainable network operations.

Keywords


Network Congestion; K-Means Clustering; Deep Learning; Ensemble Learning; Evaluation

Full Text:

PDF

References


L. Zhu, B. Li, and H. Zhang, “ARP spoofing forensics based on network data flow,” in Third International Conference on Computer Communication and Network Security (CCNS 2022), Oct. 2022, p. 33, doi: 10.1117/12.2659380.

L. Chettri and R. Bera, “A Comprehensive Survey on Internet of Things (IoT) Toward 5G Wireless Systems,” IEEE Internet Things J., vol. 7, no. 1, pp. 16–32, Jan. 2020, doi: 10.1109/JIOT.2019.2948888.

A. Narayanan et al., “A variegated look at 5G in the wild,” in Proceedings of the 2021 ACM SIGCOMM 2021 Conference, Aug. 2021, pp. 610–625, doi: 10.1145/3452296.3472923.

A. R. Md Jamil and N. Nower, “A Comprehensive Analysis of Reward Function for Adaptive Traffic Signal Control,” Knowl. Eng. Data Sci., vol. 4, no. 2, p. 85, Dec. 2021, doi: 10.17977/um018v4i22021p85-96.

R. M. Baazeem, “Cybersecurity: BotNet Threat Detection Across the Seven-Layer ISO-OSI Model Using Machine Learning Techniques,” Comput. Informatics, vol. 42, no. 5, pp. 1060–1090, 2023, doi: 10.31577/cai_2023_5_1060.

R. Swami, M. Dave, and V. Ranga, “Detection and Analysis of TCP-SYN DDoS Attack in Software-Defined Networking,” Wirel. Pers. Commun., vol. 118, no. 4, pp. 2295–2317, Jun. 2021, doi: 10.1007/s11277-021-08127-6.

X. Chen, X. Chen, Y. Huang, J. Lin, Y. Wu, and Y. Chen, “TCP1 increases drug resistance in acute myeloid leukemia by suppressing autophagy via activating AKT/mTOR signaling,” Cell Death Dis., vol. 12, no. 11, p. 1058, Nov. 2021, doi: 10.1038/s41419-021-04336-w.

L. Wang, J. Wang, Z. Liu, J. Zhu, and F. Qin, “Evaluation of a deep-learning model for multispectral remote sensing of land use and crop classification,” Crop J., vol. 10, no. 5, pp. 1435–1451, Oct. 2022, doi: 10.1016/j.cj.2022.01.009.

A. Munandar, W. Maulana Baihaqi, and A. Nurhopipah, “A Soft Voting Ensemble Classifier to Improve Survival Rate Predictions of Cardiovascular Heart Failure Patients,” Ilk. J. Ilm., vol. 15, no. 2, pp. 344–352, Aug. 2023, doi: 10.33096/ilkom.v15i2.1632.344-352.

S. Y. Prasetyo, G. Z. Nabiilah, Z. N. Izdihar, and S. M. Isa, “Pneumonia Detection on X-Ray Imaging using Softmax Output in Multilevel Meta Ensemble Algorithm of Deep Convolutional Neural Network Transfer Learning Models,” Int. J. Adv. Intell. Informatics, vol. 9, no. 2, p. 319, Jul. 2023, doi: 10.26555/ijain.v9i2.884.

K. Trang and A. H. Nguyen, “A Comparative Study of Machine Learning-based Approach for Network Traffic Classification,” Knowl. Eng. Data Sci., vol. 4, no. 2, p. 128, Jan. 2022, doi: 10.17977/um018v4i22021p128-137.

A. P. Wibawa, “Mean-Median Smoothing Backpropagation Neural Network to Forecast Unique Visitors Time Series of Electronic Journal,” J. Appl. Data Sci., vol. 4, no. 3, pp. 163–174, Sep. 2023, doi: 10.47738/jads.v4i3.97.

A. Krishnaswamy Rangarajan and H. K. Ramachandran, “A fused lightweight CNN model for the diagnosis of COVID-19 using CT scan images,” Automatika, vol. 63, no. 1, pp. 171–184, Jan. 2022, doi: 10.1080/00051144.2021.2014037.

A. W. Saputra, A. P. Wibawa, U. Pujianto, A. B. Putra Utama, and A. Nafalski, “LSTM-based Multivariate Time-Series Analysis: A Case of Journal Visitors Forecasting,” Ilk. J. Ilm., vol. 14, no. 1, pp. 57–62, Apr. 2022, doi: 10.33096/ilkom.v14i1.1106.57-62.

H. Hanafi, A. Pranolo, Y. Mao, T. Hariguna, L. Hernandez, and N. F. Kurniawan, “IDSX-Attention: Intrusion detection system (IDS) based hybrid MADE-SDAE and LSTM-Attention mechanism,” Int. J. Adv. Intell. Informatics, vol. 9, no. 1, p. 121, Mar. 2023, doi: 10.26555/ijain.v9i1.942.

A. Halbouni, T. S. Gunawan, M. H. Habaebi, M. Halbouni, M. Kartiwi, and R. Ahmad, “CNN-LSTM: Hybrid Deep Neural Network for Network Intrusion Detection System,” IEEE Access, vol. 10, pp. 99837–99849, 2022, doi: 10.1109/ACCESS.2022.3206425.

A. S. Sams and A. Zahra, “Multimodal music emotion recognition in Indonesian songs based on CNN-LSTM, XLNet transformers,” Bull. Electr. Eng. Informatics, vol. 12, no. 1, pp. 355–364, Feb. 2023, doi: 10.11591/eei.v12i1.4231.

G. S. Nijaguna, J. A. Babu, B. D. Parameshachari, R. P. de Prado, and J. Frnda, “Quantum Fruit Fly algorithm and ResNet50-VGG16 for medical diagnosis,” Appl. Soft Comput., vol. 136, p. 110055, Mar. 2023, doi: 10.1016/j.asoc.2023.110055.

K. Dashdondov, S.-M. Lee, and M.-H. Kim, “OrdinalEncoder and PCA based NB Classification for Leaked Natural Gas Prediction Using IoT based Remote Monitoring System,” 2021, pp. 252–259.

I. M. A. P. J.D et al., “Video Streaming QoS Analysis with TIPHON Standard NDNts,” in 2023 9th International Conference on Wireless and Telematics (ICWT), Jul. 2023, pp. 1–4, doi: 10.1109/ICWT58823.2023.10335399.

S. Özarpacı, B. Kılıç, O. C. Bayrak, A. Özdemir, Y. Yılmaz, and M. Floyd, “Comparative analysis of the optimum cluster number determination algorithms in clustering GPS velocities,” Geophys. J. Int., vol. 232, no. 1, pp. 70–80, Sep. 2022, doi: 10.1093/gji/ggac326.

A. Shokouhmand and N. Tavassolian, “Fetal Electrocardiogram Extraction Using Dual-Path Source Separation of Single-Channel Non-Invasive Abdominal Recordings,” IEEE Trans. Biomed. Eng., vol. 70, no. 1, pp. 283–295, Jan. 2023, doi: 10.1109/TBME.2022.3189617.

R. Herdianto, P. Setyosari, D. Kuswandi, A. P. Wibawa, A. Nafalski, and I. M. P. Pradana, “Indonesian education: A future promise,” Int. J. Educ. Learn., vol. 4, no. 3, pp. 202–213, Dec. 2022, doi: 10.31763/ijele.v4i3.733.

T. Yan, S.-L. Shen, and A. Zhou, “Identification of geological characteristics from construction parameters during shield tunnelling,” Acta Geotech., vol. 18, no. 1, pp. 535–551, Jan. 2023, doi: 10.1007/s11440-022-01590-w.

L. Gotsev et al., “Cluster analysis and ensemble transfer learning for COVID-19 classification from computed tomography scans,” Int. J. Adv. Intell. Informatics, vol. 8, no. 2, 2022.

T. Widiyaningtyas, I. Hidayah, and T. B. Adji, “Recommendation Algorithm Using Clustering-Based UPCSim (CB-UPCSim),” Computers, vol. 10, no. 10, p. 123, Oct. 2021, doi: 10.3390/computers10100123.

S. R. Jabir, Purnawansyah, H. Darwis, H. Lahuddin, A. Faradibah, and A. W. M. Gaffar, “Evaluation of Tourism Object Rating Using Naïve Bayes, Support Vector Machine, and K-Means for Business Intelligence Application in Indonesia Tourism,” in 2024 18th International Conference on Ubiquitous Information Management and Communication (IMCOM), Jan. 2024, pp. 1–8, doi: 10.1109/IMCOM60618.2024.10418390.

D. F. Laistulloh, A. N. Handayani, R. A. Asmara, and P. Taw, “Convolutional Neural Network in Motion Detection for Physiotherapy Exercise Movement,” Knowl. Eng. Data Sci., vol. 7, no. 1, p. 27, May 2024, doi: 10.17977/um018v7i12024p27-39.

A. Pranolo et al., “Exploring LSTM-based Attention Mechanisms with PSO and Grid Search under Different Normalization Techniques for Energy demands Time Series Forecasting,” Knowl. Eng. Data Sci., vol. 7, no. 1, p. 1, Apr. 2024, doi: 10.17977/um018v7i12024p1-12.

Y. I. Sulistya, E. T. Br Bangun, and D. A. Tyas, “CNN Ensemble Learning Method for Transfer learning: A Review,” Ilk. J. Ilm., vol. 15, no. 1, pp. 45–63, Apr. 2023, doi: 10.33096/ilkom.v15i1.1541.45-63.

L. Menshawy, A. H. Eid, and R. F. Abdel-Kader, “Ensemble deep models for covid-19 pandemic classification using chest x-ray images via different fusion techniques,” Int. J. Adv. Intell. Informatics, vol. 9, no. 1, p. 51, Mar. 2023, doi: 10.26555/ijain.v9i1.922.

W. Wang, Y. Pei, S.-H. Wang, J. manuel Gorrz, and Y.-D. Zhang, “PSTCNN: Explainable COVID-19 diagnosis using PSO-guided self-tuning CNN,” Biocell Off. J. Soc. Latinoam. Microsc. Electron. et. al, vol. 47, no. 2, p. 373, 2023.

D. Chicco, M. J. Warrens, and G. Jurman, “The Matthews Correlation Coefficient (MCC) is More Informative Than Cohen’s Kappa and Brier Score in Binary Classification Assessment,” IEEE Access, vol. 9, pp. 78368–78381, 2021, doi: 10.1109/ACCESS.2021.3084050.

T. M. Usman, Y. K. Saheed, D. Ignace, and A. Nsang, “Diabetic retinopathy detection using principal component analysis multi-label feature extraction and classification,” Int. J. Cogn. Comput. Eng., vol. 4, pp. 78–88, Jun. 2023, doi: 10.1016/j.ijcce.2023.02.002.




DOI: https://doi.org/10.47738/jads.v5i4.333

Refbacks

  • There are currently no refbacks.



Barcode

Journal of Applied Data Sciences

ISSN:2723-6471 (Online)
Publisher:Bright Publisher
Website:http://bright-journal.org/JADS
Email:taqwa@amikompurwokerto.ac.id (principal contact)
  support@bright-journal.org (technical issues)

This work is licensed under a Creative Commons Attribution-ShareAlike 4.0