Machine Learning Models for Predicting Flood Events Using Weather Data: An Evaluation of Logistic Regression, LightGBM, and XGBoost

Maharina Maharina, Tukino Paryono, Ahmad Fauzi, Jamaludin Indra, Sihabudin Sihabudin, Muhammad Khoiruddin Harahap, Lutfi Trisandi Rizki

Abstract


This study examines flood prediction in Jakarta, Indonesia, a pressing concern due to its significant implications for public safety and urban management. Machine Learning (ML) presents promising methodologies for accurately forecasting floods by leveraging weather data. However, flood prediction in Jakarta remains challenging due to the city’s highly variable weather patterns, including fluctuations in rainfall, humidity, temperature, and wind characteristics. Existing methods often struggle with these complexities, as they rely on traditional ML models such as K-Nearest Neighbors (KNN), which may not capture certain patterns or provide high accuracy and robustness. Therefore, this study proposes three ML methods—Logistic Regression (LR), LightGBM, and XGBoost—to predict floods accurately. Five performance metrics (i.e., accuracy, area under the curve (AUC), precision, recall, and F1-score) were used to measure and compare the accuracy of the algorithms. The proposed method consists of three main processes. The first process involves data preprocessing and evaluation using 14 different ML models. In the second process, additional feature engineering is applied to improve the quality of the data. Finally, the third process combines the previous steps with oversampling techniques and cross-validation methods. This structured approach aims to enhance the overall performance of the analysis. The experimental results show that Process 3 significantly improves performance compared to Processes 1 and 2. The model predicts floods with an accuracy score of 93.82% for LR, 96.67% for XGBoost, and 96.81% for LightGBM, respectively. Thus, the proposed model offers a solution for operational decision-making in flood risk management, including flood mitigation planning.

Keywords


Flood Prediction; Machine Learning; Logistic Regression; XGBoost; LighGBM

Full Text:

PDF

References


M. Ma et al., “XGBoost-based method for flash flood risk assessment,” Journal of Hydrology, vol. 598, p. 126382, Jul. 2021, doi: 10.1016/j.jhydrol.2021.126382.

P. J. Ward et al., “The need to integrate flood and drought disaster risk reduction strategies,” Water Security, vol. 11, p. 100070, Dec. 2020, doi: 10.1016/j.wasec.2020.100070.

A. Fekete, “Critical infrastructure and flood resilience: Cascading effects beyond water,” WIREs Water, vol. 6, no. 5, p. e1370, Sep. 2019, doi: 10.1002/wat2.1370.

M. Motta, M. De Castro Neto, and P. Sarmento, “A mixed approach for urban flood prediction using Machine Learning and GIS,” International Journal of Disaster Risk Reduction, vol. 56, p. 102154, Apr. 2021, doi: 10.1016/j.ijdrr.2021.102154.

M. Jehanzaib, M. Ajmal, M. Achite, and T.-W. Kim, “Comprehensive Review: Advancements in Rainfall-Runoff Modelling for Flood Mitigation,” Climate, vol. 10, no. 10, p. 147, Oct. 2022, doi: 10.3390/cli10100147.

I. Johnston, W. Murphy, and J. Holden, “A review of floodwater impacts on the stability of transportation embankments,” Earth-Science Reviews, vol. 215, p. 103553, Apr. 2021, doi: 10.1016/j.earscirev.2021.103553.

S. Zhong et al., “The long-term physical and psychological health impacts of flooding: A systematic mapping,” Science of The Total Environment, vol. 626, pp. 165–194, Jun. 2018, doi: 10.1016/j.scitotenv.2018.01.041.

M. S. G. Adnan et al., “A novel framework for addressing uncertainties in machine learning-based geospatial approaches for flood prediction,” Journal of Environmental Management, vol. 326, p. 116813, Jan. 2023, doi: 10.1016/j.jenvman.2022.116813.

H. Mojaddadi, B. Pradhan, H. Nampak, N. Ahmad, and A. H. B. Ghazali, “Ensemble machine-learning-based geospatial approach for flood risk assessment using multi-sensor remote-sensing data and GIS,” Geomatics, Natural Hazards and Risk, vol. 8, no. 2, pp. 1080–1102, Dec. 2017, doi: 10.1080/19475705.2017.1294113.

T. Xie, C. Hu, C. Liu, W. Li, C. Niu, and R. Li, “Study on long short-term memory based on vector direction of flood process for flood forecasting,” Sci Rep, vol. 14, no. 1, p. 21446, Sep. 2024, doi: 10.1038/s41598-024-72205-5.

S. Sankaranarayanan, M. Prabhakar, S. Satish, P. Jain, A. Ramprasad, and A. Krishnan, “Flood prediction based on weather parameters using deep learning,” Journal of Water and Climate Change, vol. 11, no. 4, pp. 1766–1783, Dec. 2020, doi: 10.2166/wcc.2019.321.

N. Gauhar, S. Das, and K. S. Moury, “Prediction of Flood in Bangladesh using k-Nearest Neighbors Algorithm,” in 2021 2nd International Conference on Robotics, Electrical and Signal Processing Techniques (ICREST), DHAKA, Bangladesh: IEEE, Jan. 2021, pp. 357–361. doi: 10.1109/ICREST51555.2021.9331199.

Z. Fang, Y. Wang, L. Peng, and H. Hong, “Predicting flood susceptibility using LSTM neural networks,” Journal of Hydrology, vol. 594, p. 125734, Mar. 2021, doi: 10.1016/j.jhydrol.2020.125734.

E. H. Ighile, H. Shirakawa, and H. Tanikawa, “Application of GIS and Machine Learning to Predict Flood Areas in Nigeria,” Sustainability, vol. 14, no. 9, p. 5039, Apr. 2022, doi: 10.3390/su14095039.

F. Grady, J. K. Tarigan, J. R. Wahidiyat, and A. Prasetyo, “Classification of Flood Alert in Jakarta with Random Forest,” in 2022 IEEE 7th International Conference on Information Technology and Digital Applications (ICITDA), Yogyakarta, Indonesia: IEEE, Nov. 2022, pp. 1–6. doi: 10.1109/ICITDA55840.2022.9971411.

S. Hadi, D. Fitrianah, V. Ayumi, and S. Mooi Lim, “The Data Analysis of Determining Potential Flood-Prone Areas in DKI Jakarta Using Classification Model Approach,” ijaste, vol. 1, no. 1, pp. 313–323, Feb. 2023, doi: 10.24912/ijaste.v1.i1.313-323.

D. Anjireddy and J. K, “Performance Comparison of Flood Prediction Using Recurrent Time Delay Neural Network and K-Nearest Neighbor Algorithm,” in 2024 Ninth International Conference on Science Technology Engineering and Mathematics (ICONSTEM), Chennai, India: IEEE, Apr. 2024, pp. 1–5. doi: 10.1109/ICONSTEM60960.2024.10568880.

D. Rolon-Mérette, M. Ross, T. Rolon-Mérette, and K. Church, “Introduction to Anaconda and Python: Installation and setup,” TQMP, vol. 16, no. 5, pp. S3–S11, May 2020, doi: 10.20982/tqmp.16.5.S003.

J. Bernard, “Python Data Analysis with pandas,” in Python Recipes Handbook: A Problem-Solution Approach, J. Bernard, Ed., Berkeley, CA: Apress, 2016, pp. 37–48. doi: 10.1007/978-1-4842-0241-8_5.

O. Kramer, “Scikit-Learn,” in Machine Learning for Evolution Strategies, O. Kramer, Ed., Cham: Springer International Publishing, 2016, pp. 45–53. doi: 10.1007/978-3-319-33383-0_5.

E. Bisong, “Matplotlib and Seaborn,” in Building Machine Learning and Deep Learning Models on Google Cloud Platform: A Comprehensive Guide for Beginners, E. Bisong, Ed., Berkeley, CA: Apress, 2019, pp. 151–165. doi: 10.1007/978-1-4842-4470-8_12.

Gadzz, “Climate and Flood Jakarta 2016 -2020,” Indonesia flood and climate dataset since 2016 until 2020. Accessed: Jan. 21, 2024. [Online]. Available: https://www.kaggle.com/datasets/christopherrichardc/climate-and-flood-jakarta/data

M. F. Uddin, J. Lee, S. Rizvi, and S. Hamada, “Proposing Enhanced Feature Engineering and a Selection Model for Machine Learning Processes,” Applied Sciences, vol. 8, no. 4, p. 646, Apr. 2018, doi: 10.3390/app8040646.

A. Bailly et al., “Effects of dataset size and interactions on the prediction performance of logistic regression and deep learning models,” Computer Methods and Programs in Biomedicine, vol. 213, p. 106504, Jan. 2022, doi: 10.1016/j.cmpb.2021.106504.

T. Chen and C. Guestrin, “XGBoost: A Scalable Tree Boosting System,” in Proceedings of the 22nd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, San Francisco California USA: ACM, Aug. 2016, pp. 785–794. doi: 10.1145/2939672.2939785.

G. V. D. Kumar, V. Deepa, N. Vineela, and G. Emmanuel, “Detection of Parkinson’s disease using LightGBM Classifier,” in 2022 6th International Conference on Computing Methodologies and Communication (ICCMC), Erode, India: IEEE, Mar. 2022, pp. 1292–1297. doi: 10.1109/ICCMC53470.2022.9753909.




DOI: https://doi.org/10.47738/jads.v6i1.503

Refbacks

  • There are currently no refbacks.



Barcode

Journal of Applied Data Sciences

ISSN:2723-6471 (Online)
Publisher:Bright Publisher
Website:http://bright-journal.org/JADS
Email:taqwa@amikompurwokerto.ac.id (principal contact)
  support@bright-journal.org (technical issues)

This work is licensed under a Creative Commons Attribution-ShareAlike 4.0