Hybrid CNN Approach for Post-Disaster Building Damage Classification Using Satellite Imagery

Sahat Sonang, Y Yuhandri, Muhammad Tajuddin

Abstract


Accurate post-disaster building damage assessment is critical for timely response and effective reconstruction planning. This study proposes a hybrid deep learning architecture that integrates Inception-ResNet-v2 and EfficientNetV2B0, designed to enhance post-disaster damage classification from high-resolution satellite imagery. The model leverages dual-stream feature extraction, followed by concatenated fully connected layers optimized with dropout and batch normalization to improve generalization and reduce overfitting. The objective is to outperform standard Convolutional Neural Network (CNN) models in terms of classification and segmentation performance across multiple damage categories: no damage, minor damage, major damage, destroyed, and unclassified. The model was trained and validated on the publicly available xView dataset, covering over 12,000 annotated images from various natural disasters. Comparative evaluation against ResNet, GoogleNet, DenseNet, and EfficientNet demonstrates that the proposed model achieves the highest accuracy (86%), precision (85%), recall (86%), and F1-score (84%). Furthermore, it outperforms all baseline models in segmentation metrics, achieving an Intersection over Union (IoU) score of 0.7749 and a Dice Similarity Coefficient (DSC) of 0.8726. The model also significantly reduces misclassification rates in critical categories such as “major damage” and “destroyed.” A Wilcoxon signed-rank test confirmed that these improvements are statistically significant (p < 0.05) across all major performance indicators. The novelty of this study lies in the fusion of two state-of-the-art CNN backbones with tailored architectural modifications, yielding a robust and generalizable model suitable for automated disaster damage assessment. This research contributes a scalable deep learning approach that can be integrated into real-time or semi-automated disaster response systems, offering improved decision-making support in emergency contexts. The results affirm the model’s potential as a reliable tool in post-disaster scenarios and set a foundation for future work in multi-modal and real-time AI-based disaster management.


Keywords


Deep Learning; Disaster Damage Classification; CNN; Satellite Imagery; Building Damage Detection

Full Text:

PDF

References


N. Karaman Aksentijević, Z. Ježić, and P. A. Zaninović, “Automatic detection of earthquake‑induced ground failure efects through Faster R‑CNN deep learning‑based object detection using satellite images,” Economies, vol. 9, no. 3, 2021, doi: 10.3390/economies9030128.

N. Roztocki, P. Soja, and H. R. Weistroffer, “The role of information and communication technologies in socioeconomic development: towards a multi-dimensional framework*,” Information Technology for Development, vol. 25, no. 2, pp. 171–183, 2019, doi: 10.1080/02681102.2019.1596654.

N. Elfi Husda and Y. Wangdra, Pengantar Teknologi Informasi. 2022.

Y. Murayama, H. J. Scholl, and D. Velev, “Information Technology in Disaster Risk Reduction,” Information Systems Frontiers, vol. 23, no. 5, pp. 1077–1081, 2021, doi: 10.1007/s10796-021-10204-x.

U. S. Sulistyawati and B. Bahruni, “The Role of Information Technology on Employee Performance in Universities at New Normal Life Order After Covid-19 Pandemic,” International Journal of Social Science and Business, vol. 5, no. 2, pp. 185–192, 2021.

X. Liu, J. Chen, H. Wang, Z. Jia, and Z. Wu, “Earthquake Economic Loss Assessment of Reinforced Concrete Structures Using Multiple Response Variables,” Buildings, vol. 13, no. 7, pp. 1–19, 2023, doi: 10.3390/buildings13071719.

B. Kalantar, N. Ueda, H. A. H. Al-Najjar, and A. A. Halin, “Assessment of convolutional neural network architectures for earthquake-induced building damage detection based on pre-and post-event orthophoto images,” Remote Sensing, vol. 12, no. 21, pp. 1–20, 2020, doi: 10.3390/rs12213529.

M. D. Zakir Hossain, F. Sohel, M. F. Shiratuddin, and H. Laga, “A comprehensive survey of deep learning for image captioning,” Feb. 2019, Association for Computing Machinery. doi: 10.1145/3295748.

Y. J. Zhang, “The Progression of Image Engineering in This Century,” 2018 7th International Conference on Reliability, Infocom Technologies and Optimization: Trends and Future Directions, ICRITO 2018, pp. 1–7, 2018, doi: 10.1109/ICRITO.2018.8748573.

X. Zhang, J. Zhang, C. Yuan, S. Liu, Z. Chen, and W. Li, “Locating induced earthquakes with a network of seismic stations in Oklahoma via a deep learning method,” Scientific Reports, vol. 10, no. 1, Dec. 2020, doi: 10.1038/s41598-020-58908-5.

A. Distante and C. Distante, Handbook of image processing and computer vision: Volume 1: From energy to image. Springer International Publishing, 2020. doi: 10.1007/978-3-030-38148-6.

G. Abdi and S. Jabari, “A Multi-Feature Fusion Using Deep Transfer Learning for Earthquake Building Damage Detection,” Canadian Journal of Remote Sensing, vol. 47, no. 2, pp. 337–352, 2021, doi: 10.1080/07038992.2021.1925530.

S. T. Seydi, H. Rastiveis, B. Kalantar, A. A. Halin, and N. Ueda, “BDD-Net: An End-to-End Multiscale Residual CNN for Earthquake-Induced Building Damage Detection,” Remote Sensing, vol. 14, no. 9, May 2022, doi: 10.3390/rs14092214.

A. Ishraq, A. A. Lima, M. M. Kabir, M. S. Rahman, and M. F. Mridha, “Assessment of Building Damage on Post-Hurricane Satellite Imagery using improved CNN,” 2022 International Conference on Decision Aid Sciences and Applications, DASA 2022, no. March, pp. 665–669, 2022, doi: 10.1109/DASA54658.2022.9765025.

S. Kaur, S. Gupta, S. Singh, and I. Gupta, “Hurricane Damage Detection From Satellite Imagery Using Convolutional Neural Networks,” International Journal of Information System Modeling and Design, vol. 13, no. 10, pp. 1–15, 2022, doi: 10.4018/IJISMD.306637.

C. Xiong, J. Zheng, L. Xu, C. Cen, R. Zheng, and Y. Li, “Multiple‐input convolutional neural network model for large‐scale seismic damage assessment of reinforced concrete frame buildings,” Applied Sciences (Switzerland), vol. 11, no. 17, 2021, doi: 10.3390/app11178258.

W. Yang, X. Zhang, and P. Luo, “Transferability of convolutional neural network models for identifying damaged buildings due to earthquake,” Remote Sensing, vol. 13, no. 3, pp. 1–20, 2021, doi: 10.3390/rs13030504.

X. Han, T. Jiang, Z. Zhao, and Z. Lei, “Research on Remote Sensing Image Target Recognition Based on Deep Convolution Neural Network,” International Journal of Pattern Recognition and Artificial Intelligence, vol. 34, no. 5, pp. 1–20, 2020, doi: 10.1142/S0218001420540154.

D. Lam et al., “xView: Objects in Context in Overhead Imagery,” 2018, [Online]. Available: http://arxiv.org/abs/1802.07856

A. Singh and M. J. Nene, “Performance Assessment of Deep Learning Algorithm Using xView Data Set,” in 2023 International Conference for Advancement in Technology (ICONAT), 2023, pp. 1–6. doi: 10.1109/ICONAT57137.2023.10080522.

S. Ioffe and C. Szegedy, “Batch normalization: Accelerating deep network training by reducing internal covariate shift,” 32nd International Conference on Machine Learning, ICML 2015, vol. 1, pp. 448–456, 2015.

N. Srivastava, G. Hinton, A. Krizhevsky, I. Sutskever, and R. Salakhutdinov, “Dropout: A simple way to prevent neural networks from overfitting,” Journal of Machine Learning Research, vol. 15, pp. 1929–1958, 2014.

R. Gupta et al., “Creating XBD: A dataset for assessing building damage from satellite imagery,” IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops, vol. 2019-June, pp. 10–17, 2019.

J. Jia and W. Ye, “Deep Learning for Earthquake Disaster Assessment: Objects, Data, Models, Stages, Challenges, and Opportunities,” Remote Sensing, vol. 15, no. 16, 2023, doi: 10.3390/rs15164098.




DOI: https://doi.org/10.47738/jads.v6i4.931

Refbacks

  • There are currently no refbacks.



Barcode

Journal of Applied Data Sciences

ISSN:2723-6471 (Online)
Publisher:Bright Publisher
Website:http://bright-journal.org/JADS
Email:taqwa@amikompurwokerto.ac.id (principal contact)
  support@bright-journal.org (technical issues)

This work is licensed under a Creative Commons Attribution-ShareAlike 4.0