Hybrid Deep Learning for Image Authenticity: Distinguishing Between Real and AI-Generated Images

Wella Wella, Suryasari Suryasari, Ririn Ikana Desanti

Abstract


The increasing use of artificially generated images raises significant concerns about the authenticity of digital content. This study introduces a hybrid deep learning model for binary classification of real and generated images by combining spatial and relational features. The central idea is to integrate a convolutional backbone adapted from ResNet18 for visual feature extraction with a graph representation based on nearest-neighbor relations to capture inter-image similarities. The objective is to evaluate whether this dual-feature approach improves classification performance compared to single-feature baselines. Using a balanced dataset of 1,256 images (744 real and 512 generated), the model was trained on 70% of the data and tested on the remaining 30%. Experimental findings demonstrate that the model achieved an overall accuracy of 88%, with precision of 0.91 and recall of 0.89 for real images, and precision of 0.85 and recall of 0.87 for generated images. The corresponding F1 scores were 0.90 and 0.86, yielding a macro average F1 of 0.88. Confusion matrix analysis shows balanced misclassification across both classes, while stable performance across epochs indicates reliable learning behavior. Results confirm that the hybrid model achieves stronger classification effectiveness than convolution-only or graph-only baselines. The novelty of this work lies in demonstrating that the integration of spatial and relational learning provides a more robust framework for detecting synthetic images than single-modality approaches. The contribution of this research is both methodological, in proposing a hybrid architecture that unifies convolutional and graph-based learning, and practical, in providing empirical evidence that such integration enhances the reliability of image authenticity verification. While the absence of a validation set limited hyperparameter optimization and early stopping, the findings indicate that this hybrid design offers a promising direction for improving the robustness and generalizability of synthetic image detection.


Keywords


Deepfake Detection; Hybrid CNN-GNN; Graph Neural Networks; Image Classification; k-NN Graph Construction

Full Text:

PDF

References


A. Al-Adwan, H. Alazzam, N. Al-Anbaki, and E. Alduweib, “Detection of Deepfake Media Using a Hybrid CNN–RNN Model and Particle Swarm Optimization (PSO) Algorithm,” Computers 2024, Vol. 13, Page 99, vol. 13, no. 4, p. 99, Apr. 2024, doi: 10.3390/COMPUTERS13040099.

R. Raman et al., “Fake news research trends, linkages to generative artificial intelligence and sustainable development goals,” Heliyon, vol. 10, no. 3, Feb. 2024, doi: 10.1016/j.heliyon.2024.e24727.

Q. Thomas, “Johnny Somali Guaranteed Prison Time in South Korea After AI Deepfake Scandal.” Accessed: Jul. 23, 2025. [Online]. Available: https://www.yahoo.com/entertainment/johnny-somali-guaranteed-prison-time-222406985.html

S. G. Ji, “#MeToo in an AI-generated deepfake sexual violence era in South Korea,” Womens Stud Int Forum, vol. 112, Sep. 2025, doi: 10.1016/j.wsif.2025.103146.

T. Saheb, M. Sidaoui, and B. Schmarzo, “Convergence of artificial intelligence with social media: A bibliometric & qualitative analysis,” Telematics and Informatics Reports, vol. 14, Jun. 2024, doi: 10.1016/j.teler.2024.100146.

C. Yavuz, “Adverse human rights impacts of dissemination of nonconsensual sexual deepfakes in the framework of European Convention on Human Rights: A victim-centered perspective,” Computer Law and Security Review, vol. 56, Apr. 2025, doi: 10.1016/j.clsr.2025.106108.

A. Diel, T. Lalgi, I. C. Schröter, K. F. MacDorman, M. Teufel, and A. Bäuerle, “Human performance in detecting deepfakes: A systematic review and meta-analysis of 56 papers,” Computers in Human Behavior Reports, vol. 16, Dec. 2024, doi: 10.1016/j.chbr.2024.100538.

M. Burgess, “Deepfake Porn Is Out of Control | WIRED.” Accessed: Jul. 23, 2025. [Online]. Available: https://www.wired.com/story/deepfake-porn-is-out-of-control/?utm_source=chatgpt.com

Z. Xu, X. Wen, G. Zhong, and Q. Fang, “Public perception towards deepfake through topic modelling and sentiment analysis of social media data,” Soc Netw Anal Min, vol. 15, no. 1, pp. 1–20, Dec. 2025, doi: 10.1007/S13278-025-01445-8/FIGURES/10.

N. Saeed, G. Mumtaz, M. Yaqub, and M. H. Ahmad, “Improving DeepFake Detection: A Comprehensive Review of Adversarial Robustness, Real-Time Processing and Evaluation Metrics | Journal of Computing & Biomedical Informatics,” Journal of Computing & Biomedical Informatics, vol. 7, no. 2, Sep. 2024, doi: https://doi.org/10.56979/702/2024.

B. Li, J. Sun, C. M. Poskitt, and X. Wang, “How Generalizable are Deepfake Image Detectors? An Empirical Study,” Aug. 2023, Accessed: Jul. 23, 2025. [Online]. Available: https://arxiv.org/pdf/2308.04177

M. M. El-Gayar, M. Abouhawwash, S. S. Askar, and S. Sweidan, “A novel approach for detecting deep fake videos using graph neural network,” J Big Data, vol. 11, no. 1, Dec. 2024, doi: 10.1186/s40537-024-00884-y.

F. Khalid, A. Javed, Q. ul ain, H. Ilyas, and A. Irtaza, “DFGNN: An interpretable and generalized graph neural network for deepfakes detection,” Expert Syst Appl, vol. 222, p. 119843, Jul. 2023, doi: 10.1016/J.ESWA.2023.119843.

Z. Yan et al., “Multimodal Graph Learning for Deepfake Detection,” Sep. 2022, Accessed: Jul. 23, 2025. [Online]. Available: https://arxiv.org/pdf/2209.05419

A. Jahin et al., “Soybean Disease Detection via Interpretable Hybrid CNN-GNN: Integrating MobileNetV2 and GraphSAGE with Cross-Modal Attention,” Mar. 2025, Accessed: Jul. 23, 2025. [Online]. Available: https://arxiv.org/pdf/2503.01284

Z. Jiao, H. Zhang, and X. Li, “CNN2GNN: How to Bridge CNN with GNN,” Apr. 2024, doi: 10.1109/TPAMI.2025.3583357.

A. Beghdadi, A. Beghdadi, M. Ullah, F. A. Cheikh, and M. Mallem, “A New Lightweight Hybrid Graph Convolutional Neural Network -- CNN Scheme for Scene Classification using Object Detection Inference,” Jul. 2024, Accessed: Jul. 23, 2025. [Online]. Available: https://arxiv.org/pdf/2407.14658

L. Visengeriyeva, A. Kammer, I. Bär, A. Kniesz, and M. Plöd, “CRISP-ML(Q). The ML Lifecycle Process.” Accessed: Mar. 20, 2025. [Online]. Available: https://ml-ops.org/content/crisp-ml

dk_9892, “CASIA_v2.” Accessed: Jul. 23, 2025. [Online]. Available: https://www.kaggle.com/datasets/dk9892/casia-v2

resnet18, “resnet18 — Torchvision main documentation.” Accessed: Jul. 23, 2025. [Online]. Available: https://docs.pytorch.org/vision/main/models/generated/torchvision.models.resnet18.html




DOI: https://doi.org/10.47738/jads.v7i1.991

Refbacks

  • There are currently no refbacks.



Barcode

Journal of Applied Data Sciences

ISSN:2723-6471 (Online)
Publisher:Bright Publisher
Website:http://bright-journal.org/JADS
Email:taqwa@amikompurwokerto.ac.id (principal contact)
  support@bright-journal.org (technical issues)

This work is licensed under a Creative Commons Attribution-ShareAlike 4.0