.png)
EagleEyes: An Artificial Intelligence-Based Approach for Automatic Traffic Violation Detection Using Deep Learning
Abstract
Rapid urbanization and the advancement of smart city programs in Indonesia necessitate intelligent, automated solutions for traffic monitoring and law enforcement. This study introduces EagleEyes, an artificial intelligence–based framework designed for automatic detection of multiple traffic violations by integrating the YOLOv8 deep learning architecture with Optical Character Recognition (OCR) for vehicle license plate identification. YOLOv8 was selected due to its anchor-free design, decoupled detection head, and enhanced feature fusion modules, which collectively improve detection accuracy, convergence speed, and small-object recognition compared to YOLOv5 and YOLOv7, while maintaining lightweight computational efficiency suitable for real-time applications. The proposed system was trained on a multi-class dataset representing common Indonesian violations, including seat belt non-compliance, helmet absence, motorcycle overcapacity, and unreadable license plates. Experimental results demonstrate robust performance, achieving a precision of 0.91, recall of 0.92, and mean average precision (mAP@0.5) of 0.96 at the optimal epoch, with an average inference speed of 25 frames per second and total training time of approximately 15 minutes on an NVIDIA RTX GPU. The OCR module attained an average recognition accuracy of 98.7%, although its performance decreased for vehicles captured beyond a five-meter distance due to reduced clarity and illumination inconsistencies. Implemented as a web-based application using the Flask framework, EagleEyes enables flexible browser-based visualization, and can be seamlessly integrated into Indonesia’s Electronic Traffic Law Enforcement (ETLE) infrastructure. Overall, the system demonstrates high potential to enhance smart city traffic management through scalable, AI-driven, and ethically responsible automation.
Keywords
Full Text:
PDFReferences
D. Tangamus, N. A. Thai, J. Shan, E. F. A. Sihotang, and E. Irwansyah, “Method For Traffic Violation Detection Using Deep Learning,” 2023 Int. Conf. Informatics, Multimedia, Cyber Inf. Syst. ICIMCIS 2023, no. February, pp. 16–21, 2023, doi: 10.1109/ICIMCIS60089.2023.10349009.
Mr. S. Suresh, J Gopalakrishnan, K Guruseelan, S Giridharan, and K Gururajan, “Traffic Violation Detection Using Deep Learning,” Int. Res. J. Adv. Eng. Manag., vol. 3, no. 04, pp. 1359–1363, 2025, doi: 10.47392/irjaem.2025.0221.
L. Jiao et al., “A survey of deep learning-based object detection,” IEEE Access, vol. 7, pp. 128837–128868, 2019, doi: 10.1109/ACCESS.2019.2939201.
Y. Lecun, Y. Bengio, and G. Hinton, “Deep learning,” Nature, vol. 521, no. 7553, pp. 436–444, 2015, doi: 10.1038/nature14539.
M. N. Chan and T. Tint, “A Review on Advanced Detection Methods in Vehicle Traffic Scenes,” Proc. 6th Int. Conf. Inven. Comput. Technol. ICICT 2021, pp. 642–649, 2021, doi: 10.1109/ICICT50816.2021.9358791.
R. Padma and H. H. Shilpa, "Car Accident Detection and Alert System Leveraging Deep Learning," Int. J. Innov. Res. Adv. Eng., vol. 11, no. 5, pp. 121–128, 2024, doi:10.26562/ijirae.2024.v1105.24.
M. P. Melegrito, R. C. Reyes, R. R. Tejada, et al., "Deep Learning Based Traffic Accident Detection in Smart Transportation," in Proc. ICAPAI, 2024, pp. 65–70, doi: 10.1109/ICAPAI61893.2024.10541163.
F. Ali, M. J. Alnuaimi, S. AlAwadhi, et al., "Abnormal Driver Behavior Detection Using Deep Learning," in Proc. ICSPIS, 2024, pp. 102–107, doi:10.1109/ICSPIS63676.2024.10812606.
F. Yasser, S. Hatem, Z. Ahmed, et al., "Driver and Vehicle Unsafe Behavior Tracking using Deep Learning," in Proc. ICCI, 2024, pp. 233–239, doi: 10.1109/ICCI61671.2024.10485085.
M. Bagchi, M. A. H. Chowdhury, and S. A. Fattah, "Towards Safer Roads: A Deep Learning Based Object Detection Technique for Vehicle Safety," in Proc. ICACCESS, 2024, pp. 155–162, doi: 10.1109/iCACCESS61735.2024.10499581.
P. K. Nayak, D. Muduli, R. Das, et al., "Automated Seat Belt Detection in Indian Traffic," in Proc. IC-CGU, 2024, pp. 55–60, doi: 10.1109/IC-CGU58078.2024.10530825
L. Singh, D. Chaurasia, N. K. Tiwari, et al., "Driver’s Seat Belt Detection Using CNN-SVM," in Proc. CSNT, 2024, pp. 113–118, doi: 10.1109/CSNT60213.2024.10545852.
E. D. Udayanti, E. Kartikadarma, and F. Firdausillah, "Seat Belt Detection using YOLO3 and LSTM," J. RESTI, vol. 8, no. 3, pp. 375–380, 2024.
L. Qiu, J. Rao, and X. Zhao, "Seatbelt Detection Algorithm Improved with Lightweight Approach and Attention Mechanism," Appl. Sci., vol. 14, no. 8, pp. 3346–3358, 2024, doi: 10.3390/app14083346
S. B. Neamah and A. A. Karim, "Real-time Traffic Monitoring System Based on Deep Learning and YOLOv8," ARO J. Koya Univ., 2023, doi: 10.14500/aro.11327
M. Upadhyay, B. Sutrave, and A. Singh, "Real Time Seatbelt Detection Using YOLO Deep Learning Model," in Proc. SCEECS, 2023, pp. 77–82, doi: 10.1109/SCEECS57921.2023.10063114
S. Alievich and M. M. Mustafaqulovna, "Automatic Traffic Rule Violations Detection Using Deep Learning Techniques," in Smart Intelligent Computing and Applications. Springer, 2023, pp. 89–98, doi: 10.1007/978-981-19-9638-2_7
R. Khan, S. T. A. Ali, A. Siddiq, et al., "Multi-String Missing Characters Restoration for Automatic License Plate Recognition System," Int. J. Adv. Comput. Sci. Appl., vol. 14, no. 3, pp. 101–107, 2023, doi: 10.14569/IJACSA.2023.0140395
W. Feng, W. Yu, and R. Nan, "Deep Learning Based Vehicle Seat Belt Detection Algorithm," in Proc. ICIIBMS, 2022, pp. 187–192, doi: 10.1109/ICIIBMS55689.2022.9971531
Madake, S. Singh, S. Bhatlawande, et al., "Vision-Based Driver’s Seat Belt Detection," in Proc. ICONAT, 2023, pp. 33–38, doi: 10.1109/ICONAT57137.2023.10080147
Y. Gu and R. O. Sinnott, "Real-Time Vehicle Passenger Detection Through Deep Learning," in Proc. e-Science, 2023, pp. 211–216, doi: 10.1109/e-Science58273.2023.10254927
E. D. Udayanti, E. Kartikadarma, and F. Firdausillah, "Convolutional Neural Network and LSTM for Seat Belt Detection in Vehicles using YOLO3," J. RESTI, vol. 8, no. 3, 2024, doi: 10.29207/resti.v8i3.5784
Nkuzo, M. Sibiya, and E. D. Markus, "Real-Time Car Safety Belt Detection Using YOLOv7," Algorithms, vol. 16, no. 9, pp. 400–408, 2023, doi: 10.3390/a16090400
R. Xu, Y. Chen, X. Chen, et al., "Deep Learning Based Vehicle Violation Detection System," in Proc. ICSP, 2021, pp. 135–140, doi: 10.1109/ICSP51882.2021.9408935
H. Ye, "Target Detection System of Autonomous Driving Based on Deep Learning," Appl. Comput. Eng., 2024, doi: 10.3390/min14090873
Z. Al-Agroudy, A. Mohamed, Z. Ashraf, et al., "AI-Safe Transportation: Real-Time Incident Detection and Alerting System in Smart Cities," in Proc. ICIICIS, 2023, pp. 60–65, doi: 10.1109/ICICIS58388.2023.10391134
C. Saha, T. H. Tran, and S. Syamal, "Enhancing Automotive Safety Through Advanced Object Behaviour Tracking," in Proc. MetroAutomotive, 2024, pp. 215–222, doi: 10.1109/MetroAutomotive61329.2024.10615654
M. Abuomar, Y. A. Ahmed, and M. A. M. Salem, "Safety on Wheels: Computer Vision for Driver and Passengers Monitoring," in Proc. MIUCC, 2023, pp. 111–116, doi: 10.1109/MIUCC58832.2023.10278366
H. Lu, H. Pan, and Z. Sun, "Comparative Review of Advanced Seatbelt Detection: Infrared Sensors vs. Image-Based Systems," Appl. Comput. Eng., vol. 4, no. 1, pp. 77–84, 2024, doi:10.54254/2755-2721/53/20241311
Haris, G. Shakhnarovich, and N. Ukita, "Recurrent Back-Projection Network for Video Super-Resolution," in Proc. CVPR, 2019, pp. 3897–3906, doi: 10.48550/arXiv.1903.10128
Haris, G. Shakhnarovich, and N. Ukita, "Deep Back-Projection Networks for Super-Resolution," in Proc. CVPR, 2018, pp. 1664–1673. doi: https://doi.org/10.48550/arXiv.1803.02735
M. I. Prasetiyowati, N. U. Maulidevi, and K. Surendro, "Determining Threshold Value on Information Gain Feature Selection to Increase Speed and Prediction Accuracy of Random Forest," J. Big Data, vol. 8, no. 1, pp. 84, 2021, doi: 10.1186/s40537-021-00472-4
M. I. Prasetiyowati, N. U. Maulidevi, and K. Surendro, "Feature Selection to Increase the Random Forest Method Performance on High Dimensional Data," Int. J. Adv. Intell. Inform., vol. 6, no. 3, pp. 303–312, 2020. doi: 10.26555/ijain.v6i3.471
W. Gata, D. Riana, M. Haris, M. I. Prasetiyowati, and D. P. Metalica, “Automated Indonesian Plate Recognition: YOLOv8 Detection and TensorFlow-CNN Character Classification,” J. RESTI, vol. 9, no. 3, pp. 544–553, 2025, doi: 10.29207/resti.v9i3.6310.
Sarhan, R. A. Rahem, B. Darwish, A. A. Attia, A. Sneed, and S. Hatem, “Egyptian car plate recognition based on YOLOv8 , Easy ‑ OCR , and CNN,” J. Electr. Syst. Inf. Technol., 2024, doi: 10.1186/s43067-024-00156-y.
DOI: https://doi.org/10.47738/jads.v7i1.1097
Refbacks
- There are currently no refbacks.
Journal of Applied Data Sciences
| ISSN | : | 2723-6471 (Online) |
| Publisher | : | Bright Publisher |
| Website | : | http://bright-journal.org/JADS |
| : | taqwa@amikompurwokerto.ac.id (principal contact) | |
| support@bright-journal.org (technical issues) |
This work is licensed under a Creative Commons Attribution-ShareAlike 4.0