Leveraging Generative AI in Vehicles for Enhanced Driver Safety and Advanced Communication Systems

Vinoth Kumar P, Sri Anadha Ganesh T, M Batumalay, S N Kumar, Gunapriya Devarajan, Bhuvaneshwari K, Kesavan T, Lakshmi Praba S, Nandhanaa K S
Pages 758-772
Abstract Views 608
PDF Downloads 498
Crossref Citations -
DOI https://doi.org/10.47738/jads.v7i1.809

Abstract


This paper proposes an integrated artificial intelligence–based driver assistance system for electric vehicles (EVs) that combines computer vision–based drowsiness detection with a generative artificial intelligence (GenAI)–driven conversational interaction framework to enhance driver safety and human–vehicle interaction. The primary objective of this work is to reduce fatigue-related driving risks while enabling natural, hands-free, and context-aware communication between the driver and the vehicle. The core idea is to tightly couple real-time driver state monitoring with intelligent conversational feedback, allowing safety alerts and voice interactions to adapt dynamically to the driver’s condition. Driver drowsiness is detected using non-intrusive visual indicators, namely eye closure duration and blink rate, extracted from an in-vehicle camera. A drowsy state is identified when eye closure exceeds 10 s or when the blink rate exceeds 6 blinks within a 6 s interval. Upon detection, the system generates multi-modal alerts consisting of audio warnings and vibration feedback, while a GenAI-based natural language processing module provides real-time, hands-free voice interaction. Experimental evaluation was conducted on an ESP32-based embedded prototype across five predefined driving scenarios representing normal and fatigued conditions. The results show stable face and eye detection under normal driving and achieved 100% correct alert triggering in all drowsiness-related cases (3 out of 5 scenarios), with zero false positives observed during non-drowsy conditions (2 out of 5 scenarios). The system demonstrated consistent real-time response and reliable alert activation under fatigue conditions. The main contribution and novelty of this research lie in the real-time integration of generative AI–driven conversational intelligence with embedded computer vision–based drowsiness detection within a unified, resource-constrained platform, which is rarely addressed jointly in existing systems. Overall, the proposed framework provides a practical, scalable, and human-centered solution for intelligent driver assistance in semi-autonomous and future autonomous EV environments.

Keywords


Computer Vision; Generative AI; Natural Language Processing; ChatGPT;EV; Process Innovation

Full Text:

PDF

References


H. Zhang et al., “The Role of Generative Artificial Intelligence in Internet of Electric Vehicles,” IEEE Internet of Things Journal, pp. 1–1, Jan. 2024, doi: https://doi.org/10.1109/jiot.2024.3511961.

“ChatGPT in connected and autonomous vehicles: benefits and challenges,” Intelligence & Robotics, vol. 3, no. 2, pp. 144–147, May 2023, doi: https://doi.org/10.20517/ir.2023.08.

W. Jiao, W. Wang, J. Huang, X. Wang, and Z. Tu, “Is ChatGPT A Good Translator? Yes With GPT-4 As The Engine,” arXiv (Cornell University), Jan. 2023, doi: https://doi.org/10.48550/arxiv.2301.08745.

M. Abdullah, A. Madain, and Y. Jararweh, “ChatGPT: Fundamentals, Applications and Social Impacts,” 2022 Ninth International Conference on Social Networks Analysis, Management and Security (SNAMS), Nov. 2022, doi: https://doi.org/10.1109/snams58071.2022.10062688.

M. Capallera, L. Angelini, Q. Meteier, O. A. Khaled, and E. Mugellini, “Human-Vehicle Interaction to Support Driver’s Situation Awareness in Automated Vehicles: A Systematic Review,” IEEE Transactions on Intelligent Vehicles, pp. 1–19, 2022, doi: https://doi.org/10.1109/tiv.2022.3200826.

Y. Gao, W. Tong, E. Q. Wu, W. Chen, G. Zhu, and F.-Y. Wang, “Chat with ChatGPT on Interactive Engines for Intelligent Driving,” IEEE Transactions on Intelligent Vehicles, pp. 1–3, 2023, doi: https://doi.org/10.1109/TIV.2023.3252571.

Aditya Ranjan, Karan Vyas, Sujay Ghadge, Siddharth Patel, Suvarna Sanjay Pawar, “Driver Drowsiness Detection System Using Computer Vision.”, in International Research Journal of Engineering and Technology(IRJET), 2020.

B.Mohana, C.M.Sheela Rani, “Drowsiness Detection Based on Eye Closure and Yawning Detection”, in International Research Journal of Engineering and Technology(IRJET), 2019.

C. Schwarz, J. Gaspar, T. Miller, and R. Yousefian, “The detection of drowsiness using a driver monitoring system,” Traffic Injury Prevention, vol. 20, no. sup1, pp. S157–S161, Jun. 2019, doi: https://doi.org/10.1080/15389588.2019.1622005.

Rahul Atul Bhone, “Computer Vision based drowsiness detection for motorized vehicles with Web Push Notifications,” Apr. 2019, doi: https://doi.org/10.1109/iot-siu.2019.8777652.

J. S. Wijnands, J. Thompson, K. A. Nice, G. D. P. A. Aschwanden, and M. Stevenson, “Real-time monitoring of driver drowsiness on mobile platforms using 3D neural networks,” Neural Computing and Applications, vol. 32, no. 13, pp. 9731–9743, Oct. 2019, doi: https://doi.org/10.1007/s00521-019-04506-0.

J. Zhang et al., “HiVeGPT: Human-Machine-Augmented Intelligent Vehicles With Generative Pre-Trained Transformer,” vol. 8, no. 3, pp. 2027–2033, Jan. 2023, doi: https://doi.org/10.1109/tiv.2023.3256982.

H. Du et al., “Chat with ChatGPT on Intelligent Vehicles: An IEEE TIV Perspective,” IEEE Transactions on Intelligent Vehicles, pp. 1–7, 2023, doi: https://doi.org/10.1109/tiv.2023.3253281.

R. Kumar, P. Kumar, and D. G. Das, “IoT Based Coal Mine Safety Monitoring and Alerting System,” pp. 1729–1731, Dec. 2022, doi: https://doi.org/10.1109/icac3n56670.2022.10074169.

H. Afreen and I. S. Bajwa, “An IoT-based Real-time Intelligent Monitoring and Notification System of Cold Storage,” IEEE Access, vol. 9, pp. 1–1, 2021, doi: https://doi.org/10.1109/access.2021.3056672.

M. Hao and Y. Nie, “Hazard identification, risk assessment and management of industrial system: Process safety in mining industry,” Safety Science, vol. 154, p. 105863, Oct. 2022, doi: https://doi.org/10.1016/j.ssci.2022.105863.

Wai Yie Leong, “Digital Technology for Asean Energy,” Aug. 2023, doi: https://doi.org/10.1109/iccpct58313.2023.10244806.

B. Aljafari, G. Devarajan, S. Subramani, and S. Vairavasundaram, “Intelligent RBF-Fuzzy Controller Based Non-Isolated DC-DC Multi-Port Converter for Renewable Energy Applications,” Sustainability, vol. 15, no. 12, p. 9425, 2023. [Online]. Available: https://doi.org/10.3390/su15129425

A. Alzahrani, G. Devarajan, S. Subramani, I. Vairavasundaram, and C. U. Ogbuka, “Analysis and validation of multi-device interleaved DC-DC boost converter for electric vehicle applications,” IET Power Electron., Mar. 2023. [Online]. Available: https://doi.org/10.1049/pel2.12494




DOI: https://doi.org/10.47738/jads.v7i1.809

Refbacks

  • There are currently no refbacks.


Barcode

Journal of Applied Data Sciences

ISSN:2723-6471 (Online)
Publisher:Bright Publisher
Website:http://bright-journal.org/JADS
Email:taqwa@amikompurwokerto.ac.id (principal contact)
  support@bright-journal.org (technical issues)

This work is licensed under a Creative Commons Attribution-ShareAlike 4.0