A Real-Time Vision Transformers-Based System for Enhanced Driver Drowsiness Detection and Vehicle Safety
Drowsy driving is a leading cause of fatal traffic accidents worldwide. Drowsy driving has emerged from modern societal trends such as long working hours, heavy reliance on vehicles, and insufficient sleep. Despite considerable efforts by researchers to develop efficient driver drowsiness detection...
Saved in:
| Main Authors: | , , , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
IEEE
2025-01-01
|
| Series: | IEEE Access |
| Subjects: | |
| Online Access: | https://ieeexplore.ieee.org/document/10815964/ |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1841557059239149568 |
|---|---|
| author | Anwar Jarndal Hissam Tawfik Ali I. Siam Imad Alsyouf Ali Cheaitou |
| author_facet | Anwar Jarndal Hissam Tawfik Ali I. Siam Imad Alsyouf Ali Cheaitou |
| author_sort | Anwar Jarndal |
| collection | DOAJ |
| description | Drowsy driving is a leading cause of fatal traffic accidents worldwide. Drowsy driving has emerged from modern societal trends such as long working hours, heavy reliance on vehicles, and insufficient sleep. Despite considerable efforts by researchers to develop efficient driver drowsiness detection systems, none so far has been widely adopted due to their high cost, intrusive nature, and ineffectiveness in challenging real-life situations. This paper presents a novel, real-time, non-intrusive, and cost-effective driver drowsiness detection system leveraging vision transformers (ViT). Our approach detects the driver’s face from each video frame and classifies the driver’s state as either ‘drowsy’ or ‘alert’ based on the entire facial image, as opposed to previous systems that rely on analyzing specific facial features. We demonstrate that the proposed Vision Transformers-based Driver Drowsiness Detection (ViT-DDD) system surpasses existing state-of-the-art methods, particularly in challenging scenarios such as drivers wearing glasses or sunglasses, or in different lighting conditions. The model was trained and evaluated on two widely used public drowsiness detection datasets, achieving classification accuracies of 98.89% on the NTHU-DDD dataset and 99.4% on the UTA-RLDD dataset. Furthermore, the system was successfully deployed on a Raspberry Pi microcomputer, integrated with an infrared camera, a GSM/GPS module, and a buzzer to alert the driver and report the drowsiness condition to the vehicle owner. Testing the prototype yielded highly promising results, with the system’s strong performance attributed to the ViT-DDD system and advanced hardware. The promising test results suggest the potential of this system in significantly reducing accidents caused by drowsy driving, with future work aiming to expand its capabilities and integration into broader vehicular systems. |
| format | Article |
| id | doaj-art-f0af5396231f465aa2d333e63f3d3f2c |
| institution | Kabale University |
| issn | 2169-3536 |
| language | English |
| publishDate | 2025-01-01 |
| publisher | IEEE |
| record_format | Article |
| series | IEEE Access |
| spelling | doaj-art-f0af5396231f465aa2d333e63f3d3f2c2025-01-07T00:01:50ZengIEEEIEEE Access2169-35362025-01-01131790180310.1109/ACCESS.2024.352211110815964A Real-Time Vision Transformers-Based System for Enhanced Driver Drowsiness Detection and Vehicle SafetyAnwar Jarndal0https://orcid.org/0000-0002-1873-2088Hissam Tawfik1Ali I. Siam2Imad Alsyouf3https://orcid.org/0000-0002-6200-8919Ali Cheaitou4Department of Electrical Engineering, University of Sharjah, Sharjah, United Arab EmiratesDepartment of Electrical Engineering, University of Sharjah, Sharjah, United Arab EmiratesResearch Institute of Sciences and Engineering, University of Sharjah, Sharjah, United Arab EmiratesDepartment of Industrial Engineering and Engineering Management, University of Sharjah, Sharjah, United Arab EmiratesDepartment of Industrial Engineering and Engineering Management, University of Sharjah, Sharjah, United Arab EmiratesDrowsy driving is a leading cause of fatal traffic accidents worldwide. Drowsy driving has emerged from modern societal trends such as long working hours, heavy reliance on vehicles, and insufficient sleep. Despite considerable efforts by researchers to develop efficient driver drowsiness detection systems, none so far has been widely adopted due to their high cost, intrusive nature, and ineffectiveness in challenging real-life situations. This paper presents a novel, real-time, non-intrusive, and cost-effective driver drowsiness detection system leveraging vision transformers (ViT). Our approach detects the driver’s face from each video frame and classifies the driver’s state as either ‘drowsy’ or ‘alert’ based on the entire facial image, as opposed to previous systems that rely on analyzing specific facial features. We demonstrate that the proposed Vision Transformers-based Driver Drowsiness Detection (ViT-DDD) system surpasses existing state-of-the-art methods, particularly in challenging scenarios such as drivers wearing glasses or sunglasses, or in different lighting conditions. The model was trained and evaluated on two widely used public drowsiness detection datasets, achieving classification accuracies of 98.89% on the NTHU-DDD dataset and 99.4% on the UTA-RLDD dataset. Furthermore, the system was successfully deployed on a Raspberry Pi microcomputer, integrated with an infrared camera, a GSM/GPS module, and a buzzer to alert the driver and report the drowsiness condition to the vehicle owner. Testing the prototype yielded highly promising results, with the system’s strong performance attributed to the ViT-DDD system and advanced hardware. The promising test results suggest the potential of this system in significantly reducing accidents caused by drowsy driving, with future work aiming to expand its capabilities and integration into broader vehicular systems.https://ieeexplore.ieee.org/document/10815964/Vision transformersdriver drowsinessdeep learningcomputer visionvehicle safety |
| spellingShingle | Anwar Jarndal Hissam Tawfik Ali I. Siam Imad Alsyouf Ali Cheaitou A Real-Time Vision Transformers-Based System for Enhanced Driver Drowsiness Detection and Vehicle Safety IEEE Access Vision transformers driver drowsiness deep learning computer vision vehicle safety |
| title | A Real-Time Vision Transformers-Based System for Enhanced Driver Drowsiness Detection and Vehicle Safety |
| title_full | A Real-Time Vision Transformers-Based System for Enhanced Driver Drowsiness Detection and Vehicle Safety |
| title_fullStr | A Real-Time Vision Transformers-Based System for Enhanced Driver Drowsiness Detection and Vehicle Safety |
| title_full_unstemmed | A Real-Time Vision Transformers-Based System for Enhanced Driver Drowsiness Detection and Vehicle Safety |
| title_short | A Real-Time Vision Transformers-Based System for Enhanced Driver Drowsiness Detection and Vehicle Safety |
| title_sort | real time vision transformers based system for enhanced driver drowsiness detection and vehicle safety |
| topic | Vision transformers driver drowsiness deep learning computer vision vehicle safety |
| url | https://ieeexplore.ieee.org/document/10815964/ |
| work_keys_str_mv | AT anwarjarndal arealtimevisiontransformersbasedsystemforenhanceddriverdrowsinessdetectionandvehiclesafety AT hissamtawfik arealtimevisiontransformersbasedsystemforenhanceddriverdrowsinessdetectionandvehiclesafety AT aliisiam arealtimevisiontransformersbasedsystemforenhanceddriverdrowsinessdetectionandvehiclesafety AT imadalsyouf arealtimevisiontransformersbasedsystemforenhanceddriverdrowsinessdetectionandvehiclesafety AT alicheaitou arealtimevisiontransformersbasedsystemforenhanceddriverdrowsinessdetectionandvehiclesafety AT anwarjarndal realtimevisiontransformersbasedsystemforenhanceddriverdrowsinessdetectionandvehiclesafety AT hissamtawfik realtimevisiontransformersbasedsystemforenhanceddriverdrowsinessdetectionandvehiclesafety AT aliisiam realtimevisiontransformersbasedsystemforenhanceddriverdrowsinessdetectionandvehiclesafety AT imadalsyouf realtimevisiontransformersbasedsystemforenhanceddriverdrowsinessdetectionandvehiclesafety AT alicheaitou realtimevisiontransformersbasedsystemforenhanceddriverdrowsinessdetectionandvehiclesafety |