Investigating the impacts of auditory and visual feedback in advanced driver assistance systems: a pilot study on driver behavior and emotional response
In the autonomous vehicle industry, Advanced Driver Assistance Systems (ADAS) are recognized for their capacity to enhance service quality, improve on-road safety, and increase driver comfort. Driver Assistance Systems are able to provide multi-modal feedback including auditory cues, visual cues, vi...
Saved in:
| Main Authors: | , , , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
Frontiers Media S.A.
2025-01-01
|
| Series: | Frontiers in Computer Science |
| Subjects: | |
| Online Access: | https://www.frontiersin.org/articles/10.3389/fcomp.2024.1499165/full |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1841540149969682432 |
|---|---|
| author | Zhao Zou Aila Khan Michael Lwin Fady Alnajjar Omar Mubin |
| author_facet | Zhao Zou Aila Khan Michael Lwin Fady Alnajjar Omar Mubin |
| author_sort | Zhao Zou |
| collection | DOAJ |
| description | In the autonomous vehicle industry, Advanced Driver Assistance Systems (ADAS) are recognized for their capacity to enhance service quality, improve on-road safety, and increase driver comfort. Driver Assistance Systems are able to provide multi-modal feedback including auditory cues, visual cues, vibrotactile cues and so on. The study will concentrate on assessing the impacts of auditory and visual feedback from assistive driving systems on drivers. A group consisting of five participants (N = 5) was recruited to take part in two sets of driving experiments. During the experimental sessions, they were exposed to several reminders designed for drivers in audio-only format and audio-visual format, respectively. Their driving behaviors and performances were under researcher’s observation, while their emotions were evaluated by YOLO v5 detecting model. The results reveal that the participants higher compliance rate and strong emotional reactions (especially the feelings of anger, sadness and surprise) towards the unimodal feedback of audio-only driving reminders. There is no strong evidence showing that the bimodal ADAS feedback of audio-visual cues effectively improve drivers’ performance during driving period. However, both the emotion data and user satisfaction results indicate that participants experienced an increase in feelings of happiness when they were able to visualize the AI assistant while hearing the audio reminders from the assistant. The study serves as one of the pioneering studies aimed at enhancing the theoretical foundation in the field of automotive user interface design, particularly concerning the design of auditory functions. |
| format | Article |
| id | doaj-art-c7408834831e4b6691a91add46a1da4e |
| institution | Kabale University |
| issn | 2624-9898 |
| language | English |
| publishDate | 2025-01-01 |
| publisher | Frontiers Media S.A. |
| record_format | Article |
| series | Frontiers in Computer Science |
| spelling | doaj-art-c7408834831e4b6691a91add46a1da4e2025-01-14T06:10:43ZengFrontiers Media S.A.Frontiers in Computer Science2624-98982025-01-01610.3389/fcomp.2024.14991651499165Investigating the impacts of auditory and visual feedback in advanced driver assistance systems: a pilot study on driver behavior and emotional responseZhao Zou0Aila Khan1Michael Lwin2Fady Alnajjar3Omar Mubin4School of Computer, Data and Mathematical Sciences, Western Sydney University, Sydney, NSW, AustraliaSchool of Business, Western Sydney University, Sydney, NSW, AustraliaSchool of Business, Western Sydney University, Sydney, NSW, AustraliaCollege of Information Technology, United Arab Emirates University, Al Ain, United Arab EmiratesSchool of Computer, Data and Mathematical Sciences, Western Sydney University, Sydney, NSW, AustraliaIn the autonomous vehicle industry, Advanced Driver Assistance Systems (ADAS) are recognized for their capacity to enhance service quality, improve on-road safety, and increase driver comfort. Driver Assistance Systems are able to provide multi-modal feedback including auditory cues, visual cues, vibrotactile cues and so on. The study will concentrate on assessing the impacts of auditory and visual feedback from assistive driving systems on drivers. A group consisting of five participants (N = 5) was recruited to take part in two sets of driving experiments. During the experimental sessions, they were exposed to several reminders designed for drivers in audio-only format and audio-visual format, respectively. Their driving behaviors and performances were under researcher’s observation, while their emotions were evaluated by YOLO v5 detecting model. The results reveal that the participants higher compliance rate and strong emotional reactions (especially the feelings of anger, sadness and surprise) towards the unimodal feedback of audio-only driving reminders. There is no strong evidence showing that the bimodal ADAS feedback of audio-visual cues effectively improve drivers’ performance during driving period. However, both the emotion data and user satisfaction results indicate that participants experienced an increase in feelings of happiness when they were able to visualize the AI assistant while hearing the audio reminders from the assistant. The study serves as one of the pioneering studies aimed at enhancing the theoretical foundation in the field of automotive user interface design, particularly concerning the design of auditory functions.https://www.frontiersin.org/articles/10.3389/fcomp.2024.1499165/fullrobot voiceemotion detectingadvanced driver assistance systemshuman-robot interactionhumanoid agents |
| spellingShingle | Zhao Zou Aila Khan Michael Lwin Fady Alnajjar Omar Mubin Investigating the impacts of auditory and visual feedback in advanced driver assistance systems: a pilot study on driver behavior and emotional response Frontiers in Computer Science robot voice emotion detecting advanced driver assistance systems human-robot interaction humanoid agents |
| title | Investigating the impacts of auditory and visual feedback in advanced driver assistance systems: a pilot study on driver behavior and emotional response |
| title_full | Investigating the impacts of auditory and visual feedback in advanced driver assistance systems: a pilot study on driver behavior and emotional response |
| title_fullStr | Investigating the impacts of auditory and visual feedback in advanced driver assistance systems: a pilot study on driver behavior and emotional response |
| title_full_unstemmed | Investigating the impacts of auditory and visual feedback in advanced driver assistance systems: a pilot study on driver behavior and emotional response |
| title_short | Investigating the impacts of auditory and visual feedback in advanced driver assistance systems: a pilot study on driver behavior and emotional response |
| title_sort | investigating the impacts of auditory and visual feedback in advanced driver assistance systems a pilot study on driver behavior and emotional response |
| topic | robot voice emotion detecting advanced driver assistance systems human-robot interaction humanoid agents |
| url | https://www.frontiersin.org/articles/10.3389/fcomp.2024.1499165/full |
| work_keys_str_mv | AT zhaozou investigatingtheimpactsofauditoryandvisualfeedbackinadvanceddriverassistancesystemsapilotstudyondriverbehaviorandemotionalresponse AT ailakhan investigatingtheimpactsofauditoryandvisualfeedbackinadvanceddriverassistancesystemsapilotstudyondriverbehaviorandemotionalresponse AT michaellwin investigatingtheimpactsofauditoryandvisualfeedbackinadvanceddriverassistancesystemsapilotstudyondriverbehaviorandemotionalresponse AT fadyalnajjar investigatingtheimpactsofauditoryandvisualfeedbackinadvanceddriverassistancesystemsapilotstudyondriverbehaviorandemotionalresponse AT omarmubin investigatingtheimpactsofauditoryandvisualfeedbackinadvanceddriverassistancesystemsapilotstudyondriverbehaviorandemotionalresponse |