Gaze-based detection of mind wandering during audio-guided panorama viewing
Abstract Unlike classic audio guides, intelligent audio guides can detect users’ level of attention and help them regain focus. In this paper, we investigate the detection of mind wandering (MW) from eye movements in a use case with a long focus distance. We present a novel MW annotation method for...
Saved in:
| Main Authors: | , , , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
Nature Portfolio
2024-11-01
|
| Series: | Scientific Reports |
| Online Access: | https://doi.org/10.1038/s41598-024-79172-x |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1846165435435712512 |
|---|---|
| author | Tiffany C. K. Kwok Peter Kiefer Victor R. Schinazi Christoph Hoelscher Martin Raubal |
| author_facet | Tiffany C. K. Kwok Peter Kiefer Victor R. Schinazi Christoph Hoelscher Martin Raubal |
| author_sort | Tiffany C. K. Kwok |
| collection | DOAJ |
| description | Abstract Unlike classic audio guides, intelligent audio guides can detect users’ level of attention and help them regain focus. In this paper, we investigate the detection of mind wandering (MW) from eye movements in a use case with a long focus distance. We present a novel MW annotation method for combined audio-visual stimuli and collect annotated MW data for the use case of audio-guided city panorama viewing. In two studies, MW classifiers are trained and validated, which are able to successfully detect MW in a 1-s time window. In study 1 (n = 27), MW classifiers from gaze features with and without eye vergence are trained (area under the curve of at least 0.80). We then re-validate the classifier with unseen data (study 2, n = 31) that are annotated using a memory task and find a positive correlation (repeated measure correlation = 0.49, p < 0.001) between incorrect quiz answering and the percentage of time users spent mind wandering. Overall, this paper contributes significant new knowledge on the detection of MW from gaze for use cases with audio-visual stimuli. |
| format | Article |
| id | doaj-art-d1f6c6a038bc4a779f6678119eca1738 |
| institution | Kabale University |
| issn | 2045-2322 |
| language | English |
| publishDate | 2024-11-01 |
| publisher | Nature Portfolio |
| record_format | Article |
| series | Scientific Reports |
| spelling | doaj-art-d1f6c6a038bc4a779f6678119eca17382024-11-17T12:18:15ZengNature PortfolioScientific Reports2045-23222024-11-0114111410.1038/s41598-024-79172-xGaze-based detection of mind wandering during audio-guided panorama viewingTiffany C. K. Kwok0Peter Kiefer1Victor R. Schinazi2Christoph Hoelscher3Martin Raubal4Institute of Cartography and Geoinformation, ETH ZürichInstitute of Cartography and Geoinformation, ETH ZürichDepartment of Psychology, Bond UniversityChair of Cognitive Science, ETH ZürichInstitute of Cartography and Geoinformation, ETH ZürichAbstract Unlike classic audio guides, intelligent audio guides can detect users’ level of attention and help them regain focus. In this paper, we investigate the detection of mind wandering (MW) from eye movements in a use case with a long focus distance. We present a novel MW annotation method for combined audio-visual stimuli and collect annotated MW data for the use case of audio-guided city panorama viewing. In two studies, MW classifiers are trained and validated, which are able to successfully detect MW in a 1-s time window. In study 1 (n = 27), MW classifiers from gaze features with and without eye vergence are trained (area under the curve of at least 0.80). We then re-validate the classifier with unseen data (study 2, n = 31) that are annotated using a memory task and find a positive correlation (repeated measure correlation = 0.49, p < 0.001) between incorrect quiz answering and the percentage of time users spent mind wandering. Overall, this paper contributes significant new knowledge on the detection of MW from gaze for use cases with audio-visual stimuli.https://doi.org/10.1038/s41598-024-79172-x |
| spellingShingle | Tiffany C. K. Kwok Peter Kiefer Victor R. Schinazi Christoph Hoelscher Martin Raubal Gaze-based detection of mind wandering during audio-guided panorama viewing Scientific Reports |
| title | Gaze-based detection of mind wandering during audio-guided panorama viewing |
| title_full | Gaze-based detection of mind wandering during audio-guided panorama viewing |
| title_fullStr | Gaze-based detection of mind wandering during audio-guided panorama viewing |
| title_full_unstemmed | Gaze-based detection of mind wandering during audio-guided panorama viewing |
| title_short | Gaze-based detection of mind wandering during audio-guided panorama viewing |
| title_sort | gaze based detection of mind wandering during audio guided panorama viewing |
| url | https://doi.org/10.1038/s41598-024-79172-x |
| work_keys_str_mv | AT tiffanyckkwok gazebaseddetectionofmindwanderingduringaudioguidedpanoramaviewing AT peterkiefer gazebaseddetectionofmindwanderingduringaudioguidedpanoramaviewing AT victorrschinazi gazebaseddetectionofmindwanderingduringaudioguidedpanoramaviewing AT christophhoelscher gazebaseddetectionofmindwanderingduringaudioguidedpanoramaviewing AT martinraubal gazebaseddetectionofmindwanderingduringaudioguidedpanoramaviewing |