The ballad of the bots: sonification using cognitive metaphor to support immersed teleoperation of robot teams
As an embodied and spatial medium, virtual reality is proving an attractive proposition for robot teleoperation in hazardous environments. This paper examines a nuclear decommissioning scenario in which a simulated team of semi-autonomous robots are used to characterise a chamber within a virtual nu...
Saved in:
| Main Authors: | , , , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
Frontiers Media S.A.
2024-06-01
|
| Series: | Frontiers in Virtual Reality |
| Subjects: | |
| Online Access: | https://www.frontiersin.org/articles/10.3389/frvir.2024.1404865/full |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1846142503889141760 |
|---|---|
| author | Joe Simmons Paul Bremner Thomas J. Mitchell Thomas J. Mitchell Alison Bown Verity McIntosh Verity McIntosh |
| author_facet | Joe Simmons Paul Bremner Thomas J. Mitchell Thomas J. Mitchell Alison Bown Verity McIntosh Verity McIntosh |
| author_sort | Joe Simmons |
| collection | DOAJ |
| description | As an embodied and spatial medium, virtual reality is proving an attractive proposition for robot teleoperation in hazardous environments. This paper examines a nuclear decommissioning scenario in which a simulated team of semi-autonomous robots are used to characterise a chamber within a virtual nuclear facility. This study examines the potential utility and impact of sonification as a means of communicating salient operator data in such an environment. However, the question of what sound should be used and how it can be applied in different applications is far from resolved. This paper explores and compares two sonification design approaches. The first is inspired by the theory of cognitive metaphor to create sonifications that align with socially acquired contextual and ecological understanding of the application domain. The second adopts a computationalist approach using auditory mappings that are commonplace in the literature. The results suggest that the computationalist approach outperforms the cognitive metaphor approach in terms of predictability and mental workload. However, qualitative data analysis demonstrates that the cognitive metaphor approach resulted in sounds that were more intuitive, and were better implemented for spatialisation of data sources and data legibility when there was more than one sound source. |
| format | Article |
| id | doaj-art-b6c991f17f064b75a35aae711922caac |
| institution | Kabale University |
| issn | 2673-4192 |
| language | English |
| publishDate | 2024-06-01 |
| publisher | Frontiers Media S.A. |
| record_format | Article |
| series | Frontiers in Virtual Reality |
| spelling | doaj-art-b6c991f17f064b75a35aae711922caac2024-12-03T11:08:45ZengFrontiers Media S.A.Frontiers in Virtual Reality2673-41922024-06-01510.3389/frvir.2024.14048651404865The ballad of the bots: sonification using cognitive metaphor to support immersed teleoperation of robot teamsJoe Simmons0Paul Bremner1Thomas J. Mitchell2Thomas J. Mitchell3Alison Bown4Verity McIntosh5Verity McIntosh6Bristol VR Lab, University of the West of England, Bristol, United KingdomBristol Robotics Laboratory, University of the West of England, Bristol, United KingdomDigital Cultures Research Centre, University of the West of England, Bristol, United KingdomCreative Technologies Lab, University of the West of England, Bristol, United Kingdom Technologies Lab, University of the West of England, Bristol, United KingdomBristol VR Lab, University of the West of England, Bristol, United KingdomBristol VR Lab, University of the West of England, Bristol, United KingdomDigital Cultures Research Centre, University of the West of England, Bristol, United KingdomAs an embodied and spatial medium, virtual reality is proving an attractive proposition for robot teleoperation in hazardous environments. This paper examines a nuclear decommissioning scenario in which a simulated team of semi-autonomous robots are used to characterise a chamber within a virtual nuclear facility. This study examines the potential utility and impact of sonification as a means of communicating salient operator data in such an environment. However, the question of what sound should be used and how it can be applied in different applications is far from resolved. This paper explores and compares two sonification design approaches. The first is inspired by the theory of cognitive metaphor to create sonifications that align with socially acquired contextual and ecological understanding of the application domain. The second adopts a computationalist approach using auditory mappings that are commonplace in the literature. The results suggest that the computationalist approach outperforms the cognitive metaphor approach in terms of predictability and mental workload. However, qualitative data analysis demonstrates that the cognitive metaphor approach resulted in sounds that were more intuitive, and were better implemented for spatialisation of data sources and data legibility when there was more than one sound source.https://www.frontiersin.org/articles/10.3389/frvir.2024.1404865/fullvirtual realitysonificationroboticsnuclear decommissioningteleoperation |
| spellingShingle | Joe Simmons Paul Bremner Thomas J. Mitchell Thomas J. Mitchell Alison Bown Verity McIntosh Verity McIntosh The ballad of the bots: sonification using cognitive metaphor to support immersed teleoperation of robot teams Frontiers in Virtual Reality virtual reality sonification robotics nuclear decommissioning teleoperation |
| title | The ballad of the bots: sonification using cognitive metaphor to support immersed teleoperation of robot teams |
| title_full | The ballad of the bots: sonification using cognitive metaphor to support immersed teleoperation of robot teams |
| title_fullStr | The ballad of the bots: sonification using cognitive metaphor to support immersed teleoperation of robot teams |
| title_full_unstemmed | The ballad of the bots: sonification using cognitive metaphor to support immersed teleoperation of robot teams |
| title_short | The ballad of the bots: sonification using cognitive metaphor to support immersed teleoperation of robot teams |
| title_sort | ballad of the bots sonification using cognitive metaphor to support immersed teleoperation of robot teams |
| topic | virtual reality sonification robotics nuclear decommissioning teleoperation |
| url | https://www.frontiersin.org/articles/10.3389/frvir.2024.1404865/full |
| work_keys_str_mv | AT joesimmons theballadofthebotssonificationusingcognitivemetaphortosupportimmersedteleoperationofrobotteams AT paulbremner theballadofthebotssonificationusingcognitivemetaphortosupportimmersedteleoperationofrobotteams AT thomasjmitchell theballadofthebotssonificationusingcognitivemetaphortosupportimmersedteleoperationofrobotteams AT thomasjmitchell theballadofthebotssonificationusingcognitivemetaphortosupportimmersedteleoperationofrobotteams AT alisonbown theballadofthebotssonificationusingcognitivemetaphortosupportimmersedteleoperationofrobotteams AT veritymcintosh theballadofthebotssonificationusingcognitivemetaphortosupportimmersedteleoperationofrobotteams AT veritymcintosh theballadofthebotssonificationusingcognitivemetaphortosupportimmersedteleoperationofrobotteams AT joesimmons balladofthebotssonificationusingcognitivemetaphortosupportimmersedteleoperationofrobotteams AT paulbremner balladofthebotssonificationusingcognitivemetaphortosupportimmersedteleoperationofrobotteams AT thomasjmitchell balladofthebotssonificationusingcognitivemetaphortosupportimmersedteleoperationofrobotteams AT thomasjmitchell balladofthebotssonificationusingcognitivemetaphortosupportimmersedteleoperationofrobotteams AT alisonbown balladofthebotssonificationusingcognitivemetaphortosupportimmersedteleoperationofrobotteams AT veritymcintosh balladofthebotssonificationusingcognitivemetaphortosupportimmersedteleoperationofrobotteams AT veritymcintosh balladofthebotssonificationusingcognitivemetaphortosupportimmersedteleoperationofrobotteams |