A Multimodal Assistive-Robotic-Arm Control System to Increase Independence After Tetraplegia

Following tetraplegia, independence for completing essential daily tasks, such as opening doors and eating, significantly declines. Assistive robotic manipulators (ARMs) could restore independence, but typically input devices for these manipulators require functional use of the hands. We created and...

Full description

Saved in:
Bibliographic Details
Main Authors: Taylor C. Hansen, Troy N. Tully, V. John Mathews, David J. Warren
Format: Article
Language:English
Published: IEEE 2024-01-01
Series:IEEE Transactions on Neural Systems and Rehabilitation Engineering
Subjects:
Online Access:https://ieeexplore.ieee.org/document/10547059/
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1841563394116681728
author Taylor C. Hansen
Troy N. Tully
V. John Mathews
David J. Warren
author_facet Taylor C. Hansen
Troy N. Tully
V. John Mathews
David J. Warren
author_sort Taylor C. Hansen
collection DOAJ
description Following tetraplegia, independence for completing essential daily tasks, such as opening doors and eating, significantly declines. Assistive robotic manipulators (ARMs) could restore independence, but typically input devices for these manipulators require functional use of the hands. We created and validated a hands-free multimodal input system for controlling an ARM in virtual reality using combinations of a gyroscope, eye-tracking, and heterologous surface electromyography (sEMG). These input modalities are mapped to ARM functions based on the user’s preferences and to maximize the utility of their residual volitional capabilities following tetraplegia. The two participants in this study with tetraplegia preferred to use the control mapping with sEMG button functions and disliked winking commands. Non-disabled participants were more varied in their preferences and performance, further suggesting that customizability is an advantageous component of the control system. Replacing buttons from a traditional handheld controller with sEMG did not substantively reduce performance. The system provided adequate control to all participants to complete functional tasks in virtual reality such as opening door handles, turning stove dials, eating, and drinking, all of which enable independence and improved quality of life for these individuals.
format Article
id doaj-art-cb5184591fd5489bbeb4df0938c42346
institution Kabale University
issn 1534-4320
1558-0210
language English
publishDate 2024-01-01
publisher IEEE
record_format Article
series IEEE Transactions on Neural Systems and Rehabilitation Engineering
spelling doaj-art-cb5184591fd5489bbeb4df0938c423462025-01-03T00:00:08ZengIEEEIEEE Transactions on Neural Systems and Rehabilitation Engineering1534-43201558-02102024-01-01322124213310.1109/TNSRE.2024.340883310547059A Multimodal Assistive-Robotic-Arm Control System to Increase Independence After TetraplegiaTaylor C. Hansen0https://orcid.org/0000-0003-3882-7946Troy N. Tully1https://orcid.org/0000-0001-6425-7655V. John Mathews2https://orcid.org/0000-0001-6873-4172David J. Warren3https://orcid.org/0000-0001-6216-931XDepartment of Biomedical Engineering, University of Utah, Salt Lake City, UT, USADepartment of Biomedical Engineering, University of Utah, Salt Lake City, UT, USASchool of Electrical Engineering and Computer Science, Oregon State University, Corvallis, OR, USADepartment of Biomedical Engineering, University of Utah, Salt Lake City, UT, USAFollowing tetraplegia, independence for completing essential daily tasks, such as opening doors and eating, significantly declines. Assistive robotic manipulators (ARMs) could restore independence, but typically input devices for these manipulators require functional use of the hands. We created and validated a hands-free multimodal input system for controlling an ARM in virtual reality using combinations of a gyroscope, eye-tracking, and heterologous surface electromyography (sEMG). These input modalities are mapped to ARM functions based on the user’s preferences and to maximize the utility of their residual volitional capabilities following tetraplegia. The two participants in this study with tetraplegia preferred to use the control mapping with sEMG button functions and disliked winking commands. Non-disabled participants were more varied in their preferences and performance, further suggesting that customizability is an advantageous component of the control system. Replacing buttons from a traditional handheld controller with sEMG did not substantively reduce performance. The system provided adequate control to all participants to complete functional tasks in virtual reality such as opening door handles, turning stove dials, eating, and drinking, all of which enable independence and improved quality of life for these individuals.https://ieeexplore.ieee.org/document/10547059/Assistive robotic technologyelectromyographyspinal cord injuryusability study
spellingShingle Taylor C. Hansen
Troy N. Tully
V. John Mathews
David J. Warren
A Multimodal Assistive-Robotic-Arm Control System to Increase Independence After Tetraplegia
IEEE Transactions on Neural Systems and Rehabilitation Engineering
Assistive robotic technology
electromyography
spinal cord injury
usability study
title A Multimodal Assistive-Robotic-Arm Control System to Increase Independence After Tetraplegia
title_full A Multimodal Assistive-Robotic-Arm Control System to Increase Independence After Tetraplegia
title_fullStr A Multimodal Assistive-Robotic-Arm Control System to Increase Independence After Tetraplegia
title_full_unstemmed A Multimodal Assistive-Robotic-Arm Control System to Increase Independence After Tetraplegia
title_short A Multimodal Assistive-Robotic-Arm Control System to Increase Independence After Tetraplegia
title_sort multimodal assistive robotic arm control system to increase independence after tetraplegia
topic Assistive robotic technology
electromyography
spinal cord injury
usability study
url https://ieeexplore.ieee.org/document/10547059/
work_keys_str_mv AT taylorchansen amultimodalassistiveroboticarmcontrolsystemtoincreaseindependenceaftertetraplegia
AT troyntully amultimodalassistiveroboticarmcontrolsystemtoincreaseindependenceaftertetraplegia
AT vjohnmathews amultimodalassistiveroboticarmcontrolsystemtoincreaseindependenceaftertetraplegia
AT davidjwarren amultimodalassistiveroboticarmcontrolsystemtoincreaseindependenceaftertetraplegia
AT taylorchansen multimodalassistiveroboticarmcontrolsystemtoincreaseindependenceaftertetraplegia
AT troyntully multimodalassistiveroboticarmcontrolsystemtoincreaseindependenceaftertetraplegia
AT vjohnmathews multimodalassistiveroboticarmcontrolsystemtoincreaseindependenceaftertetraplegia
AT davidjwarren multimodalassistiveroboticarmcontrolsystemtoincreaseindependenceaftertetraplegia