Collider-based movement detection and control of wearable soft robots for visually augmenting dance performance
The fusion of wearable soft robotic actuators and motion-tracking sensors can enhance dance performance, amplifying its visual language and communicative potential. However, the intricate and unpredictable nature of improvisational dance poses unique challenges for existing motion-tracking methods,...
Saved in:
| Main Authors: | , , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
Frontiers Media S.A.
2024-11-01
|
| Series: | Frontiers in Robotics and AI |
| Subjects: | |
| Online Access: | https://www.frontiersin.org/articles/10.3389/frobt.2024.1450177/full |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1846149949330292736 |
|---|---|
| author | Patrick Twomey Vaibhavsingh Varma Leslie L. Bush Mitja Trkov |
| author_facet | Patrick Twomey Vaibhavsingh Varma Leslie L. Bush Mitja Trkov |
| author_sort | Patrick Twomey |
| collection | DOAJ |
| description | The fusion of wearable soft robotic actuators and motion-tracking sensors can enhance dance performance, amplifying its visual language and communicative potential. However, the intricate and unpredictable nature of improvisational dance poses unique challenges for existing motion-tracking methods, underscoring the need for more adaptable solutions. Conventional methods such as optical tracking face limitations due to limb occlusion. The use of inertial measurement units (IMUs) can alleviate some of these challenges; however, their movement detection algorithms are complex and often based on fixed thresholds. Additionally, machine learning algorithms are unsuitable for detecting the arbitrary motion of improvisational dancers due to the non-repetitive and unique nature of their movements, resulting in limited available training data. To address these challenges, we introduce a collider-based movement detection algorithm. Colliders are modeled as virtual mass-spring-damper systems with its response related to dynamics of limb segments. Individual colliders are defined in planes corresponding to the limbs’ degrees of freedom. The system responses of these colliders relate to limb dynamics and can be used to quantify dynamic movements such as jab as demonstrated herein. One key advantage of collider dynamics is their ability to capture complex limb movements in their relative frame, as opposed to the global frame, thus avoiding drift issues common with IMUs. Additionally, we propose a simplified movement detection scheme based on individual dynamic system response variable, as opposed to fixed thresholds that consider multiple variables simultaneously (i.e., displacement, velocity, and acceleration). Our approach combines the collider-based algorithm with a hashing method to design a robust and high-speed detection algorithm for improvised dance motions. Experimental results demonstrate that our algorithm effectively detects improvisational dance movements, allowing control of wearable, origami-based soft actuators that can change size and lighting based on detected movements. This innovative method allows dancers to trigger events on stage, creating a unique organic aesthetics that seamlessly integrates technology with spontaneous movements. Our research highlights how this approach not only enriches dance performances by blending tradition and innovation but also enhances the expressive capabilities of dance, demonstrating the potential for technology to elevate and augment this art form. |
| format | Article |
| id | doaj-art-4b63861e5aba42469b5a3f0fab89452f |
| institution | Kabale University |
| issn | 2296-9144 |
| language | English |
| publishDate | 2024-11-01 |
| publisher | Frontiers Media S.A. |
| record_format | Article |
| series | Frontiers in Robotics and AI |
| spelling | doaj-art-4b63861e5aba42469b5a3f0fab89452f2024-11-29T08:39:26ZengFrontiers Media S.A.Frontiers in Robotics and AI2296-91442024-11-011110.3389/frobt.2024.14501771450177Collider-based movement detection and control of wearable soft robots for visually augmenting dance performancePatrick Twomey0Vaibhavsingh Varma1Leslie L. Bush2Mitja Trkov3Department of Mechanical Engineering, Henry M. Rowan College of Engineering, Rowan University, Glassboro, NJ, United StatesDepartment of Mechanical Engineering, Henry M. Rowan College of Engineering, Rowan University, Glassboro, NJ, United StatesDepartment of Theatre and Dance, College of Performing Arts, Rowan University, Glassboro, NJ, United StatesDepartment of Mechanical Engineering, Henry M. Rowan College of Engineering, Rowan University, Glassboro, NJ, United StatesThe fusion of wearable soft robotic actuators and motion-tracking sensors can enhance dance performance, amplifying its visual language and communicative potential. However, the intricate and unpredictable nature of improvisational dance poses unique challenges for existing motion-tracking methods, underscoring the need for more adaptable solutions. Conventional methods such as optical tracking face limitations due to limb occlusion. The use of inertial measurement units (IMUs) can alleviate some of these challenges; however, their movement detection algorithms are complex and often based on fixed thresholds. Additionally, machine learning algorithms are unsuitable for detecting the arbitrary motion of improvisational dancers due to the non-repetitive and unique nature of their movements, resulting in limited available training data. To address these challenges, we introduce a collider-based movement detection algorithm. Colliders are modeled as virtual mass-spring-damper systems with its response related to dynamics of limb segments. Individual colliders are defined in planes corresponding to the limbs’ degrees of freedom. The system responses of these colliders relate to limb dynamics and can be used to quantify dynamic movements such as jab as demonstrated herein. One key advantage of collider dynamics is their ability to capture complex limb movements in their relative frame, as opposed to the global frame, thus avoiding drift issues common with IMUs. Additionally, we propose a simplified movement detection scheme based on individual dynamic system response variable, as opposed to fixed thresholds that consider multiple variables simultaneously (i.e., displacement, velocity, and acceleration). Our approach combines the collider-based algorithm with a hashing method to design a robust and high-speed detection algorithm for improvised dance motions. Experimental results demonstrate that our algorithm effectively detects improvisational dance movements, allowing control of wearable, origami-based soft actuators that can change size and lighting based on detected movements. This innovative method allows dancers to trigger events on stage, creating a unique organic aesthetics that seamlessly integrates technology with spontaneous movements. Our research highlights how this approach not only enriches dance performances by blending tradition and innovation but also enhances the expressive capabilities of dance, demonstrating the potential for technology to elevate and augment this art form.https://www.frontiersin.org/articles/10.3389/frobt.2024.1450177/fullactivity recognitionmovement detectioncolliderswearable sensorsinertial measurement units (IMUs)soft robots |
| spellingShingle | Patrick Twomey Vaibhavsingh Varma Leslie L. Bush Mitja Trkov Collider-based movement detection and control of wearable soft robots for visually augmenting dance performance Frontiers in Robotics and AI activity recognition movement detection colliders wearable sensors inertial measurement units (IMUs) soft robots |
| title | Collider-based movement detection and control of wearable soft robots for visually augmenting dance performance |
| title_full | Collider-based movement detection and control of wearable soft robots for visually augmenting dance performance |
| title_fullStr | Collider-based movement detection and control of wearable soft robots for visually augmenting dance performance |
| title_full_unstemmed | Collider-based movement detection and control of wearable soft robots for visually augmenting dance performance |
| title_short | Collider-based movement detection and control of wearable soft robots for visually augmenting dance performance |
| title_sort | collider based movement detection and control of wearable soft robots for visually augmenting dance performance |
| topic | activity recognition movement detection colliders wearable sensors inertial measurement units (IMUs) soft robots |
| url | https://www.frontiersin.org/articles/10.3389/frobt.2024.1450177/full |
| work_keys_str_mv | AT patricktwomey colliderbasedmovementdetectionandcontrolofwearablesoftrobotsforvisuallyaugmentingdanceperformance AT vaibhavsinghvarma colliderbasedmovementdetectionandcontrolofwearablesoftrobotsforvisuallyaugmentingdanceperformance AT leslielbush colliderbasedmovementdetectionandcontrolofwearablesoftrobotsforvisuallyaugmentingdanceperformance AT mitjatrkov colliderbasedmovementdetectionandcontrolofwearablesoftrobotsforvisuallyaugmentingdanceperformance |