Integrating humanoid robots with human musicians for synchronized musical performances
Entertainment robotics has garnered significant attention in recent years, with researchers focusing on developing robots capable of performing a variety of tasks, including magic, drawing, dancing, and music. This article presents our research on forming a musical band that includes both humanoid r...
Saved in:
| Main Authors: | , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
PeerJ Inc.
2025-01-01
|
| Series: | PeerJ Computer Science |
| Subjects: | |
| Online Access: | https://peerj.com/articles/cs-2632.pdf |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1841559000119771136 |
|---|---|
| author | MengCheng Lau John Anderson Jacky Baltes |
| author_facet | MengCheng Lau John Anderson Jacky Baltes |
| author_sort | MengCheng Lau |
| collection | DOAJ |
| description | Entertainment robotics has garnered significant attention in recent years, with researchers focusing on developing robots capable of performing a variety of tasks, including magic, drawing, dancing, and music. This article presents our research on forming a musical band that includes both humanoid robots and human musicians, with the goal of achieving natural synchronization and collaboration during musical performances. We utilized two of our humanoid robots for this project: Polaris, a mid-sized humanoid robot, as the drummer, and Oscar, a Robotis-OP3 humanoid robot, as the keyboardist. The technical implementation incorporated essential components such as visual servoing, human-robot interaction, and Robot Operating System (ROS), enabling seamless communication and coordination between the humanoid robots and the human musicians. The success of this collaborative effort can be both seen and heard through the following YouTube link: https://youtu.be/pFOyt1KKCfY?feature=shared. |
| format | Article |
| id | doaj-art-1fbde5ca2957442cbb2f15484898fa8c |
| institution | Kabale University |
| issn | 2376-5992 |
| language | English |
| publishDate | 2025-01-01 |
| publisher | PeerJ Inc. |
| record_format | Article |
| series | PeerJ Computer Science |
| spelling | doaj-art-1fbde5ca2957442cbb2f15484898fa8c2025-01-05T15:05:14ZengPeerJ Inc.PeerJ Computer Science2376-59922025-01-0111e263210.7717/peerj-cs.2632Integrating humanoid robots with human musicians for synchronized musical performancesMengCheng Lau0John Anderson1Jacky Baltes2Bharti School of Engineering and Computer Science, Laurentian University, Sudbury, Ontario, CanadaDepartment of Computer Science, University of Manitoba, Winnipeg, Manitoba, CanadaDepartment of Electrical Engineering, National Taiwan Normal University, Taipei, TaiwanEntertainment robotics has garnered significant attention in recent years, with researchers focusing on developing robots capable of performing a variety of tasks, including magic, drawing, dancing, and music. This article presents our research on forming a musical band that includes both humanoid robots and human musicians, with the goal of achieving natural synchronization and collaboration during musical performances. We utilized two of our humanoid robots for this project: Polaris, a mid-sized humanoid robot, as the drummer, and Oscar, a Robotis-OP3 humanoid robot, as the keyboardist. The technical implementation incorporated essential components such as visual servoing, human-robot interaction, and Robot Operating System (ROS), enabling seamless communication and coordination between the humanoid robots and the human musicians. The success of this collaborative effort can be both seen and heard through the following YouTube link: https://youtu.be/pFOyt1KKCfY?feature=shared.https://peerj.com/articles/cs-2632.pdfRobot musicianHuman-robot interactionVisual servoingSynchronization |
| spellingShingle | MengCheng Lau John Anderson Jacky Baltes Integrating humanoid robots with human musicians for synchronized musical performances PeerJ Computer Science Robot musician Human-robot interaction Visual servoing Synchronization |
| title | Integrating humanoid robots with human musicians for synchronized musical performances |
| title_full | Integrating humanoid robots with human musicians for synchronized musical performances |
| title_fullStr | Integrating humanoid robots with human musicians for synchronized musical performances |
| title_full_unstemmed | Integrating humanoid robots with human musicians for synchronized musical performances |
| title_short | Integrating humanoid robots with human musicians for synchronized musical performances |
| title_sort | integrating humanoid robots with human musicians for synchronized musical performances |
| topic | Robot musician Human-robot interaction Visual servoing Synchronization |
| url | https://peerj.com/articles/cs-2632.pdf |
| work_keys_str_mv | AT mengchenglau integratinghumanoidrobotswithhumanmusiciansforsynchronizedmusicalperformances AT johnanderson integratinghumanoidrobotswithhumanmusiciansforsynchronizedmusicalperformances AT jackybaltes integratinghumanoidrobotswithhumanmusiciansforsynchronizedmusicalperformances |