Automatic piano performance interaction system based on greedy algorithm for dexterous manipulator

With continuous advancements in artificial intelligence (AI), automatic piano-playing robots have become subjects of cross-disciplinary interest. However, in most studies, these robots served merely as objects of observation with limited user engagement or interaction. To address this issue, we prop...

Full description

Saved in:
Bibliographic Details
Main Authors: Yufei Wang, Junfeng Yao, Yalan Zhou, Zefeng Wang
Format: Article
Language:English
Published: KeAi Communications Co., Ltd. 2024-12-01
Series:Virtual Reality & Intelligent Hardware
Subjects:
Online Access:http://www.sciencedirect.com/science/article/pii/S2096579624000548
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1846099097713377280
author Yufei Wang
Junfeng Yao
Yalan Zhou
Zefeng Wang
author_facet Yufei Wang
Junfeng Yao
Yalan Zhou
Zefeng Wang
author_sort Yufei Wang
collection DOAJ
description With continuous advancements in artificial intelligence (AI), automatic piano-playing robots have become subjects of cross-disciplinary interest. However, in most studies, these robots served merely as objects of observation with limited user engagement or interaction. To address this issue, we propose a user-friendly and innovative interaction system based on the principles of greedy algorithms. This system features three modules: score management, performance control, and keyboard interactions. Upon importing a custom score or playing a note via an external device, the system performs on a virtual piano in line with user inputs. This system has been successfully integrated into our dexterous manipulator-based piano-playing device, which significantly enhances user interactions.
format Article
id doaj-art-8c74dfd552f34e6ebfc6c3e3880da3a8
institution Kabale University
issn 2096-5796
language English
publishDate 2024-12-01
publisher KeAi Communications Co., Ltd.
record_format Article
series Virtual Reality & Intelligent Hardware
spelling doaj-art-8c74dfd552f34e6ebfc6c3e3880da3a82025-01-01T05:10:13ZengKeAi Communications Co., Ltd.Virtual Reality & Intelligent Hardware2096-57962024-12-0166473485Automatic piano performance interaction system based on greedy algorithm for dexterous manipulatorYufei Wang0Junfeng Yao1Yalan Zhou2Zefeng Wang3Center for Digital Media Computing, School of Film, Xiamen University, Xiamen 361005, ChinaCenter for Digital Media Computing, School of Film, Xiamen University, Xiamen 361005, China; Institute of Artificial Intelligence, Xiamen University, Xiamen 361005, China; School of Informatics, Xiamen University, Xiamen 361005, China; Key Laboratory of Digital Protection and Intelligent Processing of Intangible Cultural Heritage of Fujian and Taiwan Ministry of Culture and Tourism, Xiamen 361005, China; Corresponding author.School of Informatics, Xiamen University, Xiamen 361005, ChinaCenter for Digital Media Computing, School of Film, Xiamen University, Xiamen 361005, ChinaWith continuous advancements in artificial intelligence (AI), automatic piano-playing robots have become subjects of cross-disciplinary interest. However, in most studies, these robots served merely as objects of observation with limited user engagement or interaction. To address this issue, we propose a user-friendly and innovative interaction system based on the principles of greedy algorithms. This system features three modules: score management, performance control, and keyboard interactions. Upon importing a custom score or playing a note via an external device, the system performs on a virtual piano in line with user inputs. This system has been successfully integrated into our dexterous manipulator-based piano-playing device, which significantly enhances user interactions.http://www.sciencedirect.com/science/article/pii/S2096579624000548Human-robot interactionPiano-playing robotGreedy algorithmScore parsing
spellingShingle Yufei Wang
Junfeng Yao
Yalan Zhou
Zefeng Wang
Automatic piano performance interaction system based on greedy algorithm for dexterous manipulator
Virtual Reality & Intelligent Hardware
Human-robot interaction
Piano-playing robot
Greedy algorithm
Score parsing
title Automatic piano performance interaction system based on greedy algorithm for dexterous manipulator
title_full Automatic piano performance interaction system based on greedy algorithm for dexterous manipulator
title_fullStr Automatic piano performance interaction system based on greedy algorithm for dexterous manipulator
title_full_unstemmed Automatic piano performance interaction system based on greedy algorithm for dexterous manipulator
title_short Automatic piano performance interaction system based on greedy algorithm for dexterous manipulator
title_sort automatic piano performance interaction system based on greedy algorithm for dexterous manipulator
topic Human-robot interaction
Piano-playing robot
Greedy algorithm
Score parsing
url http://www.sciencedirect.com/science/article/pii/S2096579624000548
work_keys_str_mv AT yufeiwang automaticpianoperformanceinteractionsystembasedongreedyalgorithmfordexterousmanipulator
AT junfengyao automaticpianoperformanceinteractionsystembasedongreedyalgorithmfordexterousmanipulator
AT yalanzhou automaticpianoperformanceinteractionsystembasedongreedyalgorithmfordexterousmanipulator
AT zefengwang automaticpianoperformanceinteractionsystembasedongreedyalgorithmfordexterousmanipulator