Mormyroidea-inspired electronic skin for active non-contact three-dimensional tracking and sensing

Abstract The capacity to discern and locate positions in three-dimensional space is crucial for human-machine interfaces and robotic perception. However, current soft electronics can only obtain two-dimensional spatial locations through physical contact. In this study, we report a non-contact positi...

Full description

Saved in:
Bibliographic Details
Main Authors: Jingkun Zhou, Jian Li, Huiling Jia, Kuanming Yao, Shengxin Jia, Jiyu Li, Guangyao Zhao, Chun Ki Yiu, Zhan Gao, Dengfeng Li, Binbin Zhang, Ya Huang, Qiuna Zhuang, Yawen Yang, Xingcan Huang, Mengge Wu, Yiming Liu, Yuyu Gao, Hu Li, Yue Hu, Rui Shi, Meenakshi Mukherji, Zijian Zheng, Xinge Yu
Format: Article
Language:English
Published: Nature Portfolio 2024-11-01
Series:Nature Communications
Online Access:https://doi.org/10.1038/s41467-024-54249-3
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1846165029124046848
author Jingkun Zhou
Jian Li
Huiling Jia
Kuanming Yao
Shengxin Jia
Jiyu Li
Guangyao Zhao
Chun Ki Yiu
Zhan Gao
Dengfeng Li
Binbin Zhang
Ya Huang
Qiuna Zhuang
Yawen Yang
Xingcan Huang
Mengge Wu
Yiming Liu
Yuyu Gao
Hu Li
Yue Hu
Rui Shi
Meenakshi Mukherji
Zijian Zheng
Xinge Yu
author_facet Jingkun Zhou
Jian Li
Huiling Jia
Kuanming Yao
Shengxin Jia
Jiyu Li
Guangyao Zhao
Chun Ki Yiu
Zhan Gao
Dengfeng Li
Binbin Zhang
Ya Huang
Qiuna Zhuang
Yawen Yang
Xingcan Huang
Mengge Wu
Yiming Liu
Yuyu Gao
Hu Li
Yue Hu
Rui Shi
Meenakshi Mukherji
Zijian Zheng
Xinge Yu
author_sort Jingkun Zhou
collection DOAJ
description Abstract The capacity to discern and locate positions in three-dimensional space is crucial for human-machine interfaces and robotic perception. However, current soft electronics can only obtain two-dimensional spatial locations through physical contact. In this study, we report a non-contact position targeting concept enabled by transparent and thin soft electronic skin (E-skin) with three-dimensional sensing capabilities. Inspired by the active electrosensation of mormyroidea fish, this E-skin actively ascertains the 3D positions of targeted objects in a contactless manner and can wirelessly convey the corresponding positions to other devices in real-time. Consequently, this E-skin readily enables interaction with machines, i.e., manipulating virtual objects, controlling robotic arms, and drones in either virtual or actual 3D space. Additionally, it can be integrated with robots to provide them with 3D situational awareness for perceiving their surroundings, avoiding obstacles, or tracking targets.
format Article
id doaj-art-274fb608f9564bb994cc5e79ee2771e2
institution Kabale University
issn 2041-1723
language English
publishDate 2024-11-01
publisher Nature Portfolio
record_format Article
series Nature Communications
spelling doaj-art-274fb608f9564bb994cc5e79ee2771e22024-11-17T12:37:27ZengNature PortfolioNature Communications2041-17232024-11-0115111410.1038/s41467-024-54249-3Mormyroidea-inspired electronic skin for active non-contact three-dimensional tracking and sensingJingkun Zhou0Jian Li1Huiling Jia2Kuanming Yao3Shengxin Jia4Jiyu Li5Guangyao Zhao6Chun Ki Yiu7Zhan Gao8Dengfeng Li9Binbin Zhang10Ya Huang11Qiuna Zhuang12Yawen Yang13Xingcan Huang14Mengge Wu15Yiming Liu16Yuyu Gao17Hu Li18Yue Hu19Rui Shi20Meenakshi Mukherji21Zijian Zheng22Xinge Yu23Department of Biomedical Engineering, City University of Hong KongDepartment of Biomedical Engineering, City University of Hong KongDepartment of Biomedical Engineering, City University of Hong KongDepartment of Biomedical Engineering, City University of Hong KongDepartment of Biomedical Engineering, City University of Hong KongDepartment of Biomedical Engineering, City University of Hong KongDepartment of Biomedical Engineering, City University of Hong KongDepartment of Biomedical Engineering, City University of Hong KongDepartment of Biomedical Engineering, City University of Hong KongDepartment of Biomedical Engineering, City University of Hong KongDepartment of Biomedical Engineering, City University of Hong KongDepartment of Biomedical Engineering, City University of Hong KongLaboratory for Advanced Interfacial Materials and Devices, Department of Applied Biology and Chemical Technology, The Hong Kong Polytechnic UniversityDepartment of Biomedical Engineering, City University of Hong KongDepartment of Biomedical Engineering, City University of Hong KongDepartment of Biomedical Engineering, City University of Hong KongDepartment of Biomedical Engineering, City University of Hong KongDepartment of Biomedical Engineering, City University of Hong KongDepartment of Biomedical Engineering, City University of Hong KongDepartment of Biomedical Engineering, City University of Hong KongDepartment of Biomedical Engineering, City University of Hong KongDepartment of Electrical Engineering, City University of Hong KongLaboratory for Advanced Interfacial Materials and Devices, Department of Applied Biology and Chemical Technology, The Hong Kong Polytechnic UniversityDepartment of Biomedical Engineering, City University of Hong KongAbstract The capacity to discern and locate positions in three-dimensional space is crucial for human-machine interfaces and robotic perception. However, current soft electronics can only obtain two-dimensional spatial locations through physical contact. In this study, we report a non-contact position targeting concept enabled by transparent and thin soft electronic skin (E-skin) with three-dimensional sensing capabilities. Inspired by the active electrosensation of mormyroidea fish, this E-skin actively ascertains the 3D positions of targeted objects in a contactless manner and can wirelessly convey the corresponding positions to other devices in real-time. Consequently, this E-skin readily enables interaction with machines, i.e., manipulating virtual objects, controlling robotic arms, and drones in either virtual or actual 3D space. Additionally, it can be integrated with robots to provide them with 3D situational awareness for perceiving their surroundings, avoiding obstacles, or tracking targets.https://doi.org/10.1038/s41467-024-54249-3
spellingShingle Jingkun Zhou
Jian Li
Huiling Jia
Kuanming Yao
Shengxin Jia
Jiyu Li
Guangyao Zhao
Chun Ki Yiu
Zhan Gao
Dengfeng Li
Binbin Zhang
Ya Huang
Qiuna Zhuang
Yawen Yang
Xingcan Huang
Mengge Wu
Yiming Liu
Yuyu Gao
Hu Li
Yue Hu
Rui Shi
Meenakshi Mukherji
Zijian Zheng
Xinge Yu
Mormyroidea-inspired electronic skin for active non-contact three-dimensional tracking and sensing
Nature Communications
title Mormyroidea-inspired electronic skin for active non-contact three-dimensional tracking and sensing
title_full Mormyroidea-inspired electronic skin for active non-contact three-dimensional tracking and sensing
title_fullStr Mormyroidea-inspired electronic skin for active non-contact three-dimensional tracking and sensing
title_full_unstemmed Mormyroidea-inspired electronic skin for active non-contact three-dimensional tracking and sensing
title_short Mormyroidea-inspired electronic skin for active non-contact three-dimensional tracking and sensing
title_sort mormyroidea inspired electronic skin for active non contact three dimensional tracking and sensing
url https://doi.org/10.1038/s41467-024-54249-3
work_keys_str_mv AT jingkunzhou mormyroideainspiredelectronicskinforactivenoncontactthreedimensionaltrackingandsensing
AT jianli mormyroideainspiredelectronicskinforactivenoncontactthreedimensionaltrackingandsensing
AT huilingjia mormyroideainspiredelectronicskinforactivenoncontactthreedimensionaltrackingandsensing
AT kuanmingyao mormyroideainspiredelectronicskinforactivenoncontactthreedimensionaltrackingandsensing
AT shengxinjia mormyroideainspiredelectronicskinforactivenoncontactthreedimensionaltrackingandsensing
AT jiyuli mormyroideainspiredelectronicskinforactivenoncontactthreedimensionaltrackingandsensing
AT guangyaozhao mormyroideainspiredelectronicskinforactivenoncontactthreedimensionaltrackingandsensing
AT chunkiyiu mormyroideainspiredelectronicskinforactivenoncontactthreedimensionaltrackingandsensing
AT zhangao mormyroideainspiredelectronicskinforactivenoncontactthreedimensionaltrackingandsensing
AT dengfengli mormyroideainspiredelectronicskinforactivenoncontactthreedimensionaltrackingandsensing
AT binbinzhang mormyroideainspiredelectronicskinforactivenoncontactthreedimensionaltrackingandsensing
AT yahuang mormyroideainspiredelectronicskinforactivenoncontactthreedimensionaltrackingandsensing
AT qiunazhuang mormyroideainspiredelectronicskinforactivenoncontactthreedimensionaltrackingandsensing
AT yawenyang mormyroideainspiredelectronicskinforactivenoncontactthreedimensionaltrackingandsensing
AT xingcanhuang mormyroideainspiredelectronicskinforactivenoncontactthreedimensionaltrackingandsensing
AT menggewu mormyroideainspiredelectronicskinforactivenoncontactthreedimensionaltrackingandsensing
AT yimingliu mormyroideainspiredelectronicskinforactivenoncontactthreedimensionaltrackingandsensing
AT yuyugao mormyroideainspiredelectronicskinforactivenoncontactthreedimensionaltrackingandsensing
AT huli mormyroideainspiredelectronicskinforactivenoncontactthreedimensionaltrackingandsensing
AT yuehu mormyroideainspiredelectronicskinforactivenoncontactthreedimensionaltrackingandsensing
AT ruishi mormyroideainspiredelectronicskinforactivenoncontactthreedimensionaltrackingandsensing
AT meenakshimukherji mormyroideainspiredelectronicskinforactivenoncontactthreedimensionaltrackingandsensing
AT zijianzheng mormyroideainspiredelectronicskinforactivenoncontactthreedimensionaltrackingandsensing
AT xingeyu mormyroideainspiredelectronicskinforactivenoncontactthreedimensionaltrackingandsensing