Current status and application of visual-tactile sensing technology
Visual tactile fusion sensing technology is an integrated sensor biomimetic technology that combines visual camera image information and tactile sensor perception information of objects and environments, inspired by the coordinated regulation of human visual and tactile movements and behaviors. With...
Saved in:
Main Authors: | , , , , |
---|---|
Format: | Article |
Language: | zho |
Published: |
Hebei University of Science and Technology
2024-12-01
|
Series: | Journal of Hebei University of Science and Technology |
Subjects: | |
Online Access: | https://xuebao.hebust.edu.cn/hbkjdx/article/pdf/b202406009?st=article_issue |
Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
_version_ | 1841559962605584384 |
---|---|
author | Bin WEI Zihao WANG Ping WANG Jie LI Guang LIU |
author_facet | Bin WEI Zihao WANG Ping WANG Jie LI Guang LIU |
author_sort | Bin WEI |
collection | DOAJ |
description | Visual tactile fusion sensing technology is an integrated sensor biomimetic technology that combines visual camera image information and tactile sensor perception information of objects and environments, inspired by the coordinated regulation of human visual and tactile movements and behaviors. With the development of computer vision, neural networks, and tactile perception technology, the introduction of visual touch fusion sensing technology in the control and working process of intelligent robots has gradually become a research hotspot. The basic principles and development status of visual tactile sensors was summarized based on different tactile sensing modes, including diffuse reflection of light rays in reflective layers, tracking and detection of marked points/objects, optical waveguides, and bionics. At the same time, the application status of visual touch fusion sensors in object recognition and detection, object slip and grasping stability detection, and robot grasping fields was summarized. Finally, the following prospects were proposed for visual touch fusion technology: 1) development of multimodal perception technology; 2) innovation in human-computer interaction methods; 3) improvement of control accuracy for intelligent robots; 4) drive the consumption of electronic products. |
format | Article |
id | doaj-art-0492b1cd9cee4767bc4efece8eee8acd |
institution | Kabale University |
issn | 1008-1542 |
language | zho |
publishDate | 2024-12-01 |
publisher | Hebei University of Science and Technology |
record_format | Article |
series | Journal of Hebei University of Science and Technology |
spelling | doaj-art-0492b1cd9cee4767bc4efece8eee8acd2025-01-05T06:35:22ZzhoHebei University of Science and TechnologyJournal of Hebei University of Science and Technology1008-15422024-12-0145664465210.7535/hbkd.2024yx06009b202406009Current status and application of visual-tactile sensing technologyBin WEI0Zihao WANG1Ping WANG2Jie LI3Guang LIU4School of Mechanical Engineering, Hebei University of Science and Technology, Shijiazhuang, Hebei 050018, ChinaSchool of Mechanical Engineering, Hebei University of Science and Technology, Shijiazhuang, Hebei 050018, ChinaSchool of Mechanical Engineering, Hebei University of Science and Technology, Shijiazhuang, Hebei 050018, ChinaTeaching Affairs Office, Shijiazhuang Information Engineering Vocational College, Shijiazhuang, Hebei 050035, ChinaSchool of Mechanical Engineering, Hebei University of Science and Technology, Shijiazhuang, Hebei 050018, ChinaVisual tactile fusion sensing technology is an integrated sensor biomimetic technology that combines visual camera image information and tactile sensor perception information of objects and environments, inspired by the coordinated regulation of human visual and tactile movements and behaviors. With the development of computer vision, neural networks, and tactile perception technology, the introduction of visual touch fusion sensing technology in the control and working process of intelligent robots has gradually become a research hotspot. The basic principles and development status of visual tactile sensors was summarized based on different tactile sensing modes, including diffuse reflection of light rays in reflective layers, tracking and detection of marked points/objects, optical waveguides, and bionics. At the same time, the application status of visual touch fusion sensors in object recognition and detection, object slip and grasping stability detection, and robot grasping fields was summarized. Finally, the following prospects were proposed for visual touch fusion technology: 1) development of multimodal perception technology; 2) innovation in human-computer interaction methods; 3) improvement of control accuracy for intelligent robots; 4) drive the consumption of electronic products.https://xuebao.hebust.edu.cn/hbkjdx/article/pdf/b202406009?st=article_issuesensor technology; visual and tactile fusion; computer vision; robot perception; bionics |
spellingShingle | Bin WEI Zihao WANG Ping WANG Jie LI Guang LIU Current status and application of visual-tactile sensing technology Journal of Hebei University of Science and Technology sensor technology; visual and tactile fusion; computer vision; robot perception; bionics |
title | Current status and application of visual-tactile sensing technology |
title_full | Current status and application of visual-tactile sensing technology |
title_fullStr | Current status and application of visual-tactile sensing technology |
title_full_unstemmed | Current status and application of visual-tactile sensing technology |
title_short | Current status and application of visual-tactile sensing technology |
title_sort | current status and application of visual tactile sensing technology |
topic | sensor technology; visual and tactile fusion; computer vision; robot perception; bionics |
url | https://xuebao.hebust.edu.cn/hbkjdx/article/pdf/b202406009?st=article_issue |
work_keys_str_mv | AT binwei currentstatusandapplicationofvisualtactilesensingtechnology AT zihaowang currentstatusandapplicationofvisualtactilesensingtechnology AT pingwang currentstatusandapplicationofvisualtactilesensingtechnology AT jieli currentstatusandapplicationofvisualtactilesensingtechnology AT guangliu currentstatusandapplicationofvisualtactilesensingtechnology |