Current status and application of visual-tactile sensing technology

Visual tactile fusion sensing technology is an integrated sensor biomimetic technology that combines visual camera image information and tactile sensor perception information of objects and environments, inspired by the coordinated regulation of human visual and tactile movements and behaviors. With...

Full description

Saved in:
Bibliographic Details
Main Authors: Bin WEI, Zihao WANG, Ping WANG, Jie LI, Guang LIU
Format: Article
Language:zho
Published: Hebei University of Science and Technology 2024-12-01
Series:Journal of Hebei University of Science and Technology
Subjects:
Online Access:https://xuebao.hebust.edu.cn/hbkjdx/article/pdf/b202406009?st=article_issue
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1841559962605584384
author Bin WEI
Zihao WANG
Ping WANG
Jie LI
Guang LIU
author_facet Bin WEI
Zihao WANG
Ping WANG
Jie LI
Guang LIU
author_sort Bin WEI
collection DOAJ
description Visual tactile fusion sensing technology is an integrated sensor biomimetic technology that combines visual camera image information and tactile sensor perception information of objects and environments, inspired by the coordinated regulation of human visual and tactile movements and behaviors. With the development of computer vision, neural networks, and tactile perception technology, the introduction of visual touch fusion sensing technology in the control and working process of intelligent robots has gradually become a research hotspot. The basic principles and development status of visual tactile sensors was summarized based on different tactile sensing modes, including diffuse reflection of light rays in reflective layers, tracking and detection of marked points/objects, optical waveguides, and bionics. At the same time, the application status of visual touch fusion sensors in object recognition and detection, object slip and grasping stability detection, and robot grasping fields was summarized. Finally, the following prospects were proposed for visual touch fusion technology: 1) development of multimodal perception technology; 2) innovation in human-computer interaction methods; 3) improvement of control accuracy for intelligent robots; 4) drive the consumption of electronic products.
format Article
id doaj-art-0492b1cd9cee4767bc4efece8eee8acd
institution Kabale University
issn 1008-1542
language zho
publishDate 2024-12-01
publisher Hebei University of Science and Technology
record_format Article
series Journal of Hebei University of Science and Technology
spelling doaj-art-0492b1cd9cee4767bc4efece8eee8acd2025-01-05T06:35:22ZzhoHebei University of Science and TechnologyJournal of Hebei University of Science and Technology1008-15422024-12-0145664465210.7535/hbkd.2024yx06009b202406009Current status and application of visual-tactile sensing technologyBin WEI0Zihao WANG1Ping WANG2Jie LI3Guang LIU4School of Mechanical Engineering, Hebei University of Science and Technology, Shijiazhuang, Hebei 050018, ChinaSchool of Mechanical Engineering, Hebei University of Science and Technology, Shijiazhuang, Hebei 050018, ChinaSchool of Mechanical Engineering, Hebei University of Science and Technology, Shijiazhuang, Hebei 050018, ChinaTeaching Affairs Office, Shijiazhuang Information Engineering Vocational College, Shijiazhuang, Hebei 050035, ChinaSchool of Mechanical Engineering, Hebei University of Science and Technology, Shijiazhuang, Hebei 050018, ChinaVisual tactile fusion sensing technology is an integrated sensor biomimetic technology that combines visual camera image information and tactile sensor perception information of objects and environments, inspired by the coordinated regulation of human visual and tactile movements and behaviors. With the development of computer vision, neural networks, and tactile perception technology, the introduction of visual touch fusion sensing technology in the control and working process of intelligent robots has gradually become a research hotspot. The basic principles and development status of visual tactile sensors was summarized based on different tactile sensing modes, including diffuse reflection of light rays in reflective layers, tracking and detection of marked points/objects, optical waveguides, and bionics. At the same time, the application status of visual touch fusion sensors in object recognition and detection, object slip and grasping stability detection, and robot grasping fields was summarized. Finally, the following prospects were proposed for visual touch fusion technology: 1) development of multimodal perception technology; 2) innovation in human-computer interaction methods; 3) improvement of control accuracy for intelligent robots; 4) drive the consumption of electronic products.https://xuebao.hebust.edu.cn/hbkjdx/article/pdf/b202406009?st=article_issuesensor technology; visual and tactile fusion; computer vision; robot perception; bionics
spellingShingle Bin WEI
Zihao WANG
Ping WANG
Jie LI
Guang LIU
Current status and application of visual-tactile sensing technology
Journal of Hebei University of Science and Technology
sensor technology; visual and tactile fusion; computer vision; robot perception; bionics
title Current status and application of visual-tactile sensing technology
title_full Current status and application of visual-tactile sensing technology
title_fullStr Current status and application of visual-tactile sensing technology
title_full_unstemmed Current status and application of visual-tactile sensing technology
title_short Current status and application of visual-tactile sensing technology
title_sort current status and application of visual tactile sensing technology
topic sensor technology; visual and tactile fusion; computer vision; robot perception; bionics
url https://xuebao.hebust.edu.cn/hbkjdx/article/pdf/b202406009?st=article_issue
work_keys_str_mv AT binwei currentstatusandapplicationofvisualtactilesensingtechnology
AT zihaowang currentstatusandapplicationofvisualtactilesensingtechnology
AT pingwang currentstatusandapplicationofvisualtactilesensingtechnology
AT jieli currentstatusandapplicationofvisualtactilesensingtechnology
AT guangliu currentstatusandapplicationofvisualtactilesensingtechnology