Faster R-CNN and 3D reconstruction for handling tasks implementing a Scara robot

This paper presents the design and results of using a deep learning algorithm for robotic manipulation in object handling tasks in a virtual industrial environment. The simulation tool used is V-REP and the environment corresponds to a production line based on a conveyor belt and a SCARA type robot...

Full description

Saved in:
Bibliographic Details
Main Authors: Julian Herrera-Benavidez, Cesar Pachón-Suescún, Robinson Jimenez-Moreno
Format: Article
Language:English
Published: Iran University of Science and Technology 2024-11-01
Series:Iranian Journal of Electrical and Electronic Engineering
Subjects:
Online Access:http://ijeee.iust.ac.ir/article-1-3331-en.pdf
Tags: Add Tag
No Tags, Be the first to tag this record!
Description
Summary:This paper presents the design and results of using a deep learning algorithm for robotic manipulation in object handling tasks in a virtual industrial environment. The simulation tool used is V-REP and the environment corresponds to a production line based on a conveyor belt and a SCARA type robot manipulator. The main contribution of this work focuses on the integration of a depth camera located on the robot and the computation of the gripping coordinates by identifying and locating three different types of objects of interest with random locations on the conveyor belt, through a Faster R-CNN. The results show that the system manages to perform the indicated activities, obtaining a classification accuracy of 97.4% and a mean average precision of 0.93, which allowed a correct detection and manipulation of the objects.
ISSN:1735-2827
2383-3890