A fast monocular 6D pose estimation method for textureless objects based on perceptual hashing and template matching
Object pose estimation is essential for computer vision applications such as quality inspection, robotic bin picking, and warehouse logistics. However, this task often requires expensive equipment such as 3D cameras or Lidar sensors, as well as significant computational resources. Many state-of-the-...
Saved in:
| Main Authors: | , , , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
Frontiers Media S.A.
2025-01-01
|
| Series: | Frontiers in Robotics and AI |
| Subjects: | |
| Online Access: | https://www.frontiersin.org/articles/10.3389/frobt.2024.1424036/full |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1841555118690926592 |
|---|---|
| author | Jose Moises Araya-Martinez Jose Moises Araya-Martinez Vinicius Soares Matthiesen Vinicius Soares Matthiesen Simon Bøgh Jens Lambrecht Rui Pimentel de Figueiredo |
| author_facet | Jose Moises Araya-Martinez Jose Moises Araya-Martinez Vinicius Soares Matthiesen Vinicius Soares Matthiesen Simon Bøgh Jens Lambrecht Rui Pimentel de Figueiredo |
| author_sort | Jose Moises Araya-Martinez |
| collection | DOAJ |
| description | Object pose estimation is essential for computer vision applications such as quality inspection, robotic bin picking, and warehouse logistics. However, this task often requires expensive equipment such as 3D cameras or Lidar sensors, as well as significant computational resources. Many state-of-the-art methods for 6D pose estimation depend on deep neural networks, which are computationally demanding and require GPUs for real-time performance. Moreover, they usually involve the collection and labeling of large training datasets, which is costly and time-consuming. In this study, we propose a template-based matching algorithm that utilizes a novel perceptual hashing method for binary images, enabling fast and robust pose estimation. This approach allows the automatic preselection of a subset of templates, significantly reducing inference time while maintaining similar accuracy. Our solution runs efficiently on multiple devices without GPU support, offering reduced runtime and high accuracy on cost-effective hardware. We benchmarked our proposed approach on a body-in-white automotive part and a widely used publicly available dataset. Our set of experiments on a synthetically generated dataset reveals a trade-off between accuracy and computation time superior to a previous work on the same automotive-production use case. Additionally, our algorithm efficiently utilizes all CPU cores and includes adjustable parameters for balancing computation time and accuracy, making it suitable for a wide range of applications where hardware cost and power efficiency are critical. For instance, with a rotation step of 10° in the template database, we achieve an average rotation error of 10°, matching the template quantization level, and an average translation error of 14% of the object’s size, with an average processing time of 0.3s per image on a small form-factor NVIDIA AGX Orin device. We also evaluate robustness under partial occlusions (up to 10% occlusion) and noisy inputs (signal-to-noise ratios [SNRs] up to 10 dB), with only minor losses in accuracy. Additionally, we compare our method to state-of-the-art deep learning models on a public dataset. Although our algorithm does not outperform them in absolute accuracy, it provides a more favorable trade-off between accuracy and processing time, which is especially relevant to applications using resource-constrained devices. |
| format | Article |
| id | doaj-art-ca9b65a0a19e441a87c15051dae99a41 |
| institution | Kabale University |
| issn | 2296-9144 |
| language | English |
| publishDate | 2025-01-01 |
| publisher | Frontiers Media S.A. |
| record_format | Article |
| series | Frontiers in Robotics and AI |
| spelling | doaj-art-ca9b65a0a19e441a87c15051dae99a412025-01-08T06:11:53ZengFrontiers Media S.A.Frontiers in Robotics and AI2296-91442025-01-011110.3389/frobt.2024.14240361424036A fast monocular 6D pose estimation method for textureless objects based on perceptual hashing and template matchingJose Moises Araya-Martinez0Jose Moises Araya-Martinez1Vinicius Soares Matthiesen2Vinicius Soares Matthiesen3Simon Bøgh4Jens Lambrecht5Rui Pimentel de Figueiredo6Industry Grade Networks and Clouds, Institute of Telecommunication Systems, Electrical Engineering and Computer Science, Technical University Berlin, Berlin, GermanyFuture Manufacturing Technologies, Mercedes-Benz AG, Sindelfingen, GermanyFuture Manufacturing Technologies, Mercedes-Benz AG, Sindelfingen, GermanyDepartment of Materials and Production, Aalborg University, Aalborg, DenmarkDepartment of Materials and Production, Aalborg University, Aalborg, DenmarkIndustry Grade Networks and Clouds, Institute of Telecommunication Systems, Electrical Engineering and Computer Science, Technical University Berlin, Berlin, GermanyDepartment of Materials and Production, Aalborg University, Aalborg, DenmarkObject pose estimation is essential for computer vision applications such as quality inspection, robotic bin picking, and warehouse logistics. However, this task often requires expensive equipment such as 3D cameras or Lidar sensors, as well as significant computational resources. Many state-of-the-art methods for 6D pose estimation depend on deep neural networks, which are computationally demanding and require GPUs for real-time performance. Moreover, they usually involve the collection and labeling of large training datasets, which is costly and time-consuming. In this study, we propose a template-based matching algorithm that utilizes a novel perceptual hashing method for binary images, enabling fast and robust pose estimation. This approach allows the automatic preselection of a subset of templates, significantly reducing inference time while maintaining similar accuracy. Our solution runs efficiently on multiple devices without GPU support, offering reduced runtime and high accuracy on cost-effective hardware. We benchmarked our proposed approach on a body-in-white automotive part and a widely used publicly available dataset. Our set of experiments on a synthetically generated dataset reveals a trade-off between accuracy and computation time superior to a previous work on the same automotive-production use case. Additionally, our algorithm efficiently utilizes all CPU cores and includes adjustable parameters for balancing computation time and accuracy, making it suitable for a wide range of applications where hardware cost and power efficiency are critical. For instance, with a rotation step of 10° in the template database, we achieve an average rotation error of 10°, matching the template quantization level, and an average translation error of 14% of the object’s size, with an average processing time of 0.3s per image on a small form-factor NVIDIA AGX Orin device. We also evaluate robustness under partial occlusions (up to 10% occlusion) and noisy inputs (signal-to-noise ratios [SNRs] up to 10 dB), with only minor losses in accuracy. Additionally, we compare our method to state-of-the-art deep learning models on a public dataset. Although our algorithm does not outperform them in absolute accuracy, it provides a more favorable trade-off between accuracy and processing time, which is especially relevant to applications using resource-constrained devices.https://www.frontiersin.org/articles/10.3389/frobt.2024.1424036/full6D pose estimationperceptual hashingIoUhamming distanceautomotive production |
| spellingShingle | Jose Moises Araya-Martinez Jose Moises Araya-Martinez Vinicius Soares Matthiesen Vinicius Soares Matthiesen Simon Bøgh Jens Lambrecht Rui Pimentel de Figueiredo A fast monocular 6D pose estimation method for textureless objects based on perceptual hashing and template matching Frontiers in Robotics and AI 6D pose estimation perceptual hashing IoU hamming distance automotive production |
| title | A fast monocular 6D pose estimation method for textureless objects based on perceptual hashing and template matching |
| title_full | A fast monocular 6D pose estimation method for textureless objects based on perceptual hashing and template matching |
| title_fullStr | A fast monocular 6D pose estimation method for textureless objects based on perceptual hashing and template matching |
| title_full_unstemmed | A fast monocular 6D pose estimation method for textureless objects based on perceptual hashing and template matching |
| title_short | A fast monocular 6D pose estimation method for textureless objects based on perceptual hashing and template matching |
| title_sort | fast monocular 6d pose estimation method for textureless objects based on perceptual hashing and template matching |
| topic | 6D pose estimation perceptual hashing IoU hamming distance automotive production |
| url | https://www.frontiersin.org/articles/10.3389/frobt.2024.1424036/full |
| work_keys_str_mv | AT josemoisesarayamartinez afastmonocular6dposeestimationmethodfortexturelessobjectsbasedonperceptualhashingandtemplatematching AT josemoisesarayamartinez afastmonocular6dposeestimationmethodfortexturelessobjectsbasedonperceptualhashingandtemplatematching AT viniciussoaresmatthiesen afastmonocular6dposeestimationmethodfortexturelessobjectsbasedonperceptualhashingandtemplatematching AT viniciussoaresmatthiesen afastmonocular6dposeestimationmethodfortexturelessobjectsbasedonperceptualhashingandtemplatematching AT simonbøgh afastmonocular6dposeestimationmethodfortexturelessobjectsbasedonperceptualhashingandtemplatematching AT jenslambrecht afastmonocular6dposeestimationmethodfortexturelessobjectsbasedonperceptualhashingandtemplatematching AT ruipimenteldefigueiredo afastmonocular6dposeestimationmethodfortexturelessobjectsbasedonperceptualhashingandtemplatematching AT josemoisesarayamartinez fastmonocular6dposeestimationmethodfortexturelessobjectsbasedonperceptualhashingandtemplatematching AT josemoisesarayamartinez fastmonocular6dposeestimationmethodfortexturelessobjectsbasedonperceptualhashingandtemplatematching AT viniciussoaresmatthiesen fastmonocular6dposeestimationmethodfortexturelessobjectsbasedonperceptualhashingandtemplatematching AT viniciussoaresmatthiesen fastmonocular6dposeestimationmethodfortexturelessobjectsbasedonperceptualhashingandtemplatematching AT simonbøgh fastmonocular6dposeestimationmethodfortexturelessobjectsbasedonperceptualhashingandtemplatematching AT jenslambrecht fastmonocular6dposeestimationmethodfortexturelessobjectsbasedonperceptualhashingandtemplatematching AT ruipimenteldefigueiredo fastmonocular6dposeestimationmethodfortexturelessobjectsbasedonperceptualhashingandtemplatematching |