GRVIO: Semantic-Aware Visual-Inertial Odometry for Ground Robot Platforms
Visual-inertial odometry (VIO) has emerged as a key technology for state estimation of mobile robots by complementarily fusing data from a lightweight, low-cost inertial measurement unit and a camera. However, ground robots face significant challenges that degrade VIO performance, including texturel...
Saved in:
| Main Authors: | , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
IEEE
2025-01-01
|
| Series: | IEEE Access |
| Subjects: | |
| Online Access: | https://ieeexplore.ieee.org/document/11124869/ |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1849223087616163840 |
|---|---|
| author | Sangbum Lee Hanyeol Lee Chan Gook Park |
| author_facet | Sangbum Lee Hanyeol Lee Chan Gook Park |
| author_sort | Sangbum Lee |
| collection | DOAJ |
| description | Visual-inertial odometry (VIO) has emerged as a key technology for state estimation of mobile robots by complementarily fusing data from a lightweight, low-cost inertial measurement unit and a camera. However, ground robots face significant challenges that degrade VIO performance, including textureless image regions from ground surfaces, dynamic environments, and motion-induced vibrations. To address these issues, this paper proposes ground robot visual-inertial odometry (GRVIO), a semantic-aware VIO framework specifically designed for ground robots. The proposed approach introduces a novel camera-plane distance measurement model, a zero-motion update model, and a dynamic object removal strategy. Our measurement formulation process leverages deep neural network-based semantic information to effectively remove dynamic point features and enhance the accuracy of plane features through high-level scene understanding. All measurement models are systematically integrated into a multi-state constraint Kalman filter (MSCKF) framework for accurate state estimation with a lightweight filter design. The effectiveness of the proposed method is validated through Monte Carlo simulations and real-world experiments using a publicly available dataset collected from a quadruped robot operating in diverse indoor and outdoor environments. Simulation results demonstrate that each proposed measurement model enhances localization accuracy and show the robustness of the proposed method against semantic segmentation errors and extrinsic calibration uncertainties. Furthermore, experimental results validate that GRVIO outperforms state-of-the-art VIO methods relying solely on point features, achieving an average reduction of approximately 40% in position root mean squared error compared to MSCKF, thus highlighting its capability to impose effective measurements and enhance both robustness and accuracy for ground robots. |
| format | Article |
| id | doaj-art-25a44c4e76ce40c189ab8f090e72484d |
| institution | Kabale University |
| issn | 2169-3536 |
| language | English |
| publishDate | 2025-01-01 |
| publisher | IEEE |
| record_format | Article |
| series | IEEE Access |
| spelling | doaj-art-25a44c4e76ce40c189ab8f090e72484d2025-08-25T23:11:59ZengIEEEIEEE Access2169-35362025-01-011314587514588710.1109/ACCESS.2025.359877111124869GRVIO: Semantic-Aware Visual-Inertial Odometry for Ground Robot PlatformsSangbum Lee0https://orcid.org/0009-0002-1647-3972Hanyeol Lee1https://orcid.org/0000-0002-0169-4994Chan Gook Park2https://orcid.org/0000-0002-7403-951XDepartment of Aerospace Engineering, Seoul National University, Seoul, South KoreaDepartment of Aerospace Engineering, Seoul National University, Seoul, South KoreaDepartment of Aerospace Engineering, Seoul National University, Seoul, South KoreaVisual-inertial odometry (VIO) has emerged as a key technology for state estimation of mobile robots by complementarily fusing data from a lightweight, low-cost inertial measurement unit and a camera. However, ground robots face significant challenges that degrade VIO performance, including textureless image regions from ground surfaces, dynamic environments, and motion-induced vibrations. To address these issues, this paper proposes ground robot visual-inertial odometry (GRVIO), a semantic-aware VIO framework specifically designed for ground robots. The proposed approach introduces a novel camera-plane distance measurement model, a zero-motion update model, and a dynamic object removal strategy. Our measurement formulation process leverages deep neural network-based semantic information to effectively remove dynamic point features and enhance the accuracy of plane features through high-level scene understanding. All measurement models are systematically integrated into a multi-state constraint Kalman filter (MSCKF) framework for accurate state estimation with a lightweight filter design. The effectiveness of the proposed method is validated through Monte Carlo simulations and real-world experiments using a publicly available dataset collected from a quadruped robot operating in diverse indoor and outdoor environments. Simulation results demonstrate that each proposed measurement model enhances localization accuracy and show the robustness of the proposed method against semantic segmentation errors and extrinsic calibration uncertainties. Furthermore, experimental results validate that GRVIO outperforms state-of-the-art VIO methods relying solely on point features, achieving an average reduction of approximately 40% in position root mean squared error compared to MSCKF, thus highlighting its capability to impose effective measurements and enhance both robustness and accuracy for ground robots.https://ieeexplore.ieee.org/document/11124869/Ground robotvisual-inertial odometryplane measurement modelsemantic perception |
| spellingShingle | Sangbum Lee Hanyeol Lee Chan Gook Park GRVIO: Semantic-Aware Visual-Inertial Odometry for Ground Robot Platforms IEEE Access Ground robot visual-inertial odometry plane measurement model semantic perception |
| title | GRVIO: Semantic-Aware Visual-Inertial Odometry for Ground Robot Platforms |
| title_full | GRVIO: Semantic-Aware Visual-Inertial Odometry for Ground Robot Platforms |
| title_fullStr | GRVIO: Semantic-Aware Visual-Inertial Odometry for Ground Robot Platforms |
| title_full_unstemmed | GRVIO: Semantic-Aware Visual-Inertial Odometry for Ground Robot Platforms |
| title_short | GRVIO: Semantic-Aware Visual-Inertial Odometry for Ground Robot Platforms |
| title_sort | grvio semantic aware visual inertial odometry for ground robot platforms |
| topic | Ground robot visual-inertial odometry plane measurement model semantic perception |
| url | https://ieeexplore.ieee.org/document/11124869/ |
| work_keys_str_mv | AT sangbumlee grviosemanticawarevisualinertialodometryforgroundrobotplatforms AT hanyeollee grviosemanticawarevisualinertialodometryforgroundrobotplatforms AT changookpark grviosemanticawarevisualinertialodometryforgroundrobotplatforms |