A real-time 3D modeling method for buildings driven by IMU and RGB-D fusion

With the rapid development of cutting-edge technologies such as autonomous driving, augmented reality, and intelligent robotics, real-time 3D scene reconstruction is increasingly demonstrating its crucial value in diverse application domains. However, 3D reconstruction faces challenges such as redun...

Full description

Saved in:
Bibliographic Details
Main Authors: Yuhan Gao, Chao Dang, Jun Zhu, Yakun Xie, Ya Hu, Chunli Yan, Kun Yi, Chuan Yi, Xue Li
Format: Article
Language:English
Published: Taylor & Francis Group 2025-08-01
Series:International Journal of Digital Earth
Subjects:
Online Access:https://www.tandfonline.com/doi/10.1080/17538947.2025.2506496
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1849224345826623488
author Yuhan Gao
Chao Dang
Jun Zhu
Yakun Xie
Ya Hu
Chunli Yan
Kun Yi
Chuan Yi
Xue Li
author_facet Yuhan Gao
Chao Dang
Jun Zhu
Yakun Xie
Ya Hu
Chunli Yan
Kun Yi
Chuan Yi
Xue Li
author_sort Yuhan Gao
collection DOAJ
description With the rapid development of cutting-edge technologies such as autonomous driving, augmented reality, and intelligent robotics, real-time 3D scene reconstruction is increasingly demonstrating its crucial value in diverse application domains. However, 3D reconstruction faces challenges such as redundant data acquisition, inaccurate pose estimation, and insufficient reconstruction precision, making it difficult to support rapid visualization and measurement analysis. Therefore, this paper proposes an innovative real-time 3D modeling method for buildings driven by IMU and RGB-D fusion. The method incorporates an adaptive sampling strategy for RGB-D cameras based on IMU data calibration, introduces a pose estimation optimization algorithm that combines dynamic feature point cluster centroid prediction with bias detection, establishes a progressive 3D modeling approach constrained by structural features, and develops a prototype system for in-depth case study analysis. Experimental results demonstrate that, compared to existing methods, our approach achieves significant improvements across multiple metrics: data redundancy is reduced by 31%, dynamic object detection precision reaches 93.2%, computational latency decreases by 13.9%, and spatial accuracy improves by 29.0%. This approach enables rapid 3D reconstruction of building environments, automating structural measurements and analysis while significantly reducing manual effort, making it beneficial for applications in smart city development and digital twin implementation.
format Article
id doaj-art-1cb75671db6140a19c8f9905be8fdac7
institution Kabale University
issn 1753-8947
1753-8955
language English
publishDate 2025-08-01
publisher Taylor & Francis Group
record_format Article
series International Journal of Digital Earth
spelling doaj-art-1cb75671db6140a19c8f9905be8fdac72025-08-25T11:24:47ZengTaylor & Francis GroupInternational Journal of Digital Earth1753-89471753-89552025-08-0118110.1080/17538947.2025.2506496A real-time 3D modeling method for buildings driven by IMU and RGB-D fusionYuhan Gao0Chao Dang1Jun Zhu2Yakun Xie3Ya Hu4Chunli Yan5Kun Yi6Chuan Yi7Xue Li8Faculty of Geosciences and Engineering, Southwest Jiaotong University, Chengdu, People’s Republic of ChinaFaculty of Geosciences and Engineering, Southwest Jiaotong University, Chengdu, People’s Republic of ChinaFaculty of Geosciences and Engineering, Southwest Jiaotong University, Chengdu, People’s Republic of ChinaFaculty of Geosciences and Engineering, Southwest Jiaotong University, Chengdu, People’s Republic of ChinaFaculty of Geosciences and Engineering, Southwest Jiaotong University, Chengdu, People’s Republic of ChinaFaculty of Geosciences and Engineering, Southwest Jiaotong University, Chengdu, People’s Republic of ChinaFaculty of Geosciences and Engineering, Southwest Jiaotong University, Chengdu, People’s Republic of ChinaFaculty of Geosciences and Engineering, Southwest Jiaotong University, Chengdu, People’s Republic of ChinaFaculty of Geosciences and Engineering, Southwest Jiaotong University, Chengdu, People’s Republic of ChinaWith the rapid development of cutting-edge technologies such as autonomous driving, augmented reality, and intelligent robotics, real-time 3D scene reconstruction is increasingly demonstrating its crucial value in diverse application domains. However, 3D reconstruction faces challenges such as redundant data acquisition, inaccurate pose estimation, and insufficient reconstruction precision, making it difficult to support rapid visualization and measurement analysis. Therefore, this paper proposes an innovative real-time 3D modeling method for buildings driven by IMU and RGB-D fusion. The method incorporates an adaptive sampling strategy for RGB-D cameras based on IMU data calibration, introduces a pose estimation optimization algorithm that combines dynamic feature point cluster centroid prediction with bias detection, establishes a progressive 3D modeling approach constrained by structural features, and develops a prototype system for in-depth case study analysis. Experimental results demonstrate that, compared to existing methods, our approach achieves significant improvements across multiple metrics: data redundancy is reduced by 31%, dynamic object detection precision reaches 93.2%, computational latency decreases by 13.9%, and spatial accuracy improves by 29.0%. This approach enables rapid 3D reconstruction of building environments, automating structural measurements and analysis while significantly reducing manual effort, making it beneficial for applications in smart city development and digital twin implementation.https://www.tandfonline.com/doi/10.1080/17538947.2025.2506496Real-time 3D modelingbuildingsmulti-source data fusion drivenORB-SLAM improvement
spellingShingle Yuhan Gao
Chao Dang
Jun Zhu
Yakun Xie
Ya Hu
Chunli Yan
Kun Yi
Chuan Yi
Xue Li
A real-time 3D modeling method for buildings driven by IMU and RGB-D fusion
International Journal of Digital Earth
Real-time 3D modeling
buildings
multi-source data fusion driven
ORB-SLAM improvement
title A real-time 3D modeling method for buildings driven by IMU and RGB-D fusion
title_full A real-time 3D modeling method for buildings driven by IMU and RGB-D fusion
title_fullStr A real-time 3D modeling method for buildings driven by IMU and RGB-D fusion
title_full_unstemmed A real-time 3D modeling method for buildings driven by IMU and RGB-D fusion
title_short A real-time 3D modeling method for buildings driven by IMU and RGB-D fusion
title_sort real time 3d modeling method for buildings driven by imu and rgb d fusion
topic Real-time 3D modeling
buildings
multi-source data fusion driven
ORB-SLAM improvement
url https://www.tandfonline.com/doi/10.1080/17538947.2025.2506496
work_keys_str_mv AT yuhangao arealtime3dmodelingmethodforbuildingsdrivenbyimuandrgbdfusion
AT chaodang arealtime3dmodelingmethodforbuildingsdrivenbyimuandrgbdfusion
AT junzhu arealtime3dmodelingmethodforbuildingsdrivenbyimuandrgbdfusion
AT yakunxie arealtime3dmodelingmethodforbuildingsdrivenbyimuandrgbdfusion
AT yahu arealtime3dmodelingmethodforbuildingsdrivenbyimuandrgbdfusion
AT chunliyan arealtime3dmodelingmethodforbuildingsdrivenbyimuandrgbdfusion
AT kunyi arealtime3dmodelingmethodforbuildingsdrivenbyimuandrgbdfusion
AT chuanyi arealtime3dmodelingmethodforbuildingsdrivenbyimuandrgbdfusion
AT xueli arealtime3dmodelingmethodforbuildingsdrivenbyimuandrgbdfusion
AT yuhangao realtime3dmodelingmethodforbuildingsdrivenbyimuandrgbdfusion
AT chaodang realtime3dmodelingmethodforbuildingsdrivenbyimuandrgbdfusion
AT junzhu realtime3dmodelingmethodforbuildingsdrivenbyimuandrgbdfusion
AT yakunxie realtime3dmodelingmethodforbuildingsdrivenbyimuandrgbdfusion
AT yahu realtime3dmodelingmethodforbuildingsdrivenbyimuandrgbdfusion
AT chunliyan realtime3dmodelingmethodforbuildingsdrivenbyimuandrgbdfusion
AT kunyi realtime3dmodelingmethodforbuildingsdrivenbyimuandrgbdfusion
AT chuanyi realtime3dmodelingmethodforbuildingsdrivenbyimuandrgbdfusion
AT xueli realtime3dmodelingmethodforbuildingsdrivenbyimuandrgbdfusion