Multimodal data visualization method for digital twin campus construction

University campuses, as distinctive yet commonplace urban environments, face similar challenges of high population density and efficient management. Integrating digital twins into smart campus construction is essential for optimizing campus management. Multimodal data integration and visualization a...

Full description

Saved in:
Bibliographic Details
Main Authors: Yakun Xie, Ni Zhan, Qing Zhu, Junjie Zhan, Zhihao Guo, Changjian Qiao, Jun Zhu, Bingli Xu
Format: Article
Language:English
Published: Taylor & Francis Group 2024-12-01
Series:International Journal of Digital Earth
Subjects:
Online Access:https://www.tandfonline.com/doi/10.1080/17538947.2024.2431624
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1846160725763948544
author Yakun Xie
Ni Zhan
Qing Zhu
Junjie Zhan
Zhihao Guo
Changjian Qiao
Jun Zhu
Bingli Xu
author_facet Yakun Xie
Ni Zhan
Qing Zhu
Junjie Zhan
Zhihao Guo
Changjian Qiao
Jun Zhu
Bingli Xu
author_sort Yakun Xie
collection DOAJ
description University campuses, as distinctive yet commonplace urban environments, face similar challenges of high population density and efficient management. Integrating digital twins into smart campus construction is essential for optimizing campus management. Multimodal data integration and visualization are key to building a digital twin campus. Traditional visualization methods often lack effective inter-data relationships, limiting their capacity to support robust multimodal data integration and create a multidimensional, real-time, comprehensive management view. Therefore, this paper proposes a tailored approach for multimodal data integration and visualization in digital twin campus construction. First, a comprehensive analysis of multimodal campus data identifies spatiotemporal associations among datasets. Subsequently, visualization strategies are developed based on these data characteristics and associations, enabling the multidimensional integration of 3D models, video surveillance, and wireless sensor data. Finally, a prototype system is implemented and evaluated through a case study. The results demonstrate that the proposed method efficiently integrates 2D maps, surveillance videos, and sensor data to create a dynamic, interactive, and panoramic campus view, achieving rendering efficiency exceeding 60 frames per second. Moreover, this adaptable framework can be applied to various campus or geographic contexts, offering critical technical support for multimodal visualization in IoT and big data environments.
format Article
id doaj-art-f5f5cbef1f964463895c1cf1907465f8
institution Kabale University
issn 1753-8947
1753-8955
language English
publishDate 2024-12-01
publisher Taylor & Francis Group
record_format Article
series International Journal of Digital Earth
spelling doaj-art-f5f5cbef1f964463895c1cf1907465f82024-11-22T04:10:41ZengTaylor & Francis GroupInternational Journal of Digital Earth1753-89471753-89552024-12-0117110.1080/17538947.2024.2431624Multimodal data visualization method for digital twin campus constructionYakun Xie0Ni Zhan1Qing Zhu2Junjie Zhan3Zhihao Guo4Changjian Qiao5Jun Zhu6Bingli Xu7Faculty of Geosciences and Engineering, Southwest Jiaotong University, Chengdu, People’s Republic of ChinaFaculty of Geosciences and Engineering, Southwest Jiaotong University, Chengdu, People’s Republic of ChinaFaculty of Geosciences and Engineering, Southwest Jiaotong University, Chengdu, People’s Republic of ChinaFaculty of Geosciences and Engineering, Southwest Jiaotong University, Chengdu, People’s Republic of ChinaFaculty of Geosciences and Engineering, Southwest Jiaotong University, Chengdu, People’s Republic of ChinaSchool of Resources and Environment, Henan University of Economics and Law, Zhengzhou, People’s Republic of ChinaFaculty of Geosciences and Engineering, Southwest Jiaotong University, Chengdu, People’s Republic of ChinaDepartment of Information and Communication, The Army Academy of Armored Forces, Bejing, People’s Republic of ChinaUniversity campuses, as distinctive yet commonplace urban environments, face similar challenges of high population density and efficient management. Integrating digital twins into smart campus construction is essential for optimizing campus management. Multimodal data integration and visualization are key to building a digital twin campus. Traditional visualization methods often lack effective inter-data relationships, limiting their capacity to support robust multimodal data integration and create a multidimensional, real-time, comprehensive management view. Therefore, this paper proposes a tailored approach for multimodal data integration and visualization in digital twin campus construction. First, a comprehensive analysis of multimodal campus data identifies spatiotemporal associations among datasets. Subsequently, visualization strategies are developed based on these data characteristics and associations, enabling the multidimensional integration of 3D models, video surveillance, and wireless sensor data. Finally, a prototype system is implemented and evaluated through a case study. The results demonstrate that the proposed method efficiently integrates 2D maps, surveillance videos, and sensor data to create a dynamic, interactive, and panoramic campus view, achieving rendering efficiency exceeding 60 frames per second. Moreover, this adaptable framework can be applied to various campus or geographic contexts, offering critical technical support for multimodal visualization in IoT and big data environments.https://www.tandfonline.com/doi/10.1080/17538947.2024.2431624Digital twinsmart campusmultimodal datavisualizationreal-scene 3D modelvideo fusion
spellingShingle Yakun Xie
Ni Zhan
Qing Zhu
Junjie Zhan
Zhihao Guo
Changjian Qiao
Jun Zhu
Bingli Xu
Multimodal data visualization method for digital twin campus construction
International Journal of Digital Earth
Digital twin
smart campus
multimodal data
visualization
real-scene 3D model
video fusion
title Multimodal data visualization method for digital twin campus construction
title_full Multimodal data visualization method for digital twin campus construction
title_fullStr Multimodal data visualization method for digital twin campus construction
title_full_unstemmed Multimodal data visualization method for digital twin campus construction
title_short Multimodal data visualization method for digital twin campus construction
title_sort multimodal data visualization method for digital twin campus construction
topic Digital twin
smart campus
multimodal data
visualization
real-scene 3D model
video fusion
url https://www.tandfonline.com/doi/10.1080/17538947.2024.2431624
work_keys_str_mv AT yakunxie multimodaldatavisualizationmethodfordigitaltwincampusconstruction
AT nizhan multimodaldatavisualizationmethodfordigitaltwincampusconstruction
AT qingzhu multimodaldatavisualizationmethodfordigitaltwincampusconstruction
AT junjiezhan multimodaldatavisualizationmethodfordigitaltwincampusconstruction
AT zhihaoguo multimodaldatavisualizationmethodfordigitaltwincampusconstruction
AT changjianqiao multimodaldatavisualizationmethodfordigitaltwincampusconstruction
AT junzhu multimodaldatavisualizationmethodfordigitaltwincampusconstruction
AT binglixu multimodaldatavisualizationmethodfordigitaltwincampusconstruction