A Method for Building a Mixed-Reality Digital Twin of a Roadheader Monitoring System
The working environment of the coal mine boom-type roadheader is harsh with large blind areas and numerous safety hazards for operators. Traditional on-site or remote control methods do not meet the requirements for intelligent tunneling. This paper proposes a digital twin monitoring system of an EB...
Saved in:
| Main Authors: | , , , , , , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
MDPI AG
2024-12-01
|
| Series: | Applied Sciences |
| Subjects: | |
| Online Access: | https://www.mdpi.com/2076-3417/14/24/11582 |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1846106075643772928 |
|---|---|
| author | Xuedi Hao Hanhui Lin Han Jia Yitong Cui Shengjie Wang Yingzong Gao Ji Guang Shirong Ge |
| author_facet | Xuedi Hao Hanhui Lin Han Jia Yitong Cui Shengjie Wang Yingzong Gao Ji Guang Shirong Ge |
| author_sort | Xuedi Hao |
| collection | DOAJ |
| description | The working environment of the coal mine boom-type roadheader is harsh with large blind areas and numerous safety hazards for operators. Traditional on-site or remote control methods do not meet the requirements for intelligent tunneling. This paper proposes a digital twin monitoring system of an EBZ-type roadheader based on mixed reality (MR). First, the system integrates a five-dimensional digital twin model to establish the boom-type roadheader digital twin monitoring system. Second, the Unity3D software (v2020.3.25f1c1) and the MR Hololens (v22621.1133 produced by Microsoft) are used to build a digital twin human–machine interaction platform, achieving bidirectional mapping and driving of cutting operation data. Third, a twin data exchange program is designed by employing the Winform framework and the C/S communication architecture, making use of the socket communication protocol to transmit and store the cutting model data within the system. Finally, a physical prototype of the boom-type roadheader is built, and a validation experiment of the monitoring system’s digital twin is conducted. The experimental results show that the average transmission error of the cutting model data of the twin monitoring system is below 0.757%, and the execution accuracy error is below 3.7%. This system can achieve bidirectional real-time mapping and control between the twins, which provides a new monitoring method for actual underground roadheader operations. It effectively eliminates the operator’s blind areas and improves the intelligence level of roadheader monitoring. Beyond mining, this methodology can be extended to the monitoring and control of other mining equipment, predictive maintenance in manufacturing, and infrastructure management in smart cities. |
| format | Article |
| id | doaj-art-91ff0efc5d8e457b9e0632a59f728846 |
| institution | Kabale University |
| issn | 2076-3417 |
| language | English |
| publishDate | 2024-12-01 |
| publisher | MDPI AG |
| record_format | Article |
| series | Applied Sciences |
| spelling | doaj-art-91ff0efc5d8e457b9e0632a59f7288462024-12-27T14:07:44ZengMDPI AGApplied Sciences2076-34172024-12-0114241158210.3390/app142411582A Method for Building a Mixed-Reality Digital Twin of a Roadheader Monitoring SystemXuedi Hao0Hanhui Lin1Han Jia2Yitong Cui3Shengjie Wang4Yingzong Gao5Ji Guang6Shirong Ge7College of Mechanical and Electrical Engineering, China University of Mining and Technology (Beijing), Beijing 100083, ChinaCollege of Mechanical and Electrical Engineering, China University of Mining and Technology (Beijing), Beijing 100083, ChinaCollege of Mechanical and Electrical Engineering, China University of Mining and Technology (Beijing), Beijing 100083, ChinaCollege of Mechanical and Electrical Engineering, China University of Mining and Technology (Beijing), Beijing 100083, ChinaCollege of Mechanical and Electrical Engineering, China University of Mining and Technology (Beijing), Beijing 100083, ChinaCollege of Mechanical and Electrical Engineering, China University of Mining and Technology (Beijing), Beijing 100083, ChinaCollege of Mechanical and Electrical Engineering, China University of Mining and Technology (Beijing), Beijing 100083, ChinaCollege of Mechanical and Electrical Engineering, China University of Mining and Technology (Beijing), Beijing 100083, ChinaThe working environment of the coal mine boom-type roadheader is harsh with large blind areas and numerous safety hazards for operators. Traditional on-site or remote control methods do not meet the requirements for intelligent tunneling. This paper proposes a digital twin monitoring system of an EBZ-type roadheader based on mixed reality (MR). First, the system integrates a five-dimensional digital twin model to establish the boom-type roadheader digital twin monitoring system. Second, the Unity3D software (v2020.3.25f1c1) and the MR Hololens (v22621.1133 produced by Microsoft) are used to build a digital twin human–machine interaction platform, achieving bidirectional mapping and driving of cutting operation data. Third, a twin data exchange program is designed by employing the Winform framework and the C/S communication architecture, making use of the socket communication protocol to transmit and store the cutting model data within the system. Finally, a physical prototype of the boom-type roadheader is built, and a validation experiment of the monitoring system’s digital twin is conducted. The experimental results show that the average transmission error of the cutting model data of the twin monitoring system is below 0.757%, and the execution accuracy error is below 3.7%. This system can achieve bidirectional real-time mapping and control between the twins, which provides a new monitoring method for actual underground roadheader operations. It effectively eliminates the operator’s blind areas and improves the intelligence level of roadheader monitoring. Beyond mining, this methodology can be extended to the monitoring and control of other mining equipment, predictive maintenance in manufacturing, and infrastructure management in smart cities.https://www.mdpi.com/2076-3417/14/24/11582roadheaderdigital twinequipment monitoringmixed reality |
| spellingShingle | Xuedi Hao Hanhui Lin Han Jia Yitong Cui Shengjie Wang Yingzong Gao Ji Guang Shirong Ge A Method for Building a Mixed-Reality Digital Twin of a Roadheader Monitoring System Applied Sciences roadheader digital twin equipment monitoring mixed reality |
| title | A Method for Building a Mixed-Reality Digital Twin of a Roadheader Monitoring System |
| title_full | A Method for Building a Mixed-Reality Digital Twin of a Roadheader Monitoring System |
| title_fullStr | A Method for Building a Mixed-Reality Digital Twin of a Roadheader Monitoring System |
| title_full_unstemmed | A Method for Building a Mixed-Reality Digital Twin of a Roadheader Monitoring System |
| title_short | A Method for Building a Mixed-Reality Digital Twin of a Roadheader Monitoring System |
| title_sort | method for building a mixed reality digital twin of a roadheader monitoring system |
| topic | roadheader digital twin equipment monitoring mixed reality |
| url | https://www.mdpi.com/2076-3417/14/24/11582 |
| work_keys_str_mv | AT xuedihao amethodforbuildingamixedrealitydigitaltwinofaroadheadermonitoringsystem AT hanhuilin amethodforbuildingamixedrealitydigitaltwinofaroadheadermonitoringsystem AT hanjia amethodforbuildingamixedrealitydigitaltwinofaroadheadermonitoringsystem AT yitongcui amethodforbuildingamixedrealitydigitaltwinofaroadheadermonitoringsystem AT shengjiewang amethodforbuildingamixedrealitydigitaltwinofaroadheadermonitoringsystem AT yingzonggao amethodforbuildingamixedrealitydigitaltwinofaroadheadermonitoringsystem AT jiguang amethodforbuildingamixedrealitydigitaltwinofaroadheadermonitoringsystem AT shirongge amethodforbuildingamixedrealitydigitaltwinofaroadheadermonitoringsystem AT xuedihao methodforbuildingamixedrealitydigitaltwinofaroadheadermonitoringsystem AT hanhuilin methodforbuildingamixedrealitydigitaltwinofaroadheadermonitoringsystem AT hanjia methodforbuildingamixedrealitydigitaltwinofaroadheadermonitoringsystem AT yitongcui methodforbuildingamixedrealitydigitaltwinofaroadheadermonitoringsystem AT shengjiewang methodforbuildingamixedrealitydigitaltwinofaroadheadermonitoringsystem AT yingzonggao methodforbuildingamixedrealitydigitaltwinofaroadheadermonitoringsystem AT jiguang methodforbuildingamixedrealitydigitaltwinofaroadheadermonitoringsystem AT shirongge methodforbuildingamixedrealitydigitaltwinofaroadheadermonitoringsystem |