Enhancing Air Conditioning System Efficiency Through Load Prediction and Deep Reinforcement Learning: A Case Study of Ground Source Heat Pumps
This study proposes a control method that integrates deep reinforcement learning with load forecasting, to enhance the energy efficiency of ground source heat pump systems. Eight machine learning models are first developed to predict future cooling loads, and the optimal one is then incorporated int...
Saved in:
| Main Authors: | , , , , , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
MDPI AG
2025-01-01
|
| Series: | Energies |
| Subjects: | |
| Online Access: | https://www.mdpi.com/1996-1073/18/1/199 |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1841549203455606784 |
|---|---|
| author | Zhitao Wang Yubin Qiu Shiyu Zhou Yanfa Tian Xiangyuan Zhu Jiying Liu Shengze Lu |
| author_facet | Zhitao Wang Yubin Qiu Shiyu Zhou Yanfa Tian Xiangyuan Zhu Jiying Liu Shengze Lu |
| author_sort | Zhitao Wang |
| collection | DOAJ |
| description | This study proposes a control method that integrates deep reinforcement learning with load forecasting, to enhance the energy efficiency of ground source heat pump systems. Eight machine learning models are first developed to predict future cooling loads, and the optimal one is then incorporated into deep reinforcement learning. Through interaction with the environment, the optimal control strategy is identified using a deep Q-network to optimize the supply water temperature from the ground source, allowing for energy savings. The obtained results show that the XGBoost model significantly outperforms other models in terms of prediction accuracy, reaching a coefficient of determination of 0.982, a mean absolute percentage error of 6.621%, and a coefficient of variation for the root mean square error of 10.612%. Moreover, the energy savings achieved through the load forecasting-based deep reinforcement learning control method are greater than those of traditional constant water temperature control methods by 10%. Additionally, without shortening the control interval, the energy savings are improved by 0.38% compared with deep reinforcement learning control methods that do not use predictive information. This approach requires only continuous interaction and learning between the agent and the environment, which makes it an effective alternative in scenarios where sensor and equipment data are not present. It provides a smart and adaptive optimization control solution for heating, ventilation, and air conditioning systems in buildings. |
| format | Article |
| id | doaj-art-29148d92d6d04fe0b2f1a3516daa1a31 |
| institution | Kabale University |
| issn | 1996-1073 |
| language | English |
| publishDate | 2025-01-01 |
| publisher | MDPI AG |
| record_format | Article |
| series | Energies |
| spelling | doaj-art-29148d92d6d04fe0b2f1a3516daa1a312025-01-10T13:17:24ZengMDPI AGEnergies1996-10732025-01-0118119910.3390/en18010199Enhancing Air Conditioning System Efficiency Through Load Prediction and Deep Reinforcement Learning: A Case Study of Ground Source Heat PumpsZhitao Wang0Yubin Qiu1Shiyu Zhou2Yanfa Tian3Xiangyuan Zhu4Jiying Liu5Shengze Lu6Youshi Technology Development Co., Ltd., Jinan 250098, ChinaSchool of Thermal Engineering, Shandong Jianzhu University, Jinan 250101, ChinaSchool of Thermal Engineering, Shandong Jianzhu University, Jinan 250101, ChinaShandong Huake Planning and Architectural Design Co., Ltd., Liaocheng 252026, ChinaSchool of Thermal Engineering, Shandong Jianzhu University, Jinan 250101, ChinaSchool of Thermal Engineering, Shandong Jianzhu University, Jinan 250101, ChinaSchool of Thermal Engineering, Shandong Jianzhu University, Jinan 250101, ChinaThis study proposes a control method that integrates deep reinforcement learning with load forecasting, to enhance the energy efficiency of ground source heat pump systems. Eight machine learning models are first developed to predict future cooling loads, and the optimal one is then incorporated into deep reinforcement learning. Through interaction with the environment, the optimal control strategy is identified using a deep Q-network to optimize the supply water temperature from the ground source, allowing for energy savings. The obtained results show that the XGBoost model significantly outperforms other models in terms of prediction accuracy, reaching a coefficient of determination of 0.982, a mean absolute percentage error of 6.621%, and a coefficient of variation for the root mean square error of 10.612%. Moreover, the energy savings achieved through the load forecasting-based deep reinforcement learning control method are greater than those of traditional constant water temperature control methods by 10%. Additionally, without shortening the control interval, the energy savings are improved by 0.38% compared with deep reinforcement learning control methods that do not use predictive information. This approach requires only continuous interaction and learning between the agent and the environment, which makes it an effective alternative in scenarios where sensor and equipment data are not present. It provides a smart and adaptive optimization control solution for heating, ventilation, and air conditioning systems in buildings.https://www.mdpi.com/1996-1073/18/1/199ground source heat pump systemdeep reinforcement learningbuilding load predictionhigh-efficiency chiller plant |
| spellingShingle | Zhitao Wang Yubin Qiu Shiyu Zhou Yanfa Tian Xiangyuan Zhu Jiying Liu Shengze Lu Enhancing Air Conditioning System Efficiency Through Load Prediction and Deep Reinforcement Learning: A Case Study of Ground Source Heat Pumps Energies ground source heat pump system deep reinforcement learning building load prediction high-efficiency chiller plant |
| title | Enhancing Air Conditioning System Efficiency Through Load Prediction and Deep Reinforcement Learning: A Case Study of Ground Source Heat Pumps |
| title_full | Enhancing Air Conditioning System Efficiency Through Load Prediction and Deep Reinforcement Learning: A Case Study of Ground Source Heat Pumps |
| title_fullStr | Enhancing Air Conditioning System Efficiency Through Load Prediction and Deep Reinforcement Learning: A Case Study of Ground Source Heat Pumps |
| title_full_unstemmed | Enhancing Air Conditioning System Efficiency Through Load Prediction and Deep Reinforcement Learning: A Case Study of Ground Source Heat Pumps |
| title_short | Enhancing Air Conditioning System Efficiency Through Load Prediction and Deep Reinforcement Learning: A Case Study of Ground Source Heat Pumps |
| title_sort | enhancing air conditioning system efficiency through load prediction and deep reinforcement learning a case study of ground source heat pumps |
| topic | ground source heat pump system deep reinforcement learning building load prediction high-efficiency chiller plant |
| url | https://www.mdpi.com/1996-1073/18/1/199 |
| work_keys_str_mv | AT zhitaowang enhancingairconditioningsystemefficiencythroughloadpredictionanddeepreinforcementlearningacasestudyofgroundsourceheatpumps AT yubinqiu enhancingairconditioningsystemefficiencythroughloadpredictionanddeepreinforcementlearningacasestudyofgroundsourceheatpumps AT shiyuzhou enhancingairconditioningsystemefficiencythroughloadpredictionanddeepreinforcementlearningacasestudyofgroundsourceheatpumps AT yanfatian enhancingairconditioningsystemefficiencythroughloadpredictionanddeepreinforcementlearningacasestudyofgroundsourceheatpumps AT xiangyuanzhu enhancingairconditioningsystemefficiencythroughloadpredictionanddeepreinforcementlearningacasestudyofgroundsourceheatpumps AT jiyingliu enhancingairconditioningsystemefficiencythroughloadpredictionanddeepreinforcementlearningacasestudyofgroundsourceheatpumps AT shengzelu enhancingairconditioningsystemefficiencythroughloadpredictionanddeepreinforcementlearningacasestudyofgroundsourceheatpumps |