Attention-Driven Hybrid Ensemble Approach With Bayesian Optimization for Accurate Energy Forecasting in Jeju Island’s Renewable Energy System
The rapid integration of renewable energy sources into power grids has created an urgent need for accurate energy demand and supply forecasting models capable of managing the inherent variability of renewable energy generation. The combination of fluctuating consumer demand patterns and high variabi...
Saved in:
| Main Authors: | , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
IEEE
2025-01-01
|
| Series: | IEEE Access |
| Subjects: | |
| Online Access: | https://ieeexplore.ieee.org/document/10833637/ |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1841536222267179008 |
|---|---|
| author | Muhammad Ali Iqbal Joon-Min Gil Soo Kyun Kim |
| author_facet | Muhammad Ali Iqbal Joon-Min Gil Soo Kyun Kim |
| author_sort | Muhammad Ali Iqbal |
| collection | DOAJ |
| description | The rapid integration of renewable energy sources into power grids has created an urgent need for accurate energy demand and supply forecasting models capable of managing the inherent variability of renewable energy generation. The combination of fluctuating consumer demand patterns and high variability across different energy sources presents significant challenges in maintaining a reliable balance between supply and demand. To address these challenges, we propose a Attention-driven Bayesian-Optimized Hybrid Ensemble Framework (ABHEF), evaluated on Jeju Island’s energy mix data. ABHEF integrates state-of-the-art models—ConvBiLSTM (Convolutional Bidirectional Long Short-Term Memory), ETCN (Enhanced Temporal Convolutional Network), TFT (Temporal Fusion Transformer), and DAT (Dual Attention Transformer)—to capture both short-term fluctuations and long-term trends in energy data. The proposed framework is evaluated on actual energy demand and supply data from Jeju Island, along with key weather attributes, thereby enhancing the model’s real-world applicability and accuracy. Bayesian optimization was applied to each model to determine optimal hyperparameters, to ensure the peak predictive performance. The output of the base models was stacked, and four meta-models (Gradient Boosting, LGBM, Ridge, and CatBoost) were applied. Among these, CatBoost demonstrated the best performance and was selected as the final meta-model. For hourly supply prediction, our selected meta-model achieved a 52% reduction in MAE and a 50% reduction in RMSE compared to BiLSTM, the best-performing standalone time-series model, validated through a consistent evaluation of accuracy metrics across all models on the same dataset. For hourly demand predictions, it achieved a 43% reduction in MAE and a 34% reduction in RMSE. For daily supply predictions, it demonstrated a 76% reduction in MAE and a 77% reduction in RMSE, while for daily demand predictions, the reductions were 70% in MAE and 69% in RMSE. These results highlight the superior accuracy of the proposed framework, offering significant benefits for energy management and resource planning in renewable energy systems. |
| format | Article |
| id | doaj-art-fda0e650c9ba4e8cbe66327f6d5ad78b |
| institution | Kabale University |
| issn | 2169-3536 |
| language | English |
| publishDate | 2025-01-01 |
| publisher | IEEE |
| record_format | Article |
| series | IEEE Access |
| spelling | doaj-art-fda0e650c9ba4e8cbe66327f6d5ad78b2025-01-15T00:03:25ZengIEEEIEEE Access2169-35362025-01-01137986801010.1109/ACCESS.2025.352694310833637Attention-Driven Hybrid Ensemble Approach With Bayesian Optimization for Accurate Energy Forecasting in Jeju Island’s Renewable Energy SystemMuhammad Ali Iqbal0https://orcid.org/0009-0001-5152-0255Joon-Min Gil1https://orcid.org/0000-0001-6774-8476Soo Kyun Kim2https://orcid.org/0000-0001-6071-8231Department of Computer Engineering, Jeju National University, Jeju City, Jeju Province, Republic of KoreaDepartment of Computer Engineering, Jeju National University, Jeju City, Jeju Province, Republic of KoreaDepartment of Computer Engineering, Jeju National University, Jeju City, Jeju Province, Republic of KoreaThe rapid integration of renewable energy sources into power grids has created an urgent need for accurate energy demand and supply forecasting models capable of managing the inherent variability of renewable energy generation. The combination of fluctuating consumer demand patterns and high variability across different energy sources presents significant challenges in maintaining a reliable balance between supply and demand. To address these challenges, we propose a Attention-driven Bayesian-Optimized Hybrid Ensemble Framework (ABHEF), evaluated on Jeju Island’s energy mix data. ABHEF integrates state-of-the-art models—ConvBiLSTM (Convolutional Bidirectional Long Short-Term Memory), ETCN (Enhanced Temporal Convolutional Network), TFT (Temporal Fusion Transformer), and DAT (Dual Attention Transformer)—to capture both short-term fluctuations and long-term trends in energy data. The proposed framework is evaluated on actual energy demand and supply data from Jeju Island, along with key weather attributes, thereby enhancing the model’s real-world applicability and accuracy. Bayesian optimization was applied to each model to determine optimal hyperparameters, to ensure the peak predictive performance. The output of the base models was stacked, and four meta-models (Gradient Boosting, LGBM, Ridge, and CatBoost) were applied. Among these, CatBoost demonstrated the best performance and was selected as the final meta-model. For hourly supply prediction, our selected meta-model achieved a 52% reduction in MAE and a 50% reduction in RMSE compared to BiLSTM, the best-performing standalone time-series model, validated through a consistent evaluation of accuracy metrics across all models on the same dataset. For hourly demand predictions, it achieved a 43% reduction in MAE and a 34% reduction in RMSE. For daily supply predictions, it demonstrated a 76% reduction in MAE and a 77% reduction in RMSE, while for daily demand predictions, the reductions were 70% in MAE and 69% in RMSE. These results highlight the superior accuracy of the proposed framework, offering significant benefits for energy management and resource planning in renewable energy systems.https://ieeexplore.ieee.org/document/10833637/Hybrid deep learningrenewable energy forecastingBayesian optimizationtime-series forecastingmeta-model stacking |
| spellingShingle | Muhammad Ali Iqbal Joon-Min Gil Soo Kyun Kim Attention-Driven Hybrid Ensemble Approach With Bayesian Optimization for Accurate Energy Forecasting in Jeju Island’s Renewable Energy System IEEE Access Hybrid deep learning renewable energy forecasting Bayesian optimization time-series forecasting meta-model stacking |
| title | Attention-Driven Hybrid Ensemble Approach With Bayesian Optimization for Accurate Energy Forecasting in Jeju Island’s Renewable Energy System |
| title_full | Attention-Driven Hybrid Ensemble Approach With Bayesian Optimization for Accurate Energy Forecasting in Jeju Island’s Renewable Energy System |
| title_fullStr | Attention-Driven Hybrid Ensemble Approach With Bayesian Optimization for Accurate Energy Forecasting in Jeju Island’s Renewable Energy System |
| title_full_unstemmed | Attention-Driven Hybrid Ensemble Approach With Bayesian Optimization for Accurate Energy Forecasting in Jeju Island’s Renewable Energy System |
| title_short | Attention-Driven Hybrid Ensemble Approach With Bayesian Optimization for Accurate Energy Forecasting in Jeju Island’s Renewable Energy System |
| title_sort | attention driven hybrid ensemble approach with bayesian optimization for accurate energy forecasting in jeju island x2019 s renewable energy system |
| topic | Hybrid deep learning renewable energy forecasting Bayesian optimization time-series forecasting meta-model stacking |
| url | https://ieeexplore.ieee.org/document/10833637/ |
| work_keys_str_mv | AT muhammadaliiqbal attentiondrivenhybridensembleapproachwithbayesianoptimizationforaccurateenergyforecastinginjejuislandx2019srenewableenergysystem AT joonmingil attentiondrivenhybridensembleapproachwithbayesianoptimizationforaccurateenergyforecastinginjejuislandx2019srenewableenergysystem AT sookyunkim attentiondrivenhybridensembleapproachwithbayesianoptimizationforaccurateenergyforecastinginjejuislandx2019srenewableenergysystem |