Optimizing a Machine Learning Algorithm by a Novel Metaheuristic Approach: A Case Study in Forecasting
Accurate sales forecasting is essential for optimizing resource allocation, managing inventory, and maximizing profit in competitive markets. Machine learning models are being increasingly used to develop reliable sales-forecasting systems due to their advanced capabilities in handling complex data...
Saved in:
| Main Authors: | , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
MDPI AG
2024-12-01
|
| Series: | Mathematics |
| Subjects: | |
| Online Access: | https://www.mdpi.com/2227-7390/12/24/3921 |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1846103788667011072 |
|---|---|
| author | Bahadır Gülsün Muhammed Resul Aydin |
| author_facet | Bahadır Gülsün Muhammed Resul Aydin |
| author_sort | Bahadır Gülsün |
| collection | DOAJ |
| description | Accurate sales forecasting is essential for optimizing resource allocation, managing inventory, and maximizing profit in competitive markets. Machine learning models are being increasingly used to develop reliable sales-forecasting systems due to their advanced capabilities in handling complex data patterns. This study introduces a novel hybrid approach that combines the artificial bee colony (ABC) and fire hawk optimizer (FHO) algorithms, specifically designed to enhance hyperparameter optimization in machine learning-based forecasting models. By leveraging the strengths of these two metaheuristic algorithms, the hybrid method enhances the predictive accuracy and robustness of models, with a focus on optimizing the hyperparameters of XGBoost for forecasting tasks. Evaluations across three distinct datasets demonstrated that the hybrid model consistently outperformed standalone algorithms, including the genetic algorithm (GA), artificial rabbits optimization (ARO), the white shark optimizer (WSO), the ABC algorithm, and the FHO, with the latter being applied for the first time to hyperparameter optimization. The superior performance of the hybrid model was confirmed through the RMSE, the MAPE, and statistical tests, marking a significant advancement in sales forecasting and providing a reliable, effective solution for refining predictive models to support business decision-making. |
| format | Article |
| id | doaj-art-67a199666ceb44b891e3c76e982cc35d |
| institution | Kabale University |
| issn | 2227-7390 |
| language | English |
| publishDate | 2024-12-01 |
| publisher | MDPI AG |
| record_format | Article |
| series | Mathematics |
| spelling | doaj-art-67a199666ceb44b891e3c76e982cc35d2024-12-27T14:38:01ZengMDPI AGMathematics2227-73902024-12-011224392110.3390/math12243921Optimizing a Machine Learning Algorithm by a Novel Metaheuristic Approach: A Case Study in ForecastingBahadır Gülsün0Muhammed Resul Aydin1Department of Industrial Engineering, Yildiz Technical University, 34349 Istanbul, TürkiyeDepartment of Industrial Engineering, Yildiz Technical University, 34349 Istanbul, TürkiyeAccurate sales forecasting is essential for optimizing resource allocation, managing inventory, and maximizing profit in competitive markets. Machine learning models are being increasingly used to develop reliable sales-forecasting systems due to their advanced capabilities in handling complex data patterns. This study introduces a novel hybrid approach that combines the artificial bee colony (ABC) and fire hawk optimizer (FHO) algorithms, specifically designed to enhance hyperparameter optimization in machine learning-based forecasting models. By leveraging the strengths of these two metaheuristic algorithms, the hybrid method enhances the predictive accuracy and robustness of models, with a focus on optimizing the hyperparameters of XGBoost for forecasting tasks. Evaluations across three distinct datasets demonstrated that the hybrid model consistently outperformed standalone algorithms, including the genetic algorithm (GA), artificial rabbits optimization (ARO), the white shark optimizer (WSO), the ABC algorithm, and the FHO, with the latter being applied for the first time to hyperparameter optimization. The superior performance of the hybrid model was confirmed through the RMSE, the MAPE, and statistical tests, marking a significant advancement in sales forecasting and providing a reliable, effective solution for refining predictive models to support business decision-making.https://www.mdpi.com/2227-7390/12/24/3921extreme gradient boosting algorithmmachine learning algorithmforecasting modelmetaheuristic algorithmshyperparameter tuninghybrid metaheuristic |
| spellingShingle | Bahadır Gülsün Muhammed Resul Aydin Optimizing a Machine Learning Algorithm by a Novel Metaheuristic Approach: A Case Study in Forecasting Mathematics extreme gradient boosting algorithm machine learning algorithm forecasting model metaheuristic algorithms hyperparameter tuning hybrid metaheuristic |
| title | Optimizing a Machine Learning Algorithm by a Novel Metaheuristic Approach: A Case Study in Forecasting |
| title_full | Optimizing a Machine Learning Algorithm by a Novel Metaheuristic Approach: A Case Study in Forecasting |
| title_fullStr | Optimizing a Machine Learning Algorithm by a Novel Metaheuristic Approach: A Case Study in Forecasting |
| title_full_unstemmed | Optimizing a Machine Learning Algorithm by a Novel Metaheuristic Approach: A Case Study in Forecasting |
| title_short | Optimizing a Machine Learning Algorithm by a Novel Metaheuristic Approach: A Case Study in Forecasting |
| title_sort | optimizing a machine learning algorithm by a novel metaheuristic approach a case study in forecasting |
| topic | extreme gradient boosting algorithm machine learning algorithm forecasting model metaheuristic algorithms hyperparameter tuning hybrid metaheuristic |
| url | https://www.mdpi.com/2227-7390/12/24/3921 |
| work_keys_str_mv | AT bahadırgulsun optimizingamachinelearningalgorithmbyanovelmetaheuristicapproachacasestudyinforecasting AT muhammedresulaydin optimizingamachinelearningalgorithmbyanovelmetaheuristicapproachacasestudyinforecasting |