Optimizing Kernel Extreme Learning Machine based on a Enhanced Adaptive Whale Optimization Algorithm for classification task.
Data classification is an important research direction in machine learning. In order to effectively handle extensive datasets, researchers have introduced diverse classification algorithms. Notably, Kernel Extreme Learning Machine (KELM), as a fast and effective classification method, has received w...
Saved in:
| Main Author: | |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
Public Library of Science (PLoS)
2025-01-01
|
| Series: | PLoS ONE |
| Online Access: | https://doi.org/10.1371/journal.pone.0309741 |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1841555603795738624 |
|---|---|
| author | ZeSheng Lin |
| author_facet | ZeSheng Lin |
| author_sort | ZeSheng Lin |
| collection | DOAJ |
| description | Data classification is an important research direction in machine learning. In order to effectively handle extensive datasets, researchers have introduced diverse classification algorithms. Notably, Kernel Extreme Learning Machine (KELM), as a fast and effective classification method, has received widespread attention. However, traditional KELM algorithms have some problems when dealing with large-scale data, such as the need to adjust hyperparameters, poor interpretability, and low classification accuracy. To address these problems, this paper proposes an Enhanced Adaptive Whale Optimization Algorithm to optimize Kernel Extreme Learning Machine (EAWOA-KELM). Various methods were used to improve WOA. As a first step, a novel adaptive perturbation technique employing T-distribution is proposed to perturb the optimal position and avoid being trapped in a local maximum. Secondly, the WOA's position update formula was modified by incorporating inertia weight ω and enhancing convergence factor α, thus improving its capability for local search. Furthermore, inspired by the grey wolf optimization algorithm, use 3 excellent particle surround strategies instead of the original random selecting particles. Finally, a novel Levy flight was implemented to promote the diversity of whale distribution. Results from experiments confirm that the enhanced WOA algorithm outperforms the standard WOA algorithm in terms of both fitness value and convergence speed. EAWOA demonstrates superior optimization accuracy compared to WOA across 21 test functions, with a notable edge on certain functions. The application of the upgraded WOA algorithm in KELM significantly improves the accuracy and efficiency of data classification by optimizing hyperparameters. This paper selects 7 datasets for classification experiments. Compared with the KELM optimized by WOA, the EAWOA optimized KELM in this paper has a significant improvement in performance, with a 5%-6% lead on some datasets, indicating the effectiveness of EAWOA-KELM in classification tasks. |
| format | Article |
| id | doaj-art-666a40b33de64de4bae04c8d577aa981 |
| institution | Kabale University |
| issn | 1932-6203 |
| language | English |
| publishDate | 2025-01-01 |
| publisher | Public Library of Science (PLoS) |
| record_format | Article |
| series | PLoS ONE |
| spelling | doaj-art-666a40b33de64de4bae04c8d577aa9812025-01-08T05:31:44ZengPublic Library of Science (PLoS)PLoS ONE1932-62032025-01-01201e030974110.1371/journal.pone.0309741Optimizing Kernel Extreme Learning Machine based on a Enhanced Adaptive Whale Optimization Algorithm for classification task.ZeSheng LinData classification is an important research direction in machine learning. In order to effectively handle extensive datasets, researchers have introduced diverse classification algorithms. Notably, Kernel Extreme Learning Machine (KELM), as a fast and effective classification method, has received widespread attention. However, traditional KELM algorithms have some problems when dealing with large-scale data, such as the need to adjust hyperparameters, poor interpretability, and low classification accuracy. To address these problems, this paper proposes an Enhanced Adaptive Whale Optimization Algorithm to optimize Kernel Extreme Learning Machine (EAWOA-KELM). Various methods were used to improve WOA. As a first step, a novel adaptive perturbation technique employing T-distribution is proposed to perturb the optimal position and avoid being trapped in a local maximum. Secondly, the WOA's position update formula was modified by incorporating inertia weight ω and enhancing convergence factor α, thus improving its capability for local search. Furthermore, inspired by the grey wolf optimization algorithm, use 3 excellent particle surround strategies instead of the original random selecting particles. Finally, a novel Levy flight was implemented to promote the diversity of whale distribution. Results from experiments confirm that the enhanced WOA algorithm outperforms the standard WOA algorithm in terms of both fitness value and convergence speed. EAWOA demonstrates superior optimization accuracy compared to WOA across 21 test functions, with a notable edge on certain functions. The application of the upgraded WOA algorithm in KELM significantly improves the accuracy and efficiency of data classification by optimizing hyperparameters. This paper selects 7 datasets for classification experiments. Compared with the KELM optimized by WOA, the EAWOA optimized KELM in this paper has a significant improvement in performance, with a 5%-6% lead on some datasets, indicating the effectiveness of EAWOA-KELM in classification tasks.https://doi.org/10.1371/journal.pone.0309741 |
| spellingShingle | ZeSheng Lin Optimizing Kernel Extreme Learning Machine based on a Enhanced Adaptive Whale Optimization Algorithm for classification task. PLoS ONE |
| title | Optimizing Kernel Extreme Learning Machine based on a Enhanced Adaptive Whale Optimization Algorithm for classification task. |
| title_full | Optimizing Kernel Extreme Learning Machine based on a Enhanced Adaptive Whale Optimization Algorithm for classification task. |
| title_fullStr | Optimizing Kernel Extreme Learning Machine based on a Enhanced Adaptive Whale Optimization Algorithm for classification task. |
| title_full_unstemmed | Optimizing Kernel Extreme Learning Machine based on a Enhanced Adaptive Whale Optimization Algorithm for classification task. |
| title_short | Optimizing Kernel Extreme Learning Machine based on a Enhanced Adaptive Whale Optimization Algorithm for classification task. |
| title_sort | optimizing kernel extreme learning machine based on a enhanced adaptive whale optimization algorithm for classification task |
| url | https://doi.org/10.1371/journal.pone.0309741 |
| work_keys_str_mv | AT zeshenglin optimizingkernelextremelearningmachinebasedonaenhancedadaptivewhaleoptimizationalgorithmforclassificationtask |