Energy-efficient optimization strategy based on elastic data migration in big data streaming platform
Focused on the problem that the stream computing platform was suffering from the high energy consumption and low efficiency due to the lack of consideration for energy efficiency in designing process, an energy-efficient optimization strategy based on elastic data migration in big data streaming pla...
Saved in:
| Main Authors: | , , , , |
|---|---|
| Format: | Article |
| Language: | zho |
| Published: |
Editorial Department of Journal on Communications
2024-02-01
|
| Series: | Tongxin xuebao |
| Subjects: | |
| Online Access: | http://www.joconline.com.cn/zh/article/doi/10.11959/j.issn.1000-436x.2024006/ |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1841540046796095488 |
|---|---|
| author | Yonglin PU Xiaolong XU Jiong YU Ziyang LI Binglei GUO |
| author_facet | Yonglin PU Xiaolong XU Jiong YU Ziyang LI Binglei GUO |
| author_sort | Yonglin PU |
| collection | DOAJ |
| description | Focused on the problem that the stream computing platform was suffering from the high energy consumption and low efficiency due to the lack of consideration for energy efficiency in designing process, an energy-efficient optimization strategy based on elastic data migration in big data streaming platform (EEDM-BDSP) was proposed.Firstly, models of the load prediction and the resource judgment were set up, and the load prediction algorithm was designed, which predicted the load tendency and determine node resource occupancy, so as to find nodes of resource overload and redundancy.Secondly, models of the resource constraint and the optimal data migration were set up, and the optimal data migration algorithm was proposed, which data migration for the purpose of improving node resource utilization.Finally, model of the energy consumption was set up to calculate the energy consumption saved by the cluster after data migration.The experimental results show that the EEDM-BDSP changes node resources in the cluster can responded on time, the resource utilization and the energy-efficient are improved. |
| format | Article |
| id | doaj-art-6b7b1c437f734cd1844d316b0f486b8e |
| institution | Kabale University |
| issn | 1000-436X |
| language | zho |
| publishDate | 2024-02-01 |
| publisher | Editorial Department of Journal on Communications |
| record_format | Article |
| series | Tongxin xuebao |
| spelling | doaj-art-6b7b1c437f734cd1844d316b0f486b8e2025-01-14T06:22:09ZzhoEditorial Department of Journal on CommunicationsTongxin xuebao1000-436X2024-02-014518820059383511Energy-efficient optimization strategy based on elastic data migration in big data streaming platformYonglin PUXiaolong XUJiong YUZiyang LIBinglei GUOFocused on the problem that the stream computing platform was suffering from the high energy consumption and low efficiency due to the lack of consideration for energy efficiency in designing process, an energy-efficient optimization strategy based on elastic data migration in big data streaming platform (EEDM-BDSP) was proposed.Firstly, models of the load prediction and the resource judgment were set up, and the load prediction algorithm was designed, which predicted the load tendency and determine node resource occupancy, so as to find nodes of resource overload and redundancy.Secondly, models of the resource constraint and the optimal data migration were set up, and the optimal data migration algorithm was proposed, which data migration for the purpose of improving node resource utilization.Finally, model of the energy consumption was set up to calculate the energy consumption saved by the cluster after data migration.The experimental results show that the EEDM-BDSP changes node resources in the cluster can responded on time, the resource utilization and the energy-efficient are improved.http://www.joconline.com.cn/zh/article/doi/10.11959/j.issn.1000-436x.2024006/stream computingload predictionresource constraintdata migrationenergy-efficient |
| spellingShingle | Yonglin PU Xiaolong XU Jiong YU Ziyang LI Binglei GUO Energy-efficient optimization strategy based on elastic data migration in big data streaming platform Tongxin xuebao stream computing load prediction resource constraint data migration energy-efficient |
| title | Energy-efficient optimization strategy based on elastic data migration in big data streaming platform |
| title_full | Energy-efficient optimization strategy based on elastic data migration in big data streaming platform |
| title_fullStr | Energy-efficient optimization strategy based on elastic data migration in big data streaming platform |
| title_full_unstemmed | Energy-efficient optimization strategy based on elastic data migration in big data streaming platform |
| title_short | Energy-efficient optimization strategy based on elastic data migration in big data streaming platform |
| title_sort | energy efficient optimization strategy based on elastic data migration in big data streaming platform |
| topic | stream computing load prediction resource constraint data migration energy-efficient |
| url | http://www.joconline.com.cn/zh/article/doi/10.11959/j.issn.1000-436x.2024006/ |
| work_keys_str_mv | AT yonglinpu energyefficientoptimizationstrategybasedonelasticdatamigrationinbigdatastreamingplatform AT xiaolongxu energyefficientoptimizationstrategybasedonelasticdatamigrationinbigdatastreamingplatform AT jiongyu energyefficientoptimizationstrategybasedonelasticdatamigrationinbigdatastreamingplatform AT ziyangli energyefficientoptimizationstrategybasedonelasticdatamigrationinbigdatastreamingplatform AT bingleiguo energyefficientoptimizationstrategybasedonelasticdatamigrationinbigdatastreamingplatform |