Energy-efficient strategy for data migration and merging in Storm
Storm is suffering the problems of high energy consumption but low efficiency.Aiming at this problem,the resource constraint model,the optimal principle of data reorganization in executors and node voltage reduction principle were proposed based on the analysis of the architecture and topology of St...
Saved in:
| Main Authors: | , , , , , |
|---|---|
| Format: | Article |
| Language: | zho |
| Published: |
Editorial Department of Journal on Communications
2019-12-01
|
| Series: | Tongxin xuebao |
| Subjects: | |
| Online Access: | http://www.joconline.com.cn/zh/article/doi/10.11959/j.issn.1000-436x.2019226/ |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1841539393946386432 |
|---|---|
| author | Yonglin PU Jiong YU Liang LU Ziyang LI Chen BIAN Bin LIAO |
| author_facet | Yonglin PU Jiong YU Liang LU Ziyang LI Chen BIAN Bin LIAO |
| author_sort | Yonglin PU |
| collection | DOAJ |
| description | Storm is suffering the problems of high energy consumption but low efficiency.Aiming at this problem,the resource constraint model,the optimal principle of data reorganization in executors and node voltage reduction principle were proposed based on the analysis of the architecture and topology of Storm,and further the energy-efficient strategy for data migration and merging was put forward in Storm(DMM-Storm),which was composed of resource constraint algorithm,data migration and merging algorithm as well as node voltage reduction algorithm.The resource constraint algorithm estimates whether work nodes are appropriate for data migration according to the resource constraint model.The data migration and merging algorithm designs an optimal method to migrate data according to the the optimal principle of data reorganization in executors.The node voltage reduction algorithm reduces voltage of work nodes according to node voltage reduction principle.The experimental results show that the DMM-Storm can reduce energy consumption efficiently without affecting the performance of cluster compared with the existing researches. |
| format | Article |
| id | doaj-art-f2e46f42827e4ed7a63f792cf3f086c3 |
| institution | Kabale University |
| issn | 1000-436X |
| language | zho |
| publishDate | 2019-12-01 |
| publisher | Editorial Department of Journal on Communications |
| record_format | Article |
| series | Tongxin xuebao |
| spelling | doaj-art-f2e46f42827e4ed7a63f792cf3f086c32025-01-14T07:18:04ZzhoEditorial Department of Journal on CommunicationsTongxin xuebao1000-436X2019-12-0140688559730817Energy-efficient strategy for data migration and merging in StormYonglin PUJiong YULiang LUZiyang LIChen BIANBin LIAOStorm is suffering the problems of high energy consumption but low efficiency.Aiming at this problem,the resource constraint model,the optimal principle of data reorganization in executors and node voltage reduction principle were proposed based on the analysis of the architecture and topology of Storm,and further the energy-efficient strategy for data migration and merging was put forward in Storm(DMM-Storm),which was composed of resource constraint algorithm,data migration and merging algorithm as well as node voltage reduction algorithm.The resource constraint algorithm estimates whether work nodes are appropriate for data migration according to the resource constraint model.The data migration and merging algorithm designs an optimal method to migrate data according to the the optimal principle of data reorganization in executors.The node voltage reduction algorithm reduces voltage of work nodes according to node voltage reduction principle.The experimental results show that the DMM-Storm can reduce energy consumption efficiently without affecting the performance of cluster compared with the existing researches.http://www.joconline.com.cn/zh/article/doi/10.11959/j.issn.1000-436x.2019226/big datastormresource constraintdata migrationenergy consumption |
| spellingShingle | Yonglin PU Jiong YU Liang LU Ziyang LI Chen BIAN Bin LIAO Energy-efficient strategy for data migration and merging in Storm Tongxin xuebao big data storm resource constraint data migration energy consumption |
| title | Energy-efficient strategy for data migration and merging in Storm |
| title_full | Energy-efficient strategy for data migration and merging in Storm |
| title_fullStr | Energy-efficient strategy for data migration and merging in Storm |
| title_full_unstemmed | Energy-efficient strategy for data migration and merging in Storm |
| title_short | Energy-efficient strategy for data migration and merging in Storm |
| title_sort | energy efficient strategy for data migration and merging in storm |
| topic | big data storm resource constraint data migration energy consumption |
| url | http://www.joconline.com.cn/zh/article/doi/10.11959/j.issn.1000-436x.2019226/ |
| work_keys_str_mv | AT yonglinpu energyefficientstrategyfordatamigrationandmerginginstorm AT jiongyu energyefficientstrategyfordatamigrationandmerginginstorm AT lianglu energyefficientstrategyfordatamigrationandmerginginstorm AT ziyangli energyefficientstrategyfordatamigrationandmerginginstorm AT chenbian energyefficientstrategyfordatamigrationandmerginginstorm AT binliao energyefficientstrategyfordatamigrationandmerginginstorm |