Cooperative service caching and peer offloading in Internet of vehicles based on multi-agent meta-reinforcement learning
In order to reduce computation complexity, a two-layer mutli-RSU (road side unit) service caching and peer offloading algorithm (MPO) was proposed to decouple the optimization problem.In the designed MPO, the outer layer utilized multi-agent meta-reinforcement learning, which established long short-...
Saved in:
| Main Authors: | , , , |
|---|---|
| Format: | Article |
| Language: | zho |
| Published: |
Editorial Department of Journal on Communications
2021-06-01
|
| Series: | Tongxin xuebao |
| Subjects: | |
| Online Access: | http://www.joconline.com.cn/zh/article/doi/10.11959/j.issn.1000-436x.2021104/ |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1841539302867075072 |
|---|---|
| author | Zhaolong NING Kaiyuan ZHANG Xiaojie WANG Lei GUO |
| author_facet | Zhaolong NING Kaiyuan ZHANG Xiaojie WANG Lei GUO |
| author_sort | Zhaolong NING |
| collection | DOAJ |
| description | In order to reduce computation complexity, a two-layer mutli-RSU (road side unit) service caching and peer offloading algorithm (MPO) was proposed to decouple the optimization problem.In the designed MPO, the outer layer utilized multi-agent meta-reinforcement learning, which established long short-term memory (LSTM) network as the meta-agent to balance decisions of local agents and accelerate learning progress.The inner layer utilized lagrange multiplier method to achieve optimal decision for RSU peer offloading.Experimental results based on real traffic data in Hangzhou demonstrate that the proposed method outperforms other methods and remains robust under large-scale workloads. |
| format | Article |
| id | doaj-art-b4b166c4157549a7bc336a73c9c6af38 |
| institution | Kabale University |
| issn | 1000-436X |
| language | zho |
| publishDate | 2021-06-01 |
| publisher | Editorial Department of Journal on Communications |
| record_format | Article |
| series | Tongxin xuebao |
| spelling | doaj-art-b4b166c4157549a7bc336a73c9c6af382025-01-14T07:22:09ZzhoEditorial Department of Journal on CommunicationsTongxin xuebao1000-436X2021-06-014211813059742005Cooperative service caching and peer offloading in Internet of vehicles based on multi-agent meta-reinforcement learningZhaolong NINGKaiyuan ZHANGXiaojie WANGLei GUOIn order to reduce computation complexity, a two-layer mutli-RSU (road side unit) service caching and peer offloading algorithm (MPO) was proposed to decouple the optimization problem.In the designed MPO, the outer layer utilized multi-agent meta-reinforcement learning, which established long short-term memory (LSTM) network as the meta-agent to balance decisions of local agents and accelerate learning progress.The inner layer utilized lagrange multiplier method to achieve optimal decision for RSU peer offloading.Experimental results based on real traffic data in Hangzhou demonstrate that the proposed method outperforms other methods and remains robust under large-scale workloads.http://www.joconline.com.cn/zh/article/doi/10.11959/j.issn.1000-436x.2021104/Internet of vehiclesedge service cachingcooperative offloadingmeta-reinforcement learning |
| spellingShingle | Zhaolong NING Kaiyuan ZHANG Xiaojie WANG Lei GUO Cooperative service caching and peer offloading in Internet of vehicles based on multi-agent meta-reinforcement learning Tongxin xuebao Internet of vehicles edge service caching cooperative offloading meta-reinforcement learning |
| title | Cooperative service caching and peer offloading in Internet of vehicles based on multi-agent meta-reinforcement learning |
| title_full | Cooperative service caching and peer offloading in Internet of vehicles based on multi-agent meta-reinforcement learning |
| title_fullStr | Cooperative service caching and peer offloading in Internet of vehicles based on multi-agent meta-reinforcement learning |
| title_full_unstemmed | Cooperative service caching and peer offloading in Internet of vehicles based on multi-agent meta-reinforcement learning |
| title_short | Cooperative service caching and peer offloading in Internet of vehicles based on multi-agent meta-reinforcement learning |
| title_sort | cooperative service caching and peer offloading in internet of vehicles based on multi agent meta reinforcement learning |
| topic | Internet of vehicles edge service caching cooperative offloading meta-reinforcement learning |
| url | http://www.joconline.com.cn/zh/article/doi/10.11959/j.issn.1000-436x.2021104/ |
| work_keys_str_mv | AT zhaolongning cooperativeservicecachingandpeeroffloadingininternetofvehiclesbasedonmultiagentmetareinforcementlearning AT kaiyuanzhang cooperativeservicecachingandpeeroffloadingininternetofvehiclesbasedonmultiagentmetareinforcementlearning AT xiaojiewang cooperativeservicecachingandpeeroffloadingininternetofvehiclesbasedonmultiagentmetareinforcementlearning AT leiguo cooperativeservicecachingandpeeroffloadingininternetofvehiclesbasedonmultiagentmetareinforcementlearning |