Multi-agent reinforcement learning based dynamic optimization algorithm of CRE offset for heterogeneous networks

To cope with the high throughput demand caused by the proliferation of wireless network users, a multi-agent reinforcement learning based dynamic optimization algorithm of cell range expansion (CRE) offset was proposed for interference scenarios in macro-pico heterogeneous networks.Based on the valu...

Full description

Saved in:
Bibliographic Details
Main Authors: Cheng ZHANG, Jiaye ZHU, Zening LIU, Yongming HUANG
Format: Article
Language:zho
Published: Editorial Department of Journal on Communications 2023-12-01
Series:Tongxin xuebao
Subjects:
Online Access:http://www.joconline.com.cn/zh/article/doi/10.11959/j.issn.1000-436x.2023235/
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1841540015355592704
author Cheng ZHANG
Jiaye ZHU
Zening LIU
Yongming HUANG
author_facet Cheng ZHANG
Jiaye ZHU
Zening LIU
Yongming HUANG
author_sort Cheng ZHANG
collection DOAJ
description To cope with the high throughput demand caused by the proliferation of wireless network users, a multi-agent reinforcement learning based dynamic optimization algorithm of cell range expansion (CRE) offset was proposed for interference scenarios in macro-pico heterogeneous networks.Based on the value decomposition network framework of collaborative multi-agent reinforcement learning, a personalized online local decision of CRE offset for all pico-base stations was achieved by reasonably utilizing and interacting the intra-system user distribution and their interference levels among pico-base stations.Simulation results show that the proposed algorithm has significant advantages in increasing system throughput, balancing the throughput of each base station and improving edge-user throughput, compared to CRE=5 dB and distributed Q-learning algorithms.
format Article
id doaj-art-09d0987957c44f829cbb6777ba75e428
institution Kabale University
issn 1000-436X
language zho
publishDate 2023-12-01
publisher Editorial Department of Journal on Communications
record_format Article
series Tongxin xuebao
spelling doaj-art-09d0987957c44f829cbb6777ba75e4282025-01-14T06:22:28ZzhoEditorial Department of Journal on CommunicationsTongxin xuebao1000-436X2023-12-0144869859384534Multi-agent reinforcement learning based dynamic optimization algorithm of CRE offset for heterogeneous networksCheng ZHANGJiaye ZHUZening LIUYongming HUANGTo cope with the high throughput demand caused by the proliferation of wireless network users, a multi-agent reinforcement learning based dynamic optimization algorithm of cell range expansion (CRE) offset was proposed for interference scenarios in macro-pico heterogeneous networks.Based on the value decomposition network framework of collaborative multi-agent reinforcement learning, a personalized online local decision of CRE offset for all pico-base stations was achieved by reasonably utilizing and interacting the intra-system user distribution and their interference levels among pico-base stations.Simulation results show that the proposed algorithm has significant advantages in increasing system throughput, balancing the throughput of each base station and improving edge-user throughput, compared to CRE=5 dB and distributed Q-learning algorithms.http://www.joconline.com.cn/zh/article/doi/10.11959/j.issn.1000-436x.2023235/heterogeneous networkcell range expansionmulti-agent reinforcement learningvalue decomposition network algorithm
spellingShingle Cheng ZHANG
Jiaye ZHU
Zening LIU
Yongming HUANG
Multi-agent reinforcement learning based dynamic optimization algorithm of CRE offset for heterogeneous networks
Tongxin xuebao
heterogeneous network
cell range expansion
multi-agent reinforcement learning
value decomposition network algorithm
title Multi-agent reinforcement learning based dynamic optimization algorithm of CRE offset for heterogeneous networks
title_full Multi-agent reinforcement learning based dynamic optimization algorithm of CRE offset for heterogeneous networks
title_fullStr Multi-agent reinforcement learning based dynamic optimization algorithm of CRE offset for heterogeneous networks
title_full_unstemmed Multi-agent reinforcement learning based dynamic optimization algorithm of CRE offset for heterogeneous networks
title_short Multi-agent reinforcement learning based dynamic optimization algorithm of CRE offset for heterogeneous networks
title_sort multi agent reinforcement learning based dynamic optimization algorithm of cre offset for heterogeneous networks
topic heterogeneous network
cell range expansion
multi-agent reinforcement learning
value decomposition network algorithm
url http://www.joconline.com.cn/zh/article/doi/10.11959/j.issn.1000-436x.2023235/
work_keys_str_mv AT chengzhang multiagentreinforcementlearningbaseddynamicoptimizationalgorithmofcreoffsetforheterogeneousnetworks
AT jiayezhu multiagentreinforcementlearningbaseddynamicoptimizationalgorithmofcreoffsetforheterogeneousnetworks
AT zeningliu multiagentreinforcementlearningbaseddynamicoptimizationalgorithmofcreoffsetforheterogeneousnetworks
AT yongminghuang multiagentreinforcementlearningbaseddynamicoptimizationalgorithmofcreoffsetforheterogeneousnetworks