Joint beam hopping and coverage control optimization algorithm for multibeam satellite system

To improve the performance of multibeam satellite (MBS) systems, a deep reinforcement learning-based algorithm to jointly optimize the beam hopping and coverage control (BHCC) algorithm for MBS was proposed.Firstly, the resource allocation problem in MBS was transformed to a multi-objective optimiza...

Full description

Saved in:
Bibliographic Details
Main Authors: Guoliang XU, Feng TAN, Yongyi RAN, Feng CHEN
Format: Article
Language:zho
Published: Editorial Department of Journal on Communications 2023-04-01
Series:Tongxin xuebao
Subjects:
Online Access:http://www.joconline.com.cn/zh/article/doi/10.11959/j.issn.1000-436x.2023076/
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1841540010711449600
author Guoliang XU
Feng TAN
Yongyi RAN
Feng CHEN
author_facet Guoliang XU
Feng TAN
Yongyi RAN
Feng CHEN
author_sort Guoliang XU
collection DOAJ
description To improve the performance of multibeam satellite (MBS) systems, a deep reinforcement learning-based algorithm to jointly optimize the beam hopping and coverage control (BHCC) algorithm for MBS was proposed.Firstly, the resource allocation problem in MBS was transformed to a multi-objective optimization problem with the objective maximizing the system throughput and minimizing the packet loss rate of the MBS.Secondly, the MBS environment was characterized as a multi-dimensional matrix, and the objective problem was modelled as a Markov decision process considering stochastic communication requirements.Finally, the objective problem was solved by combining the powerful feature extraction and learning capabilities of deep reinforcement learning.In addition, a single-intelligence polling multiplexing mechanism was proposed to reduce the search space and convergence difficulty and accelerate the training of BHCC.Compared with the genetic algorithm, the simulation results show that BHCC improves the throughput of MBS and reduces the packet loss rate of the system, greedy algorithm, and random algorithm.Besides, BHCC performs better in different communication scenarios compared with a deep reinforcement learning algorithm, which do not consider the adaptive beam coverage.
format Article
id doaj-art-473f792e26f2492db45f39d3bb36b064
institution Kabale University
issn 1000-436X
language zho
publishDate 2023-04-01
publisher Editorial Department of Journal on Communications
record_format Article
series Tongxin xuebao
spelling doaj-art-473f792e26f2492db45f39d3bb36b0642025-01-14T06:28:24ZzhoEditorial Department of Journal on CommunicationsTongxin xuebao1000-436X2023-04-0144788659390216Joint beam hopping and coverage control optimization algorithm for multibeam satellite systemGuoliang XUFeng TANYongyi RANFeng CHENTo improve the performance of multibeam satellite (MBS) systems, a deep reinforcement learning-based algorithm to jointly optimize the beam hopping and coverage control (BHCC) algorithm for MBS was proposed.Firstly, the resource allocation problem in MBS was transformed to a multi-objective optimization problem with the objective maximizing the system throughput and minimizing the packet loss rate of the MBS.Secondly, the MBS environment was characterized as a multi-dimensional matrix, and the objective problem was modelled as a Markov decision process considering stochastic communication requirements.Finally, the objective problem was solved by combining the powerful feature extraction and learning capabilities of deep reinforcement learning.In addition, a single-intelligence polling multiplexing mechanism was proposed to reduce the search space and convergence difficulty and accelerate the training of BHCC.Compared with the genetic algorithm, the simulation results show that BHCC improves the throughput of MBS and reduces the packet loss rate of the system, greedy algorithm, and random algorithm.Besides, BHCC performs better in different communication scenarios compared with a deep reinforcement learning algorithm, which do not consider the adaptive beam coverage.http://www.joconline.com.cn/zh/article/doi/10.11959/j.issn.1000-436x.2023076/multibeam satellitedeep reinforcement learningbeam hopping technologybeam coverage control
spellingShingle Guoliang XU
Feng TAN
Yongyi RAN
Feng CHEN
Joint beam hopping and coverage control optimization algorithm for multibeam satellite system
Tongxin xuebao
multibeam satellite
deep reinforcement learning
beam hopping technology
beam coverage control
title Joint beam hopping and coverage control optimization algorithm for multibeam satellite system
title_full Joint beam hopping and coverage control optimization algorithm for multibeam satellite system
title_fullStr Joint beam hopping and coverage control optimization algorithm for multibeam satellite system
title_full_unstemmed Joint beam hopping and coverage control optimization algorithm for multibeam satellite system
title_short Joint beam hopping and coverage control optimization algorithm for multibeam satellite system
title_sort joint beam hopping and coverage control optimization algorithm for multibeam satellite system
topic multibeam satellite
deep reinforcement learning
beam hopping technology
beam coverage control
url http://www.joconline.com.cn/zh/article/doi/10.11959/j.issn.1000-436x.2023076/
work_keys_str_mv AT guoliangxu jointbeamhoppingandcoveragecontroloptimizationalgorithmformultibeamsatellitesystem
AT fengtan jointbeamhoppingandcoveragecontroloptimizationalgorithmformultibeamsatellitesystem
AT yongyiran jointbeamhoppingandcoveragecontroloptimizationalgorithmformultibeamsatellitesystem
AT fengchen jointbeamhoppingandcoveragecontroloptimizationalgorithmformultibeamsatellitesystem