A distributed CRN resource allocation algorithm based on CBR and cooperative Q-learning
In order to solve the problem of channel and power allocation in distributed cognitive radio networks (CRN),a case-based reasoning (CBR) and cooperative Q-learning algorithm was proposed.In order to optimize the Q initialization of Q-learning algorithm,the current problem and the historical case wer...
Saved in:
| Main Authors: | , |
|---|---|
| Format: | Article |
| Language: | zho |
| Published: |
Beijing Xintong Media Co., Ltd
2019-02-01
|
| Series: | Dianxin kexue |
| Subjects: | |
| Online Access: | http://www.telecomsci.com/zh/article/doi/10.11959/j.issn.1000-0801.2019005/ |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1841530478605107200 |
|---|---|
| author | Lin XU Zhijin ZHAO |
| author_facet | Lin XU Zhijin ZHAO |
| author_sort | Lin XU |
| collection | DOAJ |
| description | In order to solve the problem of channel and power allocation in distributed cognitive radio networks (CRN),a case-based reasoning (CBR) and cooperative Q-learning algorithm was proposed.In order to optimize the Q initialization of Q-learning algorithm,the current problem and the historical case were matched according to the similarity function,the Q value of the matching case was extracted and normalized as the initial value.Cooperative Q-learning was based on the total reward value,and each agent integrates the Q values of other agents with higher reward values with different weights to gain learning experience to reduce unnecessary exploration.Simulations show that the proposed algorithm can improve the energy efficiency of the cognitive system’s channel and power allocation,and accelerate the convergence speed of the system. |
| format | Article |
| id | doaj-art-cdffc8b39cdb412cbc7d472cc239ee11 |
| institution | Kabale University |
| issn | 1000-0801 |
| language | zho |
| publishDate | 2019-02-01 |
| publisher | Beijing Xintong Media Co., Ltd |
| record_format | Article |
| series | Dianxin kexue |
| spelling | doaj-art-cdffc8b39cdb412cbc7d472cc239ee112025-01-15T03:03:17ZzhoBeijing Xintong Media Co., LtdDianxin kexue1000-08012019-02-0135354259590941A distributed CRN resource allocation algorithm based on CBR and cooperative Q-learningLin XUZhijin ZHAOIn order to solve the problem of channel and power allocation in distributed cognitive radio networks (CRN),a case-based reasoning (CBR) and cooperative Q-learning algorithm was proposed.In order to optimize the Q initialization of Q-learning algorithm,the current problem and the historical case were matched according to the similarity function,the Q value of the matching case was extracted and normalized as the initial value.Cooperative Q-learning was based on the total reward value,and each agent integrates the Q values of other agents with higher reward values with different weights to gain learning experience to reduce unnecessary exploration.Simulations show that the proposed algorithm can improve the energy efficiency of the cognitive system’s channel and power allocation,and accelerate the convergence speed of the system.http://www.telecomsci.com/zh/article/doi/10.11959/j.issn.1000-0801.2019005/cognitive radiocooperative Q-learningcase-based reasoningchannel and power allocationenergy efficiencyconvergence speed |
| spellingShingle | Lin XU Zhijin ZHAO A distributed CRN resource allocation algorithm based on CBR and cooperative Q-learning Dianxin kexue cognitive radio cooperative Q-learning case-based reasoning channel and power allocation energy efficiency convergence speed |
| title | A distributed CRN resource allocation algorithm based on CBR and cooperative Q-learning |
| title_full | A distributed CRN resource allocation algorithm based on CBR and cooperative Q-learning |
| title_fullStr | A distributed CRN resource allocation algorithm based on CBR and cooperative Q-learning |
| title_full_unstemmed | A distributed CRN resource allocation algorithm based on CBR and cooperative Q-learning |
| title_short | A distributed CRN resource allocation algorithm based on CBR and cooperative Q-learning |
| title_sort | distributed crn resource allocation algorithm based on cbr and cooperative q learning |
| topic | cognitive radio cooperative Q-learning case-based reasoning channel and power allocation energy efficiency convergence speed |
| url | http://www.telecomsci.com/zh/article/doi/10.11959/j.issn.1000-0801.2019005/ |
| work_keys_str_mv | AT linxu adistributedcrnresourceallocationalgorithmbasedoncbrandcooperativeqlearning AT zhijinzhao adistributedcrnresourceallocationalgorithmbasedoncbrandcooperativeqlearning AT linxu distributedcrnresourceallocationalgorithmbasedoncbrandcooperativeqlearning AT zhijinzhao distributedcrnresourceallocationalgorithmbasedoncbrandcooperativeqlearning |