Research on deep reinforcement learning in Internet of vehicles edge computing based on Quasi-Newton method
To address the issues of ineffective task offloading decisions caused by multitasking and resource constraints in vehicular networks, the Quasi-Newton method deep reinforcement learning dual-phase online offloading (QNRLO) algorithm was proposed. The algorithm was designed by initially incorporating...
Saved in:
| Main Authors: | , , , |
|---|---|
| Format: | Article |
| Language: | zho |
| Published: |
Editorial Department of Journal on Communications
2024-05-01
|
| Series: | Tongxin xuebao |
| Subjects: | |
| Online Access: | http://www.joconline.com.cn/zh/article/doi/10.11959/j.issn.1000-436x.2024101/ |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1841539212291080192 |
|---|---|
| author | ZHANG Jianwu LU Zetao ZHANG Qianhua ZHAN Ming |
| author_facet | ZHANG Jianwu LU Zetao ZHANG Qianhua ZHAN Ming |
| author_sort | ZHANG Jianwu |
| collection | DOAJ |
| description | To address the issues of ineffective task offloading decisions caused by multitasking and resource constraints in vehicular networks, the Quasi-Newton method deep reinforcement learning dual-phase online offloading (QNRLO) algorithm was proposed. The algorithm was designed by initially incorporating batch normalization techniques to optimize the training process of deep neural networks. Subsequently, optimization was performed using the Quasi-Newton method to effectively approximate the optimal solution. Through this dual-stage optimization, performance was significantly enhanced under conditions of multitasking and dynamic wireless channels, improving computational efficiency. By introducing Lagrange multipliers and a reconstructed dual function, the non-convex optimization problem was transformed into a convex optimization problem of the dual function, ensuring the global optimality of the algorithm. Additionally, system transmission time allocation in the vehicular network model was considered, enhancing the practicality of the algorithm. Compared to existing algorithms, the proposed algorithm improves the convergence and stability of task offloading significantly, addresses task offloading issues in vehicular networks effectively, and offers high practicality and reliability. |
| format | Article |
| id | doaj-art-899cd6f45c4346e7b981ce3649b61289 |
| institution | Kabale University |
| issn | 1000-436X |
| language | zho |
| publishDate | 2024-05-01 |
| publisher | Editorial Department of Journal on Communications |
| record_format | Article |
| series | Tongxin xuebao |
| spelling | doaj-art-899cd6f45c4346e7b981ce3649b612892025-01-14T07:24:23ZzhoEditorial Department of Journal on CommunicationsTongxin xuebao1000-436X2024-05-01459010062276645Research on deep reinforcement learning in Internet of vehicles edge computing based on Quasi-Newton methodZHANG JianwuLU ZetaoZHANG QianhuaZHAN MingTo address the issues of ineffective task offloading decisions caused by multitasking and resource constraints in vehicular networks, the Quasi-Newton method deep reinforcement learning dual-phase online offloading (QNRLO) algorithm was proposed. The algorithm was designed by initially incorporating batch normalization techniques to optimize the training process of deep neural networks. Subsequently, optimization was performed using the Quasi-Newton method to effectively approximate the optimal solution. Through this dual-stage optimization, performance was significantly enhanced under conditions of multitasking and dynamic wireless channels, improving computational efficiency. By introducing Lagrange multipliers and a reconstructed dual function, the non-convex optimization problem was transformed into a convex optimization problem of the dual function, ensuring the global optimality of the algorithm. Additionally, system transmission time allocation in the vehicular network model was considered, enhancing the practicality of the algorithm. Compared to existing algorithms, the proposed algorithm improves the convergence and stability of task offloading significantly, addresses task offloading issues in vehicular networks effectively, and offers high practicality and reliability.http://www.joconline.com.cn/zh/article/doi/10.11959/j.issn.1000-436x.2024101/Internet of vehiclestask offloadingdeep reinforcement learningQuasi-Newton method |
| spellingShingle | ZHANG Jianwu LU Zetao ZHANG Qianhua ZHAN Ming Research on deep reinforcement learning in Internet of vehicles edge computing based on Quasi-Newton method Tongxin xuebao Internet of vehicles task offloading deep reinforcement learning Quasi-Newton method |
| title | Research on deep reinforcement learning in Internet of vehicles edge computing based on Quasi-Newton method |
| title_full | Research on deep reinforcement learning in Internet of vehicles edge computing based on Quasi-Newton method |
| title_fullStr | Research on deep reinforcement learning in Internet of vehicles edge computing based on Quasi-Newton method |
| title_full_unstemmed | Research on deep reinforcement learning in Internet of vehicles edge computing based on Quasi-Newton method |
| title_short | Research on deep reinforcement learning in Internet of vehicles edge computing based on Quasi-Newton method |
| title_sort | research on deep reinforcement learning in internet of vehicles edge computing based on quasi newton method |
| topic | Internet of vehicles task offloading deep reinforcement learning Quasi-Newton method |
| url | http://www.joconline.com.cn/zh/article/doi/10.11959/j.issn.1000-436x.2024101/ |
| work_keys_str_mv | AT zhangjianwu researchondeepreinforcementlearningininternetofvehiclesedgecomputingbasedonquasinewtonmethod AT luzetao researchondeepreinforcementlearningininternetofvehiclesedgecomputingbasedonquasinewtonmethod AT zhangqianhua researchondeepreinforcementlearningininternetofvehiclesedgecomputingbasedonquasinewtonmethod AT zhanming researchondeepreinforcementlearningininternetofvehiclesedgecomputingbasedonquasinewtonmethod |