Adaptive Improved Q-Learning Path Planning Algorithm Based on Obstacle Learning Matrix and Artificial Potential Field
To address the issues of exploration imbalance and slow convergence speed in the Q-learning path planning algorithm, an adaptive improved Q-learning path planning algorithm based on an obstacle learning matrix and artificial potential field (APF) is proposed. First, an obstacle learning matrix is es...
Saved in:
| Main Authors: | , , , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
Wiley
2024-01-01
|
| Series: | Journal of Electrical and Computer Engineering |
| Online Access: | http://dx.doi.org/10.1155/jece/3110053 |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1841555836246163456 |
|---|---|
| author | Lieping Zhang Hongyuan Chen Xiaoxu Shi Jianchu Zou Yilin Wang |
| author_facet | Lieping Zhang Hongyuan Chen Xiaoxu Shi Jianchu Zou Yilin Wang |
| author_sort | Lieping Zhang |
| collection | DOAJ |
| description | To address the issues of exploration imbalance and slow convergence speed in the Q-learning path planning algorithm, an adaptive improved Q-learning path planning algorithm based on an obstacle learning matrix and artificial potential field (APF) is proposed. First, an obstacle learning matrix is established to store the positions of obstacles encountered in each learning iteration, avoiding redundant learning of the same obstacle. Second, an adaptive exploration enhancement strategy is introduced by incorporating the concept of success rate. This strategy divides the decay process of the exploration rate into an exploration-dominant initial stage and an exploitation-dominant later stage. Finally, an APF-weighted action selection strategy is introduced, utilizing the guiding force generated by the APF to encourage the mobile robot to avoid obstacles more efficiently. Simulation results show that the proposed method can effectively reduce the number of iterations and time consumption in the optimization process, resulting in a smoother and more stable planned path. |
| format | Article |
| id | doaj-art-735c7fb30fc74ae7bf85cb0fbefdb11f |
| institution | Kabale University |
| issn | 2090-0155 |
| language | English |
| publishDate | 2024-01-01 |
| publisher | Wiley |
| record_format | Article |
| series | Journal of Electrical and Computer Engineering |
| spelling | doaj-art-735c7fb30fc74ae7bf85cb0fbefdb11f2025-01-08T00:00:01ZengWileyJournal of Electrical and Computer Engineering2090-01552024-01-01202410.1155/jece/3110053Adaptive Improved Q-Learning Path Planning Algorithm Based on Obstacle Learning Matrix and Artificial Potential FieldLieping Zhang0Hongyuan Chen1Xiaoxu Shi2Jianchu Zou3Yilin Wang4Key Laboratory of Advanced Manufacturing and Automation TechnologyKey Laboratory of Advanced Manufacturing and Automation TechnologySchool of Artificial IntelligenceKey Laboratory of AI and Information ProcessingGuilin Mingfu Robot Technology Company LimitedTo address the issues of exploration imbalance and slow convergence speed in the Q-learning path planning algorithm, an adaptive improved Q-learning path planning algorithm based on an obstacle learning matrix and artificial potential field (APF) is proposed. First, an obstacle learning matrix is established to store the positions of obstacles encountered in each learning iteration, avoiding redundant learning of the same obstacle. Second, an adaptive exploration enhancement strategy is introduced by incorporating the concept of success rate. This strategy divides the decay process of the exploration rate into an exploration-dominant initial stage and an exploitation-dominant later stage. Finally, an APF-weighted action selection strategy is introduced, utilizing the guiding force generated by the APF to encourage the mobile robot to avoid obstacles more efficiently. Simulation results show that the proposed method can effectively reduce the number of iterations and time consumption in the optimization process, resulting in a smoother and more stable planned path.http://dx.doi.org/10.1155/jece/3110053 |
| spellingShingle | Lieping Zhang Hongyuan Chen Xiaoxu Shi Jianchu Zou Yilin Wang Adaptive Improved Q-Learning Path Planning Algorithm Based on Obstacle Learning Matrix and Artificial Potential Field Journal of Electrical and Computer Engineering |
| title | Adaptive Improved Q-Learning Path Planning Algorithm Based on Obstacle Learning Matrix and Artificial Potential Field |
| title_full | Adaptive Improved Q-Learning Path Planning Algorithm Based on Obstacle Learning Matrix and Artificial Potential Field |
| title_fullStr | Adaptive Improved Q-Learning Path Planning Algorithm Based on Obstacle Learning Matrix and Artificial Potential Field |
| title_full_unstemmed | Adaptive Improved Q-Learning Path Planning Algorithm Based on Obstacle Learning Matrix and Artificial Potential Field |
| title_short | Adaptive Improved Q-Learning Path Planning Algorithm Based on Obstacle Learning Matrix and Artificial Potential Field |
| title_sort | adaptive improved q learning path planning algorithm based on obstacle learning matrix and artificial potential field |
| url | http://dx.doi.org/10.1155/jece/3110053 |
| work_keys_str_mv | AT liepingzhang adaptiveimprovedqlearningpathplanningalgorithmbasedonobstaclelearningmatrixandartificialpotentialfield AT hongyuanchen adaptiveimprovedqlearningpathplanningalgorithmbasedonobstaclelearningmatrixandartificialpotentialfield AT xiaoxushi adaptiveimprovedqlearningpathplanningalgorithmbasedonobstaclelearningmatrixandartificialpotentialfield AT jianchuzou adaptiveimprovedqlearningpathplanningalgorithmbasedonobstaclelearningmatrixandartificialpotentialfield AT yilinwang adaptiveimprovedqlearningpathplanningalgorithmbasedonobstaclelearningmatrixandartificialpotentialfield |