Robust Reinforcement Learning Control Framework for a Quadrotor Unmanned Aerial Vehicle Using Critic Neural Network

This article introduces a novel robust reinforcement learning (RL) control scheme for a quadrotor unmanned aerial vehicle (QUAV) under external disturbances and model uncertainties. First, the translational and rotational motions of the QUAV are decoupled and trained separately to mitigate the compu...

Full description

Saved in:
Bibliographic Details
Main Authors: Yu Cai, Yefeng Yang, Tao Huang, Boyang Li
Format: Article
Language:English
Published: Wiley 2025-03-01
Series:Advanced Intelligent Systems
Subjects:
Online Access:https://doi.org/10.1002/aisy.202400427
Tags: Add Tag
No Tags, Be the first to tag this record!
Description
Summary:This article introduces a novel robust reinforcement learning (RL) control scheme for a quadrotor unmanned aerial vehicle (QUAV) under external disturbances and model uncertainties. First, the translational and rotational motions of the QUAV are decoupled and trained separately to mitigate the computational complexity of the controller design and training process. Then, the proximal policy optimization algorithm with a dual‐critic structure is proposed to address the overestimation issue and accelerate the convergence speed of RL controllers. Furthermore, a novel reward function and a robust compensator employing a switch value function are proposed to address model uncertainties and external disturbances. At last, simulation results and comparisons demonstrate the effectiveness and robustness of the proposed RL control framework.
ISSN:2640-4567