Human-Centered UAV–MAV Teaming in Adversarial Scenarios via Target-Aware Intention Prediction and Reinforcement Learning

Tacit understanding refers to the ability of team members to work together seamlessly and intuitively without explicitly communicating in detail. This ability is crucial for effective teamwork in complex situations that involve both manned and unmanned aerial vehicles (UAVs). Existing collaborative...

Full description

Saved in:
Bibliographic Details
Main Authors: Wei Hao, Huaping Liu, Jia Liu, Wenjie Li, Lijun Chen
Format: Article
Language:English
Published: Wiley 2024-01-01
Series:IET Signal Processing
Online Access:http://dx.doi.org/10.1049/sil2/7719848
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1841555816554954752
author Wei Hao
Huaping Liu
Jia Liu
Wenjie Li
Lijun Chen
author_facet Wei Hao
Huaping Liu
Jia Liu
Wenjie Li
Lijun Chen
author_sort Wei Hao
collection DOAJ
description Tacit understanding refers to the ability of team members to work together seamlessly and intuitively without explicitly communicating in detail. This ability is crucial for effective teamwork in complex situations that involve both manned and unmanned aerial vehicles (UAVs). Existing collaborative tasks between manned and unmanned aircraft focus mainly on optimizing communication and the UAVs’ flight paths but neglect the benefits of tacit and intelligent operational cooperation with pilots. To address this limitation, we propose a tacit collaborative attack method that utilizes the UAVs’ capacity for tacit understanding to infer human intent and select the appropriate targets for collaborative attack missions. A learning framework incorporating intention prediction and reinforcement learning paradigms is developed to teach the UAV to generate corresponding collaborative attack actions. Finally, we present results from extensive simulation experiments in a homemade game environment to demonstrate the efficiency and scalability of our method within the proposed framework. The video can be found at https://www.youtube.com/watch?v=CjXhkD7ko14.
format Article
id doaj-art-34d7e0243be945afb41300b1c5c3f432
institution Kabale University
issn 1751-9683
language English
publishDate 2024-01-01
publisher Wiley
record_format Article
series IET Signal Processing
spelling doaj-art-34d7e0243be945afb41300b1c5c3f4322025-01-08T00:00:08ZengWileyIET Signal Processing1751-96832024-01-01202410.1049/sil2/7719848Human-Centered UAV–MAV Teaming in Adversarial Scenarios via Target-Aware Intention Prediction and Reinforcement LearningWei Hao0Huaping Liu1Jia Liu2Wenjie Li3Lijun Chen4Department of Computer Science and TechnologyDepartment of Computer Science and TechnologyDepartment of Computer Science and TechnologyDepartment of Computer Science and TechnologyDepartment of Computer Science and TechnologyTacit understanding refers to the ability of team members to work together seamlessly and intuitively without explicitly communicating in detail. This ability is crucial for effective teamwork in complex situations that involve both manned and unmanned aerial vehicles (UAVs). Existing collaborative tasks between manned and unmanned aircraft focus mainly on optimizing communication and the UAVs’ flight paths but neglect the benefits of tacit and intelligent operational cooperation with pilots. To address this limitation, we propose a tacit collaborative attack method that utilizes the UAVs’ capacity for tacit understanding to infer human intent and select the appropriate targets for collaborative attack missions. A learning framework incorporating intention prediction and reinforcement learning paradigms is developed to teach the UAV to generate corresponding collaborative attack actions. Finally, we present results from extensive simulation experiments in a homemade game environment to demonstrate the efficiency and scalability of our method within the proposed framework. The video can be found at https://www.youtube.com/watch?v=CjXhkD7ko14.http://dx.doi.org/10.1049/sil2/7719848
spellingShingle Wei Hao
Huaping Liu
Jia Liu
Wenjie Li
Lijun Chen
Human-Centered UAV–MAV Teaming in Adversarial Scenarios via Target-Aware Intention Prediction and Reinforcement Learning
IET Signal Processing
title Human-Centered UAV–MAV Teaming in Adversarial Scenarios via Target-Aware Intention Prediction and Reinforcement Learning
title_full Human-Centered UAV–MAV Teaming in Adversarial Scenarios via Target-Aware Intention Prediction and Reinforcement Learning
title_fullStr Human-Centered UAV–MAV Teaming in Adversarial Scenarios via Target-Aware Intention Prediction and Reinforcement Learning
title_full_unstemmed Human-Centered UAV–MAV Teaming in Adversarial Scenarios via Target-Aware Intention Prediction and Reinforcement Learning
title_short Human-Centered UAV–MAV Teaming in Adversarial Scenarios via Target-Aware Intention Prediction and Reinforcement Learning
title_sort human centered uav mav teaming in adversarial scenarios via target aware intention prediction and reinforcement learning
url http://dx.doi.org/10.1049/sil2/7719848
work_keys_str_mv AT weihao humancentereduavmavteaminginadversarialscenariosviatargetawareintentionpredictionandreinforcementlearning
AT huapingliu humancentereduavmavteaminginadversarialscenariosviatargetawareintentionpredictionandreinforcementlearning
AT jialiu humancentereduavmavteaminginadversarialscenariosviatargetawareintentionpredictionandreinforcementlearning
AT wenjieli humancentereduavmavteaminginadversarialscenariosviatargetawareintentionpredictionandreinforcementlearning
AT lijunchen humancentereduavmavteaminginadversarialscenariosviatargetawareintentionpredictionandreinforcementlearning