Situation Awareness Discrimination Based on Physiological Features for High-Stress Flight Tasks

Situation awareness (SA) discrimination is significant, allowing for the pilot to maintain task performance and ensure flight safety, especially during high-stress flight tasks. Although previous research has attempted to identify and classify SA, existing SA discrimination models are predominantly...

Full description

Saved in:
Bibliographic Details
Main Authors: Chunying Qian, Shuang Liu, Xiaoru Wanyan, Chuanyan Feng, Zhen Li, Wenye Sun, Yihang Wang
Format: Article
Language:English
Published: MDPI AG 2024-10-01
Series:Aerospace
Subjects:
Online Access:https://www.mdpi.com/2226-4310/11/11/897
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1846154826921017344
author Chunying Qian
Shuang Liu
Xiaoru Wanyan
Chuanyan Feng
Zhen Li
Wenye Sun
Yihang Wang
author_facet Chunying Qian
Shuang Liu
Xiaoru Wanyan
Chuanyan Feng
Zhen Li
Wenye Sun
Yihang Wang
author_sort Chunying Qian
collection DOAJ
description Situation awareness (SA) discrimination is significant, allowing for the pilot to maintain task performance and ensure flight safety, especially during high-stress flight tasks. Although previous research has attempted to identify and classify SA, existing SA discrimination models are predominantly binary and rely on traditional machine learning methods with limited physiological modalities. The current study aimed to construct a triple-class SA discrimination model for pilots facing high-stress tasks. To achieve this, a flight simulation experiment under typical high-stress tasks was carried out and deep learning algorithms (multilayer perceptron (MLP) and the attention mechanism) were utilized. Specifically, eye-tracking (ET), heart rate variability (HRV), and electroencephalograph (EEG) modalities were chosen as the model’s input features. Comparing the unimodal models, the results indicate that EEG modality surpasses ET and HRV modalities, and the attention mechanism structure has advantageous implications for processing the EEG modalities. The most superior model fused the three modalities at the decision level, with two MLP backbones and an attention mechanism backbone, achieving an accuracy of 83.41% and proving that the model performance would benefit from multimodal fusion. Thus, the current research established a triple-class SA discrimination model for pilots, laying the foundation for the real-time evaluation of SA under high-stress aerial operating conditions and providing a reference for intelligent cockpit design and dynamic human–machine function allocation.
format Article
id doaj-art-25998733a88d42c58dab0d3dae11b4ca
institution Kabale University
issn 2226-4310
language English
publishDate 2024-10-01
publisher MDPI AG
record_format Article
series Aerospace
spelling doaj-art-25998733a88d42c58dab0d3dae11b4ca2024-11-26T17:42:51ZengMDPI AGAerospace2226-43102024-10-01111189710.3390/aerospace11110897Situation Awareness Discrimination Based on Physiological Features for High-Stress Flight TasksChunying Qian0Shuang Liu1Xiaoru Wanyan2Chuanyan Feng3Zhen Li4Wenye Sun5Yihang Wang6School of Aeronautic Science and Engineering, Beihang University, Beijing 100191, ChinaSchool of Aeronautic Science and Engineering, Beihang University, Beijing 100191, ChinaSchool of Aeronautic Science and Engineering, Beihang University, Beijing 100191, ChinaSchool of Aeronautic Science and Engineering, Beihang University, Beijing 100191, ChinaShenyang Aircraft Design & Research Institute, Shenyang 110035, ChinaShenyang Aircraft Design & Research Institute, Shenyang 110035, ChinaSchool of Aeronautic Science and Engineering, Beihang University, Beijing 100191, ChinaSituation awareness (SA) discrimination is significant, allowing for the pilot to maintain task performance and ensure flight safety, especially during high-stress flight tasks. Although previous research has attempted to identify and classify SA, existing SA discrimination models are predominantly binary and rely on traditional machine learning methods with limited physiological modalities. The current study aimed to construct a triple-class SA discrimination model for pilots facing high-stress tasks. To achieve this, a flight simulation experiment under typical high-stress tasks was carried out and deep learning algorithms (multilayer perceptron (MLP) and the attention mechanism) were utilized. Specifically, eye-tracking (ET), heart rate variability (HRV), and electroencephalograph (EEG) modalities were chosen as the model’s input features. Comparing the unimodal models, the results indicate that EEG modality surpasses ET and HRV modalities, and the attention mechanism structure has advantageous implications for processing the EEG modalities. The most superior model fused the three modalities at the decision level, with two MLP backbones and an attention mechanism backbone, achieving an accuracy of 83.41% and proving that the model performance would benefit from multimodal fusion. Thus, the current research established a triple-class SA discrimination model for pilots, laying the foundation for the real-time evaluation of SA under high-stress aerial operating conditions and providing a reference for intelligent cockpit design and dynamic human–machine function allocation.https://www.mdpi.com/2226-4310/11/11/897situation awarenessdiscrimination modelmultimodal fusionaerospace human–machine function allocationflight safety
spellingShingle Chunying Qian
Shuang Liu
Xiaoru Wanyan
Chuanyan Feng
Zhen Li
Wenye Sun
Yihang Wang
Situation Awareness Discrimination Based on Physiological Features for High-Stress Flight Tasks
Aerospace
situation awareness
discrimination model
multimodal fusion
aerospace human–machine function allocation
flight safety
title Situation Awareness Discrimination Based on Physiological Features for High-Stress Flight Tasks
title_full Situation Awareness Discrimination Based on Physiological Features for High-Stress Flight Tasks
title_fullStr Situation Awareness Discrimination Based on Physiological Features for High-Stress Flight Tasks
title_full_unstemmed Situation Awareness Discrimination Based on Physiological Features for High-Stress Flight Tasks
title_short Situation Awareness Discrimination Based on Physiological Features for High-Stress Flight Tasks
title_sort situation awareness discrimination based on physiological features for high stress flight tasks
topic situation awareness
discrimination model
multimodal fusion
aerospace human–machine function allocation
flight safety
url https://www.mdpi.com/2226-4310/11/11/897
work_keys_str_mv AT chunyingqian situationawarenessdiscriminationbasedonphysiologicalfeaturesforhighstressflighttasks
AT shuangliu situationawarenessdiscriminationbasedonphysiologicalfeaturesforhighstressflighttasks
AT xiaoruwanyan situationawarenessdiscriminationbasedonphysiologicalfeaturesforhighstressflighttasks
AT chuanyanfeng situationawarenessdiscriminationbasedonphysiologicalfeaturesforhighstressflighttasks
AT zhenli situationawarenessdiscriminationbasedonphysiologicalfeaturesforhighstressflighttasks
AT wenyesun situationawarenessdiscriminationbasedonphysiologicalfeaturesforhighstressflighttasks
AT yihangwang situationawarenessdiscriminationbasedonphysiologicalfeaturesforhighstressflighttasks