Machine and Deep Learning Models for Stress Detection Using Multimodal Physiological Data

Stress can disrupt daily activities and harm health if prolonged or severe. Early detection of mental stress, indicated by changes in bio-signals like thermal, electrical, and acoustic signals, can prevent related health issues. This study employs machine learning and deep learning techniques on mul...

Full description

Saved in:
Bibliographic Details
Main Authors: Eman Abdelfattah, Shreehar Joshi, Shreekar Tiwari
Format: Article
Language:English
Published: IEEE 2025-01-01
Series:IEEE Access
Subjects:
Online Access:https://ieeexplore.ieee.org/document/10820549/
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1841550828816564224
author Eman Abdelfattah
Shreehar Joshi
Shreekar Tiwari
author_facet Eman Abdelfattah
Shreehar Joshi
Shreekar Tiwari
author_sort Eman Abdelfattah
collection DOAJ
description Stress can disrupt daily activities and harm health if prolonged or severe. Early detection of mental stress, indicated by changes in bio-signals like thermal, electrical, and acoustic signals, can prevent related health issues. This study employs machine learning and deep learning techniques on multimodal dataset from wearable sensors, focusing on processed metrics for the three-axis acceleration (ACC), electrocardiogram (ECG), blood volume pulse (BVP), body temperature (TEMP), respiration (RESP), electromyogram (EMG), and electrodermal activity (EDA) from the 15 subjects in the WESAD dataset to effectively classify four different states – baseline, stress, amusement, and meditation. Seven traditional machine learning algorithms – Logistic Regression, Gaussian Naïve Bayes Classifier, AdaBoost Classifier, XGB Classifier, Decision Trees Classifier, Extra Trees Classifier, and Random Forest Classifier and three widely used deep learning algorithms – Deep Neural Network, Convolutional Neural Network and Recurrent Neural Network were trained and tested on the dataset on two phases to predict the state of different subject at any given time. Our findings indicate that Recurrent Neural Networks achieved an F1 score of 93% when trained on a selected set of subjects and tested on the data from different subjects. Traditional machine learning algorithms, including Random Forest, Extra Trees, and XGB Classifiers, on the other hand, each achieved an F1 score of 99% when trained and tested on the data for the same set of subjects. Additionally, models performed better on chest data when trained and tested on the same subjects, while they perform better on wrist data when trained on a random group of subjects and tested on the remaining ones.
format Article
id doaj-art-2c51a5a65bdc4fa7aef18057d8df261a
institution Kabale University
issn 2169-3536
language English
publishDate 2025-01-01
publisher IEEE
record_format Article
series IEEE Access
spelling doaj-art-2c51a5a65bdc4fa7aef18057d8df261a2025-01-10T00:01:02ZengIEEEIEEE Access2169-35362025-01-01134597460810.1109/ACCESS.2024.352545910820549Machine and Deep Learning Models for Stress Detection Using Multimodal Physiological DataEman Abdelfattah0https://orcid.org/0009-0002-9967-3653Shreehar Joshi1https://orcid.org/0009-0003-0857-8405Shreekar Tiwari2https://orcid.org/0009-0000-8935-8436School of Computer Science and Engineering, Sacred Heart University, Fairfield, CT, USAThe Boring Company, Las Vegas, NV, USAInstitute of Engineering, Tribhuvan University, Pulchowk Campus, Kathmandu, NepalStress can disrupt daily activities and harm health if prolonged or severe. Early detection of mental stress, indicated by changes in bio-signals like thermal, electrical, and acoustic signals, can prevent related health issues. This study employs machine learning and deep learning techniques on multimodal dataset from wearable sensors, focusing on processed metrics for the three-axis acceleration (ACC), electrocardiogram (ECG), blood volume pulse (BVP), body temperature (TEMP), respiration (RESP), electromyogram (EMG), and electrodermal activity (EDA) from the 15 subjects in the WESAD dataset to effectively classify four different states – baseline, stress, amusement, and meditation. Seven traditional machine learning algorithms – Logistic Regression, Gaussian Naïve Bayes Classifier, AdaBoost Classifier, XGB Classifier, Decision Trees Classifier, Extra Trees Classifier, and Random Forest Classifier and three widely used deep learning algorithms – Deep Neural Network, Convolutional Neural Network and Recurrent Neural Network were trained and tested on the dataset on two phases to predict the state of different subject at any given time. Our findings indicate that Recurrent Neural Networks achieved an F1 score of 93% when trained on a selected set of subjects and tested on the data from different subjects. Traditional machine learning algorithms, including Random Forest, Extra Trees, and XGB Classifiers, on the other hand, each achieved an F1 score of 99% when trained and tested on the data for the same set of subjects. Additionally, models performed better on chest data when trained and tested on the same subjects, while they perform better on wrist data when trained on a random group of subjects and tested on the remaining ones.https://ieeexplore.ieee.org/document/10820549/Machine learningneural networksclassificationstress detection
spellingShingle Eman Abdelfattah
Shreehar Joshi
Shreekar Tiwari
Machine and Deep Learning Models for Stress Detection Using Multimodal Physiological Data
IEEE Access
Machine learning
neural networks
classification
stress detection
title Machine and Deep Learning Models for Stress Detection Using Multimodal Physiological Data
title_full Machine and Deep Learning Models for Stress Detection Using Multimodal Physiological Data
title_fullStr Machine and Deep Learning Models for Stress Detection Using Multimodal Physiological Data
title_full_unstemmed Machine and Deep Learning Models for Stress Detection Using Multimodal Physiological Data
title_short Machine and Deep Learning Models for Stress Detection Using Multimodal Physiological Data
title_sort machine and deep learning models for stress detection using multimodal physiological data
topic Machine learning
neural networks
classification
stress detection
url https://ieeexplore.ieee.org/document/10820549/
work_keys_str_mv AT emanabdelfattah machineanddeeplearningmodelsforstressdetectionusingmultimodalphysiologicaldata
AT shreeharjoshi machineanddeeplearningmodelsforstressdetectionusingmultimodalphysiologicaldata
AT shreekartiwari machineanddeeplearningmodelsforstressdetectionusingmultimodalphysiologicaldata