Interpretable machine learning for predicting sepsis risk in emergency triage patients

Abstract The study aimed to develop and validate a sepsis prediction model using structured electronic medical records (sEMR) and machine learning (ML) methods in emergency triage. The goal was to enhance early sepsis screening by integrating comprehensive triage information beyond vital signs. This...

Full description

Saved in:
Bibliographic Details
Main Authors: Zheng Liu, Wenqi Shu, Teng Li, Xuan Zhang, Wei Chong
Format: Article
Language:English
Published: Nature Portfolio 2025-01-01
Series:Scientific Reports
Subjects:
Online Access:https://doi.org/10.1038/s41598-025-85121-z
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1841544807908900864
author Zheng Liu
Wenqi Shu
Teng Li
Xuan Zhang
Wei Chong
author_facet Zheng Liu
Wenqi Shu
Teng Li
Xuan Zhang
Wei Chong
author_sort Zheng Liu
collection DOAJ
description Abstract The study aimed to develop and validate a sepsis prediction model using structured electronic medical records (sEMR) and machine learning (ML) methods in emergency triage. The goal was to enhance early sepsis screening by integrating comprehensive triage information beyond vital signs. This retrospective cohort study utilized data from the MIMIC-IV database. Two models were developed: Model 1 based on vital signs alone, and Model 2 incorporating vital signs, demographic characteristics, medical history, and chief complaints. Eight ML algorithms were employed, and model performance was evaluated using metrics such as AUC, F1 Score, and calibration curves. SHapley Additive exPlanations (SHAP) and Local Interpretable Model-agnostic Explanations (LIME) methods were used to enhance model interpretability. The study included 189,617 patients, with 5.95% diagnosed with sepsis. Model 2 consistently outperformed Model 1 across most algorithms. In Model 2, Gradient Boosting achieved the highest AUC of 0.83, followed by Extra Tree, Random Forest, and Support Vector Machine (all 0.82). The SHAP method provided more comprehensible explanations for the Gradient Boosting algorithm. Modeling with comprehensive triage information using sEMR and ML methods was more effective in predicting sepsis at triage compared to using vital signs alone. Interpretable ML enhanced model transparency and provided sepsis prediction probabilities, offering a feasible approach for early sepsis screening and aiding healthcare professionals in making informed decisions during the triage process.
format Article
id doaj-art-37967080f45748369c79cc009add0c63
institution Kabale University
issn 2045-2322
language English
publishDate 2025-01-01
publisher Nature Portfolio
record_format Article
series Scientific Reports
spelling doaj-art-37967080f45748369c79cc009add0c632025-01-12T12:14:41ZengNature PortfolioScientific Reports2045-23222025-01-0115111410.1038/s41598-025-85121-zInterpretable machine learning for predicting sepsis risk in emergency triage patientsZheng Liu0Wenqi Shu1Teng Li2Xuan Zhang3Wei Chong4Department of Emergency, The First Hospital of China Medical UniversityDepartment of Emergency, The First Hospital of China Medical UniversityDepartment of Emergency, The First Hospital of China Medical UniversityDepartment of Emergency, The First Hospital of China Medical UniversityDepartment of Emergency, The First Hospital of China Medical UniversityAbstract The study aimed to develop and validate a sepsis prediction model using structured electronic medical records (sEMR) and machine learning (ML) methods in emergency triage. The goal was to enhance early sepsis screening by integrating comprehensive triage information beyond vital signs. This retrospective cohort study utilized data from the MIMIC-IV database. Two models were developed: Model 1 based on vital signs alone, and Model 2 incorporating vital signs, demographic characteristics, medical history, and chief complaints. Eight ML algorithms were employed, and model performance was evaluated using metrics such as AUC, F1 Score, and calibration curves. SHapley Additive exPlanations (SHAP) and Local Interpretable Model-agnostic Explanations (LIME) methods were used to enhance model interpretability. The study included 189,617 patients, with 5.95% diagnosed with sepsis. Model 2 consistently outperformed Model 1 across most algorithms. In Model 2, Gradient Boosting achieved the highest AUC of 0.83, followed by Extra Tree, Random Forest, and Support Vector Machine (all 0.82). The SHAP method provided more comprehensible explanations for the Gradient Boosting algorithm. Modeling with comprehensive triage information using sEMR and ML methods was more effective in predicting sepsis at triage compared to using vital signs alone. Interpretable ML enhanced model transparency and provided sepsis prediction probabilities, offering a feasible approach for early sepsis screening and aiding healthcare professionals in making informed decisions during the triage process.https://doi.org/10.1038/s41598-025-85121-zSepsisTriageEmergencyInterpretable machine learningWarning mode
spellingShingle Zheng Liu
Wenqi Shu
Teng Li
Xuan Zhang
Wei Chong
Interpretable machine learning for predicting sepsis risk in emergency triage patients
Scientific Reports
Sepsis
Triage
Emergency
Interpretable machine learning
Warning mode
title Interpretable machine learning for predicting sepsis risk in emergency triage patients
title_full Interpretable machine learning for predicting sepsis risk in emergency triage patients
title_fullStr Interpretable machine learning for predicting sepsis risk in emergency triage patients
title_full_unstemmed Interpretable machine learning for predicting sepsis risk in emergency triage patients
title_short Interpretable machine learning for predicting sepsis risk in emergency triage patients
title_sort interpretable machine learning for predicting sepsis risk in emergency triage patients
topic Sepsis
Triage
Emergency
Interpretable machine learning
Warning mode
url https://doi.org/10.1038/s41598-025-85121-z
work_keys_str_mv AT zhengliu interpretablemachinelearningforpredictingsepsisriskinemergencytriagepatients
AT wenqishu interpretablemachinelearningforpredictingsepsisriskinemergencytriagepatients
AT tengli interpretablemachinelearningforpredictingsepsisriskinemergencytriagepatients
AT xuanzhang interpretablemachinelearningforpredictingsepsisriskinemergencytriagepatients
AT weichong interpretablemachinelearningforpredictingsepsisriskinemergencytriagepatients