An artificial intelligence application to predict prolonged dependence on mechanical ventilation among patients with critical orthopaedic trauma: an establishment and validation study

Abstract Background Prolonged dependence on mechanical ventilation is a common occurrence in clinical ICU patients and presents significant challenges for patient care and resource allocation. Predicting prolonged dependence on mechanical ventilation is crucial for improving patient outcomes, preven...

Full description

Saved in:
Bibliographic Details
Main Authors: Weigang Jiang, Tao Liu, Baisheng Sun, Lixia Zhong, Zhencan Han, Minhua Lu, Mingxing Lei
Format: Article
Language:English
Published: BMC 2024-12-01
Series:BMC Musculoskeletal Disorders
Subjects:
Online Access:https://doi.org/10.1186/s12891-024-08245-9
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1841559885718749184
author Weigang Jiang
Tao Liu
Baisheng Sun
Lixia Zhong
Zhencan Han
Minhua Lu
Mingxing Lei
author_facet Weigang Jiang
Tao Liu
Baisheng Sun
Lixia Zhong
Zhencan Han
Minhua Lu
Mingxing Lei
author_sort Weigang Jiang
collection DOAJ
description Abstract Background Prolonged dependence on mechanical ventilation is a common occurrence in clinical ICU patients and presents significant challenges for patient care and resource allocation. Predicting prolonged dependence on mechanical ventilation is crucial for improving patient outcomes, preventing ventilator-associated complications, and guiding targeted clinical interventions. However, specific tools for predicting prolonged mechanical ventilation among ICU patients, particularly those with critical orthopaedic trauma, are currently lacking. The purpose of the study was to establish and validate an artificial intelligence (AI) platform to assess the prolonged dependence on mechanical ventilation among patients with critical orthopaedic trauma. Methods This study analyzed 1400 patients with critical orthopaedic trauma who received mechanical ventilation, and the prolonged dependence on mechanical ventilation was defined as not weaning from mechanical ventilation for ≧ 7 days. Patients were randomly classified into a training cohort and a validation cohort based on the ratio of 8:2. Patients in the training cohort were used to establish models using machine learning techniques, including logistic regression (LR), extreme gradient boosting machine (eXGBM), decision tree (DT), random forest (RF), support vector machine (SVM), and light gradient boosting machine (LightGBM), whereas patients in the validation cohort were used to validate these models. The prediction performance of these models was evaluated using discrimination and calibration. A scoring system was used to comprehensively assess and compare the prediction performance of the models, based on ten evaluation metrics. External validation of the model was performed in 122 patients with critical orthopaedic trauma from a university teaching hospital. Furthermore, the optimal model was deployed as an AI calculator, which was accessible online, to assess the risk of prolonged dependence on mechanical ventilation. Results Among the developed models, the eXGBM model had the highest score of 50, followed by the LightGBM model (48) and the RF model (37). In detail, the eXGBM model outperformed other models in terms of recall (0.892), Brier score (0.088), log loss (0.291), and calibration slope (0.999), and the model was the second best in terms of area under the curve value (0.949, 95%: 0.933–0.961), accuracy (0.871), F1 score (0.873), and discrimination slope (0.647). The SHAP revealed that the most important five features were respiratory rate, lower limb fracture, glucose, PaO2, and PaCO2. External validation of the eXGBM model also demonstrated favorable prediction performance, with an AUC value of 0.893 (95%CI: 0.819–0.967). The eXGBM model was successfully deployed as an AI platform, which was at https://prolongedmechanicalventilation-lqsfm6ecky6dpd4ybkvohu.streamlit.app/ . By simply clicking the link and inputting features, users were able to obtain the risk of experiencing prolonged dependence on mechanical ventilation for individuals. Based on the risk of prolonged dependence on mechanical ventilation, patients were stratified into the high-risk or the low-risk groups, and corresponding therapeutic interventions were recommended, accordingly. Conclusions The AI model shows potential as a valuable tool for stratifying patients with a high risk of prolonged dependence on mechanical ventilation. The AI model may offer a promising approach for optimizing patient care and resource allocation in critical care settings. Clinical trial number Not applicable.
format Article
id doaj-art-66c146a28007499eaded9e85a3a1038c
institution Kabale University
issn 1471-2474
language English
publishDate 2024-12-01
publisher BMC
record_format Article
series BMC Musculoskeletal Disorders
spelling doaj-art-66c146a28007499eaded9e85a3a1038c2025-01-05T12:04:49ZengBMCBMC Musculoskeletal Disorders1471-24742024-12-0125111410.1186/s12891-024-08245-9An artificial intelligence application to predict prolonged dependence on mechanical ventilation among patients with critical orthopaedic trauma: an establishment and validation studyWeigang Jiang0Tao Liu1Baisheng Sun2Lixia Zhong3Zhencan Han4Minhua Lu5Mingxing Lei6Department of Orthopedics, The Fourth Affiliated Hospital of Soochow University (Suzhou Dushu Lake Hospital)Department of Orthopedics, The 9 th Medical Centre of Chinese PLA General HospitalDepartment of Critical Care Medicine, The First Medical Centre of Chinese PLA General HospitalDepartment of Intensive Care Medicine, Beijing Friendship Hospital, Capital Medical UniversityDepartment of Orthopedics, Peking University Third HospitalDepartment of Orthopedics, The Fourth Affiliated Hospital of Soochow University (Suzhou Dushu Lake Hospital)Department of Orthopedics, Hainan Hospital of PLA General HospitalAbstract Background Prolonged dependence on mechanical ventilation is a common occurrence in clinical ICU patients and presents significant challenges for patient care and resource allocation. Predicting prolonged dependence on mechanical ventilation is crucial for improving patient outcomes, preventing ventilator-associated complications, and guiding targeted clinical interventions. However, specific tools for predicting prolonged mechanical ventilation among ICU patients, particularly those with critical orthopaedic trauma, are currently lacking. The purpose of the study was to establish and validate an artificial intelligence (AI) platform to assess the prolonged dependence on mechanical ventilation among patients with critical orthopaedic trauma. Methods This study analyzed 1400 patients with critical orthopaedic trauma who received mechanical ventilation, and the prolonged dependence on mechanical ventilation was defined as not weaning from mechanical ventilation for ≧ 7 days. Patients were randomly classified into a training cohort and a validation cohort based on the ratio of 8:2. Patients in the training cohort were used to establish models using machine learning techniques, including logistic regression (LR), extreme gradient boosting machine (eXGBM), decision tree (DT), random forest (RF), support vector machine (SVM), and light gradient boosting machine (LightGBM), whereas patients in the validation cohort were used to validate these models. The prediction performance of these models was evaluated using discrimination and calibration. A scoring system was used to comprehensively assess and compare the prediction performance of the models, based on ten evaluation metrics. External validation of the model was performed in 122 patients with critical orthopaedic trauma from a university teaching hospital. Furthermore, the optimal model was deployed as an AI calculator, which was accessible online, to assess the risk of prolonged dependence on mechanical ventilation. Results Among the developed models, the eXGBM model had the highest score of 50, followed by the LightGBM model (48) and the RF model (37). In detail, the eXGBM model outperformed other models in terms of recall (0.892), Brier score (0.088), log loss (0.291), and calibration slope (0.999), and the model was the second best in terms of area under the curve value (0.949, 95%: 0.933–0.961), accuracy (0.871), F1 score (0.873), and discrimination slope (0.647). The SHAP revealed that the most important five features were respiratory rate, lower limb fracture, glucose, PaO2, and PaCO2. External validation of the eXGBM model also demonstrated favorable prediction performance, with an AUC value of 0.893 (95%CI: 0.819–0.967). The eXGBM model was successfully deployed as an AI platform, which was at https://prolongedmechanicalventilation-lqsfm6ecky6dpd4ybkvohu.streamlit.app/ . By simply clicking the link and inputting features, users were able to obtain the risk of experiencing prolonged dependence on mechanical ventilation for individuals. Based on the risk of prolonged dependence on mechanical ventilation, patients were stratified into the high-risk or the low-risk groups, and corresponding therapeutic interventions were recommended, accordingly. Conclusions The AI model shows potential as a valuable tool for stratifying patients with a high risk of prolonged dependence on mechanical ventilation. The AI model may offer a promising approach for optimizing patient care and resource allocation in critical care settings. Clinical trial number Not applicable.https://doi.org/10.1186/s12891-024-08245-9Artificial intelligenceMechanical ventilationCritical orthopaedic traumaMachine learningA comprehensive evaluation system
spellingShingle Weigang Jiang
Tao Liu
Baisheng Sun
Lixia Zhong
Zhencan Han
Minhua Lu
Mingxing Lei
An artificial intelligence application to predict prolonged dependence on mechanical ventilation among patients with critical orthopaedic trauma: an establishment and validation study
BMC Musculoskeletal Disorders
Artificial intelligence
Mechanical ventilation
Critical orthopaedic trauma
Machine learning
A comprehensive evaluation system
title An artificial intelligence application to predict prolonged dependence on mechanical ventilation among patients with critical orthopaedic trauma: an establishment and validation study
title_full An artificial intelligence application to predict prolonged dependence on mechanical ventilation among patients with critical orthopaedic trauma: an establishment and validation study
title_fullStr An artificial intelligence application to predict prolonged dependence on mechanical ventilation among patients with critical orthopaedic trauma: an establishment and validation study
title_full_unstemmed An artificial intelligence application to predict prolonged dependence on mechanical ventilation among patients with critical orthopaedic trauma: an establishment and validation study
title_short An artificial intelligence application to predict prolonged dependence on mechanical ventilation among patients with critical orthopaedic trauma: an establishment and validation study
title_sort artificial intelligence application to predict prolonged dependence on mechanical ventilation among patients with critical orthopaedic trauma an establishment and validation study
topic Artificial intelligence
Mechanical ventilation
Critical orthopaedic trauma
Machine learning
A comprehensive evaluation system
url https://doi.org/10.1186/s12891-024-08245-9
work_keys_str_mv AT weigangjiang anartificialintelligenceapplicationtopredictprolongeddependenceonmechanicalventilationamongpatientswithcriticalorthopaedictraumaanestablishmentandvalidationstudy
AT taoliu anartificialintelligenceapplicationtopredictprolongeddependenceonmechanicalventilationamongpatientswithcriticalorthopaedictraumaanestablishmentandvalidationstudy
AT baishengsun anartificialintelligenceapplicationtopredictprolongeddependenceonmechanicalventilationamongpatientswithcriticalorthopaedictraumaanestablishmentandvalidationstudy
AT lixiazhong anartificialintelligenceapplicationtopredictprolongeddependenceonmechanicalventilationamongpatientswithcriticalorthopaedictraumaanestablishmentandvalidationstudy
AT zhencanhan anartificialintelligenceapplicationtopredictprolongeddependenceonmechanicalventilationamongpatientswithcriticalorthopaedictraumaanestablishmentandvalidationstudy
AT minhualu anartificialintelligenceapplicationtopredictprolongeddependenceonmechanicalventilationamongpatientswithcriticalorthopaedictraumaanestablishmentandvalidationstudy
AT mingxinglei anartificialintelligenceapplicationtopredictprolongeddependenceonmechanicalventilationamongpatientswithcriticalorthopaedictraumaanestablishmentandvalidationstudy
AT weigangjiang artificialintelligenceapplicationtopredictprolongeddependenceonmechanicalventilationamongpatientswithcriticalorthopaedictraumaanestablishmentandvalidationstudy
AT taoliu artificialintelligenceapplicationtopredictprolongeddependenceonmechanicalventilationamongpatientswithcriticalorthopaedictraumaanestablishmentandvalidationstudy
AT baishengsun artificialintelligenceapplicationtopredictprolongeddependenceonmechanicalventilationamongpatientswithcriticalorthopaedictraumaanestablishmentandvalidationstudy
AT lixiazhong artificialintelligenceapplicationtopredictprolongeddependenceonmechanicalventilationamongpatientswithcriticalorthopaedictraumaanestablishmentandvalidationstudy
AT zhencanhan artificialintelligenceapplicationtopredictprolongeddependenceonmechanicalventilationamongpatientswithcriticalorthopaedictraumaanestablishmentandvalidationstudy
AT minhualu artificialintelligenceapplicationtopredictprolongeddependenceonmechanicalventilationamongpatientswithcriticalorthopaedictraumaanestablishmentandvalidationstudy
AT mingxinglei artificialintelligenceapplicationtopredictprolongeddependenceonmechanicalventilationamongpatientswithcriticalorthopaedictraumaanestablishmentandvalidationstudy