Identification of a Susceptible and High-Risk Population for Postoperative Systemic Inflammatory Response Syndrome in Older Adults: Machine Learning–Based Predictive Model
BackgroundSystemic inflammatory response syndrome (SIRS) is a serious postoperative complication among older adult surgical patients that frequently develops into sepsis or even death. Notably, the incidences of SIRS and sepsis steadily increase with age. It is important to i...
Saved in:
| Main Authors: | , , , , , , , , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
JMIR Publications
2024-11-01
|
| Series: | Journal of Medical Internet Research |
| Online Access: | https://www.jmir.org/2024/1/e57486 |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1846159847325696000 |
|---|---|
| author | Haiyan Mai Yaxin Lu Yu Fu Tongsen Luo Xiaoyue Li Yihan Zhang Zifeng Liu Yuenong Zhang Shaoli Zhou Chaojin Chen |
| author_facet | Haiyan Mai Yaxin Lu Yu Fu Tongsen Luo Xiaoyue Li Yihan Zhang Zifeng Liu Yuenong Zhang Shaoli Zhou Chaojin Chen |
| author_sort | Haiyan Mai |
| collection | DOAJ |
| description |
BackgroundSystemic inflammatory response syndrome (SIRS) is a serious postoperative complication among older adult surgical patients that frequently develops into sepsis or even death. Notably, the incidences of SIRS and sepsis steadily increase with age. It is important to identify the risk of postoperative SIRS for older adult patients at a sufficiently early stage, which would allow preemptive individualized enhanced therapy to be conducted to improve the prognosis of older adult patients. In recent years, machine learning (ML) models have been deployed by researchers for many tasks, including disease prediction and risk stratification, exhibiting good application potential.
ObjectiveWe aimed to develop and validate an individualized predictive model to identify susceptible and high-risk populations for SIRS in older adult patients to instruct appropriate early interventions.
MethodsData for surgical patients aged ≥65 years from September 2015 to September 2020 in 3 independent medical centers were retrieved and analyzed. The eligible patient cohort in the Third Affiliated Hospital of Sun Yat-sen University was randomly separated into an 80% training set (2882 patients) and a 20% internal validation set (720 patients). We developed 4 ML models to predict postoperative SIRS. The area under the receiver operating curve (AUC), F1 score, Brier score, and calibration curve were used to evaluate the model performance. The model with the best performance was further validated in the other 2 independent data sets involving 844 and 307 cases, respectively.
ResultsThe incidences of SIRS in the 3 medical centers were 24.3% (876/3602), 29.6% (250/844), and 6.5% (20/307), respectively. We identified 15 variables that were significantly associated with postoperative SIRS and used in 4 ML models to predict postoperative SIRS. A balanced cutoff between sensitivity and specificity was chosen to ensure as high a true positive as possible. The random forest classifier (RF) model showed the best overall performance to predict postoperative SIRS, with an AUC of 0.751 (95% CI 0.709-0.793), sensitivity of 0.682, specificity of 0.681, and F1 score of 0.508 in the internal validation set and higher AUCs in the external validation-1 set (0.759, 95% CI 0.723-0.795) and external validation-2 set (0.804, 95% CI 0.746-0.863).
ConclusionsWe developed and validated a generalizable RF model to predict postoperative SIRS in older adult patients, enabling clinicians to screen susceptible and high-risk patients and implement early individualized interventions. An online risk calculator to make the RF model accessible to anesthesiologists and peers around the world was developed. |
| format | Article |
| id | doaj-art-ca6a2cf1b6b147aba2ee5c80ca6bb376 |
| institution | Kabale University |
| issn | 1438-8871 |
| language | English |
| publishDate | 2024-11-01 |
| publisher | JMIR Publications |
| record_format | Article |
| series | Journal of Medical Internet Research |
| spelling | doaj-art-ca6a2cf1b6b147aba2ee5c80ca6bb3762024-11-22T21:31:08ZengJMIR PublicationsJournal of Medical Internet Research1438-88712024-11-0126e5748610.2196/57486Identification of a Susceptible and High-Risk Population for Postoperative Systemic Inflammatory Response Syndrome in Older Adults: Machine Learning–Based Predictive ModelHaiyan Maihttps://orcid.org/0009-0007-7022-173XYaxin Luhttps://orcid.org/0000-0001-6278-4347Yu Fuhttps://orcid.org/0009-0003-4499-3323Tongsen Luohttps://orcid.org/0000-0003-1284-0712Xiaoyue Lihttps://orcid.org/0009-0002-4791-4523Yihan Zhanghttps://orcid.org/0000-0002-3546-9752Zifeng Liuhttps://orcid.org/0000-0002-1392-8698Yuenong Zhanghttps://orcid.org/0000-0002-2318-3204Shaoli Zhouhttps://orcid.org/0000-0002-6604-0166Chaojin Chenhttps://orcid.org/0000-0001-5101-4101 BackgroundSystemic inflammatory response syndrome (SIRS) is a serious postoperative complication among older adult surgical patients that frequently develops into sepsis or even death. Notably, the incidences of SIRS and sepsis steadily increase with age. It is important to identify the risk of postoperative SIRS for older adult patients at a sufficiently early stage, which would allow preemptive individualized enhanced therapy to be conducted to improve the prognosis of older adult patients. In recent years, machine learning (ML) models have been deployed by researchers for many tasks, including disease prediction and risk stratification, exhibiting good application potential. ObjectiveWe aimed to develop and validate an individualized predictive model to identify susceptible and high-risk populations for SIRS in older adult patients to instruct appropriate early interventions. MethodsData for surgical patients aged ≥65 years from September 2015 to September 2020 in 3 independent medical centers were retrieved and analyzed. The eligible patient cohort in the Third Affiliated Hospital of Sun Yat-sen University was randomly separated into an 80% training set (2882 patients) and a 20% internal validation set (720 patients). We developed 4 ML models to predict postoperative SIRS. The area under the receiver operating curve (AUC), F1 score, Brier score, and calibration curve were used to evaluate the model performance. The model with the best performance was further validated in the other 2 independent data sets involving 844 and 307 cases, respectively. ResultsThe incidences of SIRS in the 3 medical centers were 24.3% (876/3602), 29.6% (250/844), and 6.5% (20/307), respectively. We identified 15 variables that were significantly associated with postoperative SIRS and used in 4 ML models to predict postoperative SIRS. A balanced cutoff between sensitivity and specificity was chosen to ensure as high a true positive as possible. The random forest classifier (RF) model showed the best overall performance to predict postoperative SIRS, with an AUC of 0.751 (95% CI 0.709-0.793), sensitivity of 0.682, specificity of 0.681, and F1 score of 0.508 in the internal validation set and higher AUCs in the external validation-1 set (0.759, 95% CI 0.723-0.795) and external validation-2 set (0.804, 95% CI 0.746-0.863). ConclusionsWe developed and validated a generalizable RF model to predict postoperative SIRS in older adult patients, enabling clinicians to screen susceptible and high-risk patients and implement early individualized interventions. An online risk calculator to make the RF model accessible to anesthesiologists and peers around the world was developed.https://www.jmir.org/2024/1/e57486 |
| spellingShingle | Haiyan Mai Yaxin Lu Yu Fu Tongsen Luo Xiaoyue Li Yihan Zhang Zifeng Liu Yuenong Zhang Shaoli Zhou Chaojin Chen Identification of a Susceptible and High-Risk Population for Postoperative Systemic Inflammatory Response Syndrome in Older Adults: Machine Learning–Based Predictive Model Journal of Medical Internet Research |
| title | Identification of a Susceptible and High-Risk Population for Postoperative Systemic Inflammatory Response Syndrome in Older Adults: Machine Learning–Based Predictive Model |
| title_full | Identification of a Susceptible and High-Risk Population for Postoperative Systemic Inflammatory Response Syndrome in Older Adults: Machine Learning–Based Predictive Model |
| title_fullStr | Identification of a Susceptible and High-Risk Population for Postoperative Systemic Inflammatory Response Syndrome in Older Adults: Machine Learning–Based Predictive Model |
| title_full_unstemmed | Identification of a Susceptible and High-Risk Population for Postoperative Systemic Inflammatory Response Syndrome in Older Adults: Machine Learning–Based Predictive Model |
| title_short | Identification of a Susceptible and High-Risk Population for Postoperative Systemic Inflammatory Response Syndrome in Older Adults: Machine Learning–Based Predictive Model |
| title_sort | identification of a susceptible and high risk population for postoperative systemic inflammatory response syndrome in older adults machine learning based predictive model |
| url | https://www.jmir.org/2024/1/e57486 |
| work_keys_str_mv | AT haiyanmai identificationofasusceptibleandhighriskpopulationforpostoperativesystemicinflammatoryresponsesyndromeinolderadultsmachinelearningbasedpredictivemodel AT yaxinlu identificationofasusceptibleandhighriskpopulationforpostoperativesystemicinflammatoryresponsesyndromeinolderadultsmachinelearningbasedpredictivemodel AT yufu identificationofasusceptibleandhighriskpopulationforpostoperativesystemicinflammatoryresponsesyndromeinolderadultsmachinelearningbasedpredictivemodel AT tongsenluo identificationofasusceptibleandhighriskpopulationforpostoperativesystemicinflammatoryresponsesyndromeinolderadultsmachinelearningbasedpredictivemodel AT xiaoyueli identificationofasusceptibleandhighriskpopulationforpostoperativesystemicinflammatoryresponsesyndromeinolderadultsmachinelearningbasedpredictivemodel AT yihanzhang identificationofasusceptibleandhighriskpopulationforpostoperativesystemicinflammatoryresponsesyndromeinolderadultsmachinelearningbasedpredictivemodel AT zifengliu identificationofasusceptibleandhighriskpopulationforpostoperativesystemicinflammatoryresponsesyndromeinolderadultsmachinelearningbasedpredictivemodel AT yuenongzhang identificationofasusceptibleandhighriskpopulationforpostoperativesystemicinflammatoryresponsesyndromeinolderadultsmachinelearningbasedpredictivemodel AT shaolizhou identificationofasusceptibleandhighriskpopulationforpostoperativesystemicinflammatoryresponsesyndromeinolderadultsmachinelearningbasedpredictivemodel AT chaojinchen identificationofasusceptibleandhighriskpopulationforpostoperativesystemicinflammatoryresponsesyndromeinolderadultsmachinelearningbasedpredictivemodel |