Prediction of Distant Metastasis of Renal Cell Carcinoma Based on Interpretable Machine Learning: A Multicenter Retrospective Study
Jinkai Dong,1,* Minjie Duan,2,3,* Xiaozhu Liu,4,* Huan Li,5 Yang Zhang,6 Tingting Zhang,7 Chengwei Fu,1 Jie Yu,8 Weike Hu,9 Shengxian Peng9,* 1Senior Department of Urology, the Third Medical Center of PLA General Hospital, Beijing, People’s Republic of China; 2Medical...
Saved in:
| Main Authors: | , , , , , , , , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
Dove Medical Press
2025-01-01
|
| Series: | Journal of Multidisciplinary Healthcare |
| Subjects: | |
| Online Access: | https://www.dovepress.com/prediction-of-distant-metastasis-of-renal-cell-carcinoma-based-on-inte-peer-reviewed-fulltext-article-JMDH |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1841526586073939968 |
|---|---|
| author | Dong J Duan M Liu X Li H Zhang Y Zhang T Fu C Yu J Hu W Peng S |
| author_facet | Dong J Duan M Liu X Li H Zhang Y Zhang T Fu C Yu J Hu W Peng S |
| author_sort | Dong J |
| collection | DOAJ |
| description | Jinkai Dong,1,* Minjie Duan,2,3,* Xiaozhu Liu,4,* Huan Li,5 Yang Zhang,6 Tingting Zhang,7 Chengwei Fu,1 Jie Yu,8 Weike Hu,9 Shengxian Peng9,* 1Senior Department of Urology, the Third Medical Center of PLA General Hospital, Beijing, People’s Republic of China; 2Medical School of Chinese PLA, Beijing, People’s Republic of China; 3Medical Innovation Research Department, Chinese PLA General Hospital, Beijing, People’s Republic of China; 4Emergency and Critical Care Medical Center, Beijing Shijitan Hospital, Capital Medical University, Beijing, People’s Republic of China; 5Chongqing College of Electronic Engineering, Chongqing, People’s Republic of China; 6College of Medical Informatics, Chongqing Medical University, Chongqing, People’s Republic of China; 7Department of Endocrinology, Fifth Medical Center of Chinese PLA Hospital, Beijing, People’s Republic of China; 8Department of Medical Imaging, The Affiliated Taian City Central Hospital of Qingdao University, Taian, People’s Republic of China; 9Scientific Research Department, First People’s Hospital of Zigong City, Zigong, People’s Republic of China*These authors contributed equally to this workCorrespondence: Shengxian Peng, Scientific Research Department, First People’s Hospital of Zigong City, No. 42, 1st Street, Shangyihao, ZiLiuJing District, ZiGong, SiChuan, 643000, People’s Republic of China, Email 13258280319@163.comBackground: : The traditional tool for predicting distant metastasis in renal cell carcinoma (RCC) is still insufficient. We aimed to establish an interpretable machine learning model for predicting distant metastasis in RCC patients.Methods: We involved a population-based cohort of 121433 patients (mean age = 63 years; 63.58% men) diagnosed with RCC between 2004 and 2015 from the Surveillance, Epidemiology, and End Results (SEER) database. The lightGBM algorithm was used to develop prediction model and assessed by the area under the receiver-operating characteristic curve (AUC), accuracy, sensitivity, and specificity. The LightGBM model was then externally validated in 36395 RCC patients enrolled from the SEER database between 2016 and 2018. Shapley Additive exPlanations (SHAP) method was applied to provide insights into the model’s outcome or prediction.Results: Of 121433 patients involved in the study cohort, 10730 (8.84%) had distant metastasis. The LightGBM model showed good performance in the internal validation set (AUC: 0.955, 95% CI: 0.951– 0.959) and temporal external validation sets (0.963, 95% CI: 0.959– 0.967; 0.961, 95% CI: 0.954– 0.966). Performance for the prediction model was also well performed in different sub-cohort stratified by age, gender, and ethnicity. The calibration curve indicated that the predicted values are highly consistent with the actual observed values. SHAP plots demonstrated that chemotherapy was the most vital variable for prediction of distant metastasis of RCC patients.Conclusion: We developed an interpretable machine learning model that is capable of accurately predicting the risk of distant metastasis of RCC patients. The presented model could help identify high-risk patients who require additional treatment strategies and follow-up regimens.Keywords: distant metastasis, machine learning, renal cell carcinoma, prediction, interpretable |
| format | Article |
| id | doaj-art-9b647881e8f6439c9f70fa9e1d83d5f3 |
| institution | Kabale University |
| issn | 1178-2390 |
| language | English |
| publishDate | 2025-01-01 |
| publisher | Dove Medical Press |
| record_format | Article |
| series | Journal of Multidisciplinary Healthcare |
| spelling | doaj-art-9b647881e8f6439c9f70fa9e1d83d5f32025-01-16T16:17:13ZengDove Medical PressJournal of Multidisciplinary Healthcare1178-23902025-01-01Volume 1819520799310Prediction of Distant Metastasis of Renal Cell Carcinoma Based on Interpretable Machine Learning: A Multicenter Retrospective StudyDong JDuan MLiu XLi HZhang YZhang TFu CYu JHu WPeng SJinkai Dong,1,* Minjie Duan,2,3,* Xiaozhu Liu,4,* Huan Li,5 Yang Zhang,6 Tingting Zhang,7 Chengwei Fu,1 Jie Yu,8 Weike Hu,9 Shengxian Peng9,* 1Senior Department of Urology, the Third Medical Center of PLA General Hospital, Beijing, People’s Republic of China; 2Medical School of Chinese PLA, Beijing, People’s Republic of China; 3Medical Innovation Research Department, Chinese PLA General Hospital, Beijing, People’s Republic of China; 4Emergency and Critical Care Medical Center, Beijing Shijitan Hospital, Capital Medical University, Beijing, People’s Republic of China; 5Chongqing College of Electronic Engineering, Chongqing, People’s Republic of China; 6College of Medical Informatics, Chongqing Medical University, Chongqing, People’s Republic of China; 7Department of Endocrinology, Fifth Medical Center of Chinese PLA Hospital, Beijing, People’s Republic of China; 8Department of Medical Imaging, The Affiliated Taian City Central Hospital of Qingdao University, Taian, People’s Republic of China; 9Scientific Research Department, First People’s Hospital of Zigong City, Zigong, People’s Republic of China*These authors contributed equally to this workCorrespondence: Shengxian Peng, Scientific Research Department, First People’s Hospital of Zigong City, No. 42, 1st Street, Shangyihao, ZiLiuJing District, ZiGong, SiChuan, 643000, People’s Republic of China, Email 13258280319@163.comBackground: : The traditional tool for predicting distant metastasis in renal cell carcinoma (RCC) is still insufficient. We aimed to establish an interpretable machine learning model for predicting distant metastasis in RCC patients.Methods: We involved a population-based cohort of 121433 patients (mean age = 63 years; 63.58% men) diagnosed with RCC between 2004 and 2015 from the Surveillance, Epidemiology, and End Results (SEER) database. The lightGBM algorithm was used to develop prediction model and assessed by the area under the receiver-operating characteristic curve (AUC), accuracy, sensitivity, and specificity. The LightGBM model was then externally validated in 36395 RCC patients enrolled from the SEER database between 2016 and 2018. Shapley Additive exPlanations (SHAP) method was applied to provide insights into the model’s outcome or prediction.Results: Of 121433 patients involved in the study cohort, 10730 (8.84%) had distant metastasis. The LightGBM model showed good performance in the internal validation set (AUC: 0.955, 95% CI: 0.951– 0.959) and temporal external validation sets (0.963, 95% CI: 0.959– 0.967; 0.961, 95% CI: 0.954– 0.966). Performance for the prediction model was also well performed in different sub-cohort stratified by age, gender, and ethnicity. The calibration curve indicated that the predicted values are highly consistent with the actual observed values. SHAP plots demonstrated that chemotherapy was the most vital variable for prediction of distant metastasis of RCC patients.Conclusion: We developed an interpretable machine learning model that is capable of accurately predicting the risk of distant metastasis of RCC patients. The presented model could help identify high-risk patients who require additional treatment strategies and follow-up regimens.Keywords: distant metastasis, machine learning, renal cell carcinoma, prediction, interpretablehttps://www.dovepress.com/prediction-of-distant-metastasis-of-renal-cell-carcinoma-based-on-inte-peer-reviewed-fulltext-article-JMDHdistant metastasismachine learningrenal cell carcinomapredictioninterpretable. |
| spellingShingle | Dong J Duan M Liu X Li H Zhang Y Zhang T Fu C Yu J Hu W Peng S Prediction of Distant Metastasis of Renal Cell Carcinoma Based on Interpretable Machine Learning: A Multicenter Retrospective Study Journal of Multidisciplinary Healthcare distant metastasis machine learning renal cell carcinoma prediction interpretable. |
| title | Prediction of Distant Metastasis of Renal Cell Carcinoma Based on Interpretable Machine Learning: A Multicenter Retrospective Study |
| title_full | Prediction of Distant Metastasis of Renal Cell Carcinoma Based on Interpretable Machine Learning: A Multicenter Retrospective Study |
| title_fullStr | Prediction of Distant Metastasis of Renal Cell Carcinoma Based on Interpretable Machine Learning: A Multicenter Retrospective Study |
| title_full_unstemmed | Prediction of Distant Metastasis of Renal Cell Carcinoma Based on Interpretable Machine Learning: A Multicenter Retrospective Study |
| title_short | Prediction of Distant Metastasis of Renal Cell Carcinoma Based on Interpretable Machine Learning: A Multicenter Retrospective Study |
| title_sort | prediction of distant metastasis of renal cell carcinoma based on interpretable machine learning a multicenter retrospective study |
| topic | distant metastasis machine learning renal cell carcinoma prediction interpretable. |
| url | https://www.dovepress.com/prediction-of-distant-metastasis-of-renal-cell-carcinoma-based-on-inte-peer-reviewed-fulltext-article-JMDH |
| work_keys_str_mv | AT dongj predictionofdistantmetastasisofrenalcellcarcinomabasedoninterpretablemachinelearningamulticenterretrospectivestudy AT duanm predictionofdistantmetastasisofrenalcellcarcinomabasedoninterpretablemachinelearningamulticenterretrospectivestudy AT liux predictionofdistantmetastasisofrenalcellcarcinomabasedoninterpretablemachinelearningamulticenterretrospectivestudy AT lih predictionofdistantmetastasisofrenalcellcarcinomabasedoninterpretablemachinelearningamulticenterretrospectivestudy AT zhangy predictionofdistantmetastasisofrenalcellcarcinomabasedoninterpretablemachinelearningamulticenterretrospectivestudy AT zhangt predictionofdistantmetastasisofrenalcellcarcinomabasedoninterpretablemachinelearningamulticenterretrospectivestudy AT fuc predictionofdistantmetastasisofrenalcellcarcinomabasedoninterpretablemachinelearningamulticenterretrospectivestudy AT yuj predictionofdistantmetastasisofrenalcellcarcinomabasedoninterpretablemachinelearningamulticenterretrospectivestudy AT huw predictionofdistantmetastasisofrenalcellcarcinomabasedoninterpretablemachinelearningamulticenterretrospectivestudy AT pengs predictionofdistantmetastasisofrenalcellcarcinomabasedoninterpretablemachinelearningamulticenterretrospectivestudy |