Research on multi-label recognition of tongue features in stroke patients based on deep learning
Abstract Stroke has become the leading cause of disability in adults worldwide. Early precise rehabilitation intervention is crucial for the recovery of stroke patients, with the key lying in accurately identifying patients’ physical characteristics during the rehabilitation phase. Compared to diagn...
Saved in:
| Main Authors: | , , , , , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
Nature Portfolio
2024-12-01
|
| Series: | Scientific Reports |
| Online Access: | https://doi.org/10.1038/s41598-024-84002-1 |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1841559478828269568 |
|---|---|
| author | Honghua Liu Peiqin Zhang Yini Huang Shanshan Zuo Lu Li Chang She Mailan Liu |
| author_facet | Honghua Liu Peiqin Zhang Yini Huang Shanshan Zuo Lu Li Chang She Mailan Liu |
| author_sort | Honghua Liu |
| collection | DOAJ |
| description | Abstract Stroke has become the leading cause of disability in adults worldwide. Early precise rehabilitation intervention is crucial for the recovery of stroke patients, with the key lying in accurately identifying patients’ physical characteristics during the rehabilitation phase. Compared to diagnostic techniques such as medical neuroimaging, traditional Chinese medicine(TCM) tongue diagnosis offers good accessibility and ease of application. However, conventional TCM tongue diagnosis relies on the experience of doctors, which introduces a degree of subjectivity, especially since stroke patients exhibit unique characteristics in tongue texture, shape, and coating, making accurate diagnosis more challenging. To address this issue, this paper proposes a deep learning-based automatic recognition approach for the tongue images of stroke patients, aiming to improve the accuracy of automatic extraction and recognition of stroke-related tongue features through image processing and machine learning techniques. First, this study performs image cropping and data augmentation on tongue images. Then, considering that tongue color, coating color, and coating texture are interrelated in TCM theory and jointly reflect the body’s physiological and pathological state, a label-guided multi-label recognition model for tongue images is designed. This model extracts features from the tongue images of stroke patients, learns the correlations among the features, and performs classification to automatically identify key characteristics such as tongue shape, color, and coating. Finally, the model’s performance is quantitatively evaluated. Experimental results show that the proposed deep learning model outperforms several advanced deep learning models, such as resnet and densenet, and existing single-task tongue classification models in automatically recognizing stroke patients’ tongue images. This research improves the accuracy of feature extraction and recognition of tongue characteristics in stroke patients during rehabilitation, providing a convenient and feasible technical approach for real-time evaluation and diagnosis in the stroke rehabilitation process. It has significant clinical application value and research significance. |
| format | Article |
| id | doaj-art-f86bd98b00e645d09c5b487f173daa22 |
| institution | Kabale University |
| issn | 2045-2322 |
| language | English |
| publishDate | 2024-12-01 |
| publisher | Nature Portfolio |
| record_format | Article |
| series | Scientific Reports |
| spelling | doaj-art-f86bd98b00e645d09c5b487f173daa222025-01-05T12:28:24ZengNature PortfolioScientific Reports2045-23222024-12-0114111210.1038/s41598-024-84002-1Research on multi-label recognition of tongue features in stroke patients based on deep learningHonghua Liu0Peiqin Zhang1Yini Huang2Shanshan Zuo3Lu Li4Chang She5Mailan Liu6Hunan University of Chinese MedicineHunan Traditional Chinese Medical CollegeChangsha Hospital of Traditional Chinese Medicine (Changsha Eighth Hospital)Changsha Hospital of Traditional Chinese Medicine (Changsha Eighth Hospital)Changsha Hospital of Traditional Chinese Medicine (Changsha Eighth Hospital)Changsha Hospital of Traditional Chinese Medicine (Changsha Eighth Hospital)Hunan University of Chinese MedicineAbstract Stroke has become the leading cause of disability in adults worldwide. Early precise rehabilitation intervention is crucial for the recovery of stroke patients, with the key lying in accurately identifying patients’ physical characteristics during the rehabilitation phase. Compared to diagnostic techniques such as medical neuroimaging, traditional Chinese medicine(TCM) tongue diagnosis offers good accessibility and ease of application. However, conventional TCM tongue diagnosis relies on the experience of doctors, which introduces a degree of subjectivity, especially since stroke patients exhibit unique characteristics in tongue texture, shape, and coating, making accurate diagnosis more challenging. To address this issue, this paper proposes a deep learning-based automatic recognition approach for the tongue images of stroke patients, aiming to improve the accuracy of automatic extraction and recognition of stroke-related tongue features through image processing and machine learning techniques. First, this study performs image cropping and data augmentation on tongue images. Then, considering that tongue color, coating color, and coating texture are interrelated in TCM theory and jointly reflect the body’s physiological and pathological state, a label-guided multi-label recognition model for tongue images is designed. This model extracts features from the tongue images of stroke patients, learns the correlations among the features, and performs classification to automatically identify key characteristics such as tongue shape, color, and coating. Finally, the model’s performance is quantitatively evaluated. Experimental results show that the proposed deep learning model outperforms several advanced deep learning models, such as resnet and densenet, and existing single-task tongue classification models in automatically recognizing stroke patients’ tongue images. This research improves the accuracy of feature extraction and recognition of tongue characteristics in stroke patients during rehabilitation, providing a convenient and feasible technical approach for real-time evaluation and diagnosis in the stroke rehabilitation process. It has significant clinical application value and research significance.https://doi.org/10.1038/s41598-024-84002-1 |
| spellingShingle | Honghua Liu Peiqin Zhang Yini Huang Shanshan Zuo Lu Li Chang She Mailan Liu Research on multi-label recognition of tongue features in stroke patients based on deep learning Scientific Reports |
| title | Research on multi-label recognition of tongue features in stroke patients based on deep learning |
| title_full | Research on multi-label recognition of tongue features in stroke patients based on deep learning |
| title_fullStr | Research on multi-label recognition of tongue features in stroke patients based on deep learning |
| title_full_unstemmed | Research on multi-label recognition of tongue features in stroke patients based on deep learning |
| title_short | Research on multi-label recognition of tongue features in stroke patients based on deep learning |
| title_sort | research on multi label recognition of tongue features in stroke patients based on deep learning |
| url | https://doi.org/10.1038/s41598-024-84002-1 |
| work_keys_str_mv | AT honghualiu researchonmultilabelrecognitionoftonguefeaturesinstrokepatientsbasedondeeplearning AT peiqinzhang researchonmultilabelrecognitionoftonguefeaturesinstrokepatientsbasedondeeplearning AT yinihuang researchonmultilabelrecognitionoftonguefeaturesinstrokepatientsbasedondeeplearning AT shanshanzuo researchonmultilabelrecognitionoftonguefeaturesinstrokepatientsbasedondeeplearning AT luli researchonmultilabelrecognitionoftonguefeaturesinstrokepatientsbasedondeeplearning AT changshe researchonmultilabelrecognitionoftonguefeaturesinstrokepatientsbasedondeeplearning AT mailanliu researchonmultilabelrecognitionoftonguefeaturesinstrokepatientsbasedondeeplearning |