Evaluation of Human Action Based on Feature-Weighted Dynamic Time Warping
Action evaluation can automatically detect abnormal actions by evaluating the quality of human actions in specific postures, which is widely used in the field of rehabilitation medicine. This paper proposes an intelligent rehabilitation action evaluation system to evaluate the quality of patients’ a...
Saved in:
| Main Authors: | , , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
MDPI AG
2024-11-01
|
| Series: | Applied Sciences |
| Subjects: | |
| Online Access: | https://www.mdpi.com/2076-3417/14/23/11130 |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1846124433339580416 |
|---|---|
| author | Mingdie Yan Xia Liu Zhaoyang Li Naiyu Guo |
| author_facet | Mingdie Yan Xia Liu Zhaoyang Li Naiyu Guo |
| author_sort | Mingdie Yan |
| collection | DOAJ |
| description | Action evaluation can automatically detect abnormal actions by evaluating the quality of human actions in specific postures, which is widely used in the field of rehabilitation medicine. This paper proposes an intelligent rehabilitation action evaluation system to evaluate the quality of patients’ actions during rehabilitation training, which helps medical professionals to more effectively monitor and guide the process, thus improving rehabilitation effects. Firstly, we collected human skeletal key-point data based on a depth camera and processed these data with gap filling and filtering; then, the effective data segments were segmented from the whole action dataset, angle and distance features were extracted, and the feature matrix was obtained; then, we used the Euclidean Barycenter Dynamic Time Warping–Barycenter Averaging algorithm to produce action templates; finally, we proposed a Feature-Weighted Dynamic Time Warping algorithm to calculate the similarity between the detected action and the template action and established an action achievement score mechanism to evaluate the rehabilitation action. The experimental results show that compared with the action evaluation method based on feature-matrix DTW, the proposed method significantly improves the similarity between healthy people and patients, and the similarity improvement for patients is more significant. Based on similarity scores, the difference between the actions of healthy people and patients and the template actions is more than 80%, which shows that the method can evaluate action quality in people with different health conditions and effectively reduce error in action evaluation. The confidence level of the action achievement score mechanism reaches 99%, which meets the actual application requirements. |
| format | Article |
| id | doaj-art-5ce21bc7617745e695978bd1f8eba34c |
| institution | Kabale University |
| issn | 2076-3417 |
| language | English |
| publishDate | 2024-11-01 |
| publisher | MDPI AG |
| record_format | Article |
| series | Applied Sciences |
| spelling | doaj-art-5ce21bc7617745e695978bd1f8eba34c2024-12-13T16:22:55ZengMDPI AGApplied Sciences2076-34172024-11-0114231113010.3390/app142311130Evaluation of Human Action Based on Feature-Weighted Dynamic Time WarpingMingdie Yan0Xia Liu1Zhaoyang Li2Naiyu Guo3School of Intelligent Manufacturing, Jianghan University, Wuhan 430056, ChinaSchool of Intelligent Manufacturing, Jianghan University, Wuhan 430056, ChinaSchool of Intelligent Manufacturing, Jianghan University, Wuhan 430056, ChinaSchool of Intelligent Manufacturing, Jianghan University, Wuhan 430056, ChinaAction evaluation can automatically detect abnormal actions by evaluating the quality of human actions in specific postures, which is widely used in the field of rehabilitation medicine. This paper proposes an intelligent rehabilitation action evaluation system to evaluate the quality of patients’ actions during rehabilitation training, which helps medical professionals to more effectively monitor and guide the process, thus improving rehabilitation effects. Firstly, we collected human skeletal key-point data based on a depth camera and processed these data with gap filling and filtering; then, the effective data segments were segmented from the whole action dataset, angle and distance features were extracted, and the feature matrix was obtained; then, we used the Euclidean Barycenter Dynamic Time Warping–Barycenter Averaging algorithm to produce action templates; finally, we proposed a Feature-Weighted Dynamic Time Warping algorithm to calculate the similarity between the detected action and the template action and established an action achievement score mechanism to evaluate the rehabilitation action. The experimental results show that compared with the action evaluation method based on feature-matrix DTW, the proposed method significantly improves the similarity between healthy people and patients, and the similarity improvement for patients is more significant. Based on similarity scores, the difference between the actions of healthy people and patients and the template actions is more than 80%, which shows that the method can evaluate action quality in people with different health conditions and effectively reduce error in action evaluation. The confidence level of the action achievement score mechanism reaches 99%, which meets the actual application requirements.https://www.mdpi.com/2076-3417/14/23/11130action evaluationIRAESaction segmentationfeature weightedDTW |
| spellingShingle | Mingdie Yan Xia Liu Zhaoyang Li Naiyu Guo Evaluation of Human Action Based on Feature-Weighted Dynamic Time Warping Applied Sciences action evaluation IRAES action segmentation feature weighted DTW |
| title | Evaluation of Human Action Based on Feature-Weighted Dynamic Time Warping |
| title_full | Evaluation of Human Action Based on Feature-Weighted Dynamic Time Warping |
| title_fullStr | Evaluation of Human Action Based on Feature-Weighted Dynamic Time Warping |
| title_full_unstemmed | Evaluation of Human Action Based on Feature-Weighted Dynamic Time Warping |
| title_short | Evaluation of Human Action Based on Feature-Weighted Dynamic Time Warping |
| title_sort | evaluation of human action based on feature weighted dynamic time warping |
| topic | action evaluation IRAES action segmentation feature weighted DTW |
| url | https://www.mdpi.com/2076-3417/14/23/11130 |
| work_keys_str_mv | AT mingdieyan evaluationofhumanactionbasedonfeatureweighteddynamictimewarping AT xialiu evaluationofhumanactionbasedonfeatureweighteddynamictimewarping AT zhaoyangli evaluationofhumanactionbasedonfeatureweighteddynamictimewarping AT naiyuguo evaluationofhumanactionbasedonfeatureweighteddynamictimewarping |