Action recognition method based on fusion of skeleton and apparent features
Focusing on the issue that traditional skeletal feature-based action recognition algorithms were not easy to distinguish similar actions, an action recognition method based on the fusion of deep joints and manual apparent features was considered.The joint spatial position and constraints was firstly...
Saved in:
| Main Authors: | , |
|---|---|
| Format: | Article |
| Language: | zho |
| Published: |
Editorial Department of Journal on Communications
2022-01-01
|
| Series: | Tongxin xuebao |
| Subjects: | |
| Online Access: | http://www.joconline.com.cn/zh/article/doi/10.11959/j.issn.1000-436x.2022020/ |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1841539960219369472 |
|---|---|
| author | Hongyan WANG Hai YUAN |
| author_facet | Hongyan WANG Hai YUAN |
| author_sort | Hongyan WANG |
| collection | DOAJ |
| description | Focusing on the issue that traditional skeletal feature-based action recognition algorithms were not easy to distinguish similar actions, an action recognition method based on the fusion of deep joints and manual apparent features was considered.The joint spatial position and constraints was firstly input into the long short-term memory (LSTM) model equipped with spatio-temporal attention mechanism to acquire spatio-temporal weighted and highly separable deep joint features.After that, heat maps were introduced to locate the key frames and joints, and manually extract the apparent features around the key joints that could be considered as an effective complement to the deep joint features.Finally, the apparent features and the deep skeleton features could be fused frame by frame to achieve effectively discriminating similar actions.Simulation results show that, compared with the state-of-the-art action recognition methods, the proposed method can distinguish similar actions effectively and then the accuracy of action recognition is promoted rather obviously. |
| format | Article |
| id | doaj-art-295f6ea4ac5f42ff9df1a1dd7efb5d7d |
| institution | Kabale University |
| issn | 1000-436X |
| language | zho |
| publishDate | 2022-01-01 |
| publisher | Editorial Department of Journal on Communications |
| record_format | Article |
| series | Tongxin xuebao |
| spelling | doaj-art-295f6ea4ac5f42ff9df1a1dd7efb5d7d2025-01-14T06:30:29ZzhoEditorial Department of Journal on CommunicationsTongxin xuebao1000-436X2022-01-014313814859398514Action recognition method based on fusion of skeleton and apparent featuresHongyan WANGHai YUANFocusing on the issue that traditional skeletal feature-based action recognition algorithms were not easy to distinguish similar actions, an action recognition method based on the fusion of deep joints and manual apparent features was considered.The joint spatial position and constraints was firstly input into the long short-term memory (LSTM) model equipped with spatio-temporal attention mechanism to acquire spatio-temporal weighted and highly separable deep joint features.After that, heat maps were introduced to locate the key frames and joints, and manually extract the apparent features around the key joints that could be considered as an effective complement to the deep joint features.Finally, the apparent features and the deep skeleton features could be fused frame by frame to achieve effectively discriminating similar actions.Simulation results show that, compared with the state-of-the-art action recognition methods, the proposed method can distinguish similar actions effectively and then the accuracy of action recognition is promoted rather obviously.http://www.joconline.com.cn/zh/article/doi/10.11959/j.issn.1000-436x.2022020/action recognitionLSTMspatio-temporal attention mechanismskeleton jointapparent feature |
| spellingShingle | Hongyan WANG Hai YUAN Action recognition method based on fusion of skeleton and apparent features Tongxin xuebao action recognition LSTM spatio-temporal attention mechanism skeleton joint apparent feature |
| title | Action recognition method based on fusion of skeleton and apparent features |
| title_full | Action recognition method based on fusion of skeleton and apparent features |
| title_fullStr | Action recognition method based on fusion of skeleton and apparent features |
| title_full_unstemmed | Action recognition method based on fusion of skeleton and apparent features |
| title_short | Action recognition method based on fusion of skeleton and apparent features |
| title_sort | action recognition method based on fusion of skeleton and apparent features |
| topic | action recognition LSTM spatio-temporal attention mechanism skeleton joint apparent feature |
| url | http://www.joconline.com.cn/zh/article/doi/10.11959/j.issn.1000-436x.2022020/ |
| work_keys_str_mv | AT hongyanwang actionrecognitionmethodbasedonfusionofskeletonandapparentfeatures AT haiyuan actionrecognitionmethodbasedonfusionofskeletonandapparentfeatures |