File Download
There are no files associated with this item.
Links for fulltext
(May Require Subscription)
- Publisher Website: 10.1109/TPAMI.2017.2771306
- Scopus: eid_2-s2.0-85033709940
- PMID: 29990167
- WOS: WOS:000449355500016
- Find via
Supplementary
- Citations:
- Appears in Collections:
Article: Skeleton-Based Action Recognition Using Spatio-Temporal LSTM Network with Trust Gates
Title | Skeleton-Based Action Recognition Using Spatio-Temporal LSTM Network with Trust Gates |
---|---|
Authors | |
Keywords | Action recognition long short-term memory recurrent neural networks skeleton sequence spatio-temporal analysis tree traversal trust gate |
Issue Date | 2018 |
Citation | IEEE Transactions on Pattern Analysis and Machine Intelligence, 2018, v. 40, n. 12, p. 3007-3021 How to Cite? |
Abstract | Skeleton-based human action recognition has attracted a lot of research attention during the past few years. Recent works attempted to utilize recurrent neural networks to model the temporal dependencies between the 3D positional configurations of human body joints for better analysis of human activities in the skeletal data. The proposed work extends this idea to spatial domain as well as temporal domain to better analyze the hidden sources of action-related information within the human skeleton sequences in both of these domains simultaneously. Based on the pictorial structure of Kinect's skeletal data, an effective tree-structure based traversal framework is also proposed. In order to deal with the noise in the skeletal data, a new gating mechanism within LSTM module is introduced, with which the network can learn the reliability of the sequential data and accordingly adjust the effect of the input data on the updating procedure of the long-term context representation stored in the unit's memory cell. Moreover, we introduce a novel multi-modal feature fusion strategy within the LSTM unit in this paper. The comprehensive experimental results on seven challenging benchmark datasets for human action recognition demonstrate the effectiveness of the proposed method. |
Persistent Identifier | http://hdl.handle.net/10722/321765 |
ISSN | 2023 Impact Factor: 20.8 2023 SCImago Journal Rankings: 6.158 |
ISI Accession Number ID |
DC Field | Value | Language |
---|---|---|
dc.contributor.author | Liu, Jun | - |
dc.contributor.author | Shahroudy, Amir | - |
dc.contributor.author | Xu, Dong | - |
dc.contributor.author | Kot, Alex C. | - |
dc.contributor.author | Wang, Gang | - |
dc.date.accessioned | 2022-11-03T02:21:18Z | - |
dc.date.available | 2022-11-03T02:21:18Z | - |
dc.date.issued | 2018 | - |
dc.identifier.citation | IEEE Transactions on Pattern Analysis and Machine Intelligence, 2018, v. 40, n. 12, p. 3007-3021 | - |
dc.identifier.issn | 0162-8828 | - |
dc.identifier.uri | http://hdl.handle.net/10722/321765 | - |
dc.description.abstract | Skeleton-based human action recognition has attracted a lot of research attention during the past few years. Recent works attempted to utilize recurrent neural networks to model the temporal dependencies between the 3D positional configurations of human body joints for better analysis of human activities in the skeletal data. The proposed work extends this idea to spatial domain as well as temporal domain to better analyze the hidden sources of action-related information within the human skeleton sequences in both of these domains simultaneously. Based on the pictorial structure of Kinect's skeletal data, an effective tree-structure based traversal framework is also proposed. In order to deal with the noise in the skeletal data, a new gating mechanism within LSTM module is introduced, with which the network can learn the reliability of the sequential data and accordingly adjust the effect of the input data on the updating procedure of the long-term context representation stored in the unit's memory cell. Moreover, we introduce a novel multi-modal feature fusion strategy within the LSTM unit in this paper. The comprehensive experimental results on seven challenging benchmark datasets for human action recognition demonstrate the effectiveness of the proposed method. | - |
dc.language | eng | - |
dc.relation.ispartof | IEEE Transactions on Pattern Analysis and Machine Intelligence | - |
dc.subject | Action recognition | - |
dc.subject | long short-term memory | - |
dc.subject | recurrent neural networks | - |
dc.subject | skeleton sequence | - |
dc.subject | spatio-temporal analysis | - |
dc.subject | tree traversal | - |
dc.subject | trust gate | - |
dc.title | Skeleton-Based Action Recognition Using Spatio-Temporal LSTM Network with Trust Gates | - |
dc.type | Article | - |
dc.description.nature | link_to_subscribed_fulltext | - |
dc.identifier.doi | 10.1109/TPAMI.2017.2771306 | - |
dc.identifier.pmid | 29990167 | - |
dc.identifier.scopus | eid_2-s2.0-85033709940 | - |
dc.identifier.volume | 40 | - |
dc.identifier.issue | 12 | - |
dc.identifier.spage | 3007 | - |
dc.identifier.epage | 3021 | - |
dc.identifier.eissn | 1939-3539 | - |
dc.identifier.isi | WOS:000449355500016 | - |