Laser & Optoelectronics Progress, Volume. 56, Issue 7, 071505(2019)
Multi-Feature Fusion Human Behavior Recognition Algorithm Based on Convolutional Neural Network and Long Short Term Memory Neural Network
A deep learning network structure based on the convolutional neural network and long short term memory (LSTM) neural network is proposed. The feature fusion is used to extract the shallow features and deep features through the convolutional network, and the features are fused by convolution, and the the obtained vector information is input into the LSTM unit. Networks are trained separately using the optical flow images and the red green blue information, and the results from each network are fused with weights. The experimental results show that the proposed model effectively improves the accuracy of behavior recognition.
Get Citation
Copy Citation Text
Youwen Huang, Chaolun Wan, Heng Feng. Multi-Feature Fusion Human Behavior Recognition Algorithm Based on Convolutional Neural Network and Long Short Term Memory Neural Network[J]. Laser & Optoelectronics Progress, 2019, 56(7): 071505
Category: Machine Vision
Received: Sep. 21, 2018
Accepted: Oct. 30, 2018
Published Online: Jul. 30, 2019
The Author Email: Wan Chaolun (353382420@qq.com)