Laser & Optoelectronics Progress, Volume. 57, Issue 24, 241506(2020)
Improved Human Action Recognition Algorithm Based on Two-Stream Faster Region Convolutional Neural Network
In the field of static image, deep neural networks have made breakthroughs and gradually expanded to the field of video recognition. Human action recognition is a research hotspot and difficult in the field of video recognition. Therefore, this paper proposes an improved human action recognition algorithm based on two-stream faster region convolutional neural network (Faster RCNN). First, we use RGB (Red, Green, Blue) images and optical flow data as input of the network to train the Faster RCNN separately; then, the trained network model is fused, and an improved squeeze and excitation block is introduced to process the feature channel to highlight important features; finally, we use the complete intersection-over-union loss function as the bounding box regression loss function to optimize some problems such as the inability to intersect the ground truth box with the predicted box. The experimental results show that the accuracy of the algorithm on the action recognition data set UCF101 is improved compared to the traditional Faster RCNN.
Get Citation
Copy Citation Text
Ruyi Guo, Jie Jin, Gaohua Liu, Kaiyan Liu, Shiqi Jiang. Improved Human Action Recognition Algorithm Based on Two-Stream Faster Region Convolutional Neural Network[J]. Laser & Optoelectronics Progress, 2020, 57(24): 241506
Category: Machine Vision
Received: Apr. 29, 2020
Accepted: Jun. 17, 2020
Published Online: Dec. 1, 2020
The Author Email: Jin Jie (jinjie@tju.edu.cn)