Laser & Optoelectronics Progress, Volume. 56, Issue 7, 071505(2019)

Multi-Feature Fusion Human Behavior Recognition Algorithm Based on Convolutional Neural Network and Long Short Term Memory Neural Network

Youwen Huang, Chaolun Wan*, and Heng Feng
Author Affiliations
  • School of Information Engineering, Jiangxi University of Science and Technology, Ganzhou, Jiangxi 341000, China
  • show less
    Figures & Tables(10)
    System block diagram
    CNN and parameters of each layer
    CNN hidden layer dimension and vectorization
    Schematic of proposed LSTM model
    Network structure of model
    KTH data training accuracy
    Recognition ratio of different weight ratios
    • Table 1. Comparison of accuracy of different algorithms on KTH dataset

      View table

      Table 1. Comparison of accuracy of different algorithms on KTH dataset

      AlgorithmAccuracy /%
      Method in Ref. [4]93.7
      Method in Ref. [3]90.2
      Method in Ref. [13]90.2
      Method in Ref. [14]93.7
      Model without concat93.3
      Proposed method94.2
    • Table 2. Comparison of accuracy of different algorithms on UCF Sports dataset

      View table

      Table 2. Comparison of accuracy of different algorithms on UCF Sports dataset

      AlgorithmAccuracy /%
      Method in Ref. [18]88.0
      Method in Ref. [19]88.4
      Proposed method88.89
    • Table 3. Behavior recognition confusion matrix based on KTH dataset

      View table

      Table 3. Behavior recognition confusion matrix based on KTH dataset

      Actual classificationModel prediction
      WalkingJoggingRunningBoxingHand wavingHand clapping
      Walking0.950.050.000.000.000.00
      Jogging0.100.850.050.000.000.00
      Running0.000.100.900.000.000.00
      Boxing0.000.000.001.000.000.00
      Hand waving0.000.000.000.001.000.00
      Hand clapping0.000.000.000.000.050.95
    Tools

    Get Citation

    Copy Citation Text

    Youwen Huang, Chaolun Wan, Heng Feng. Multi-Feature Fusion Human Behavior Recognition Algorithm Based on Convolutional Neural Network and Long Short Term Memory Neural Network[J]. Laser & Optoelectronics Progress, 2019, 56(7): 071505

    Download Citation

    EndNote(RIS)BibTexPlain Text
    Save article for my favorites
    Paper Information

    Category: Machine Vision

    Received: Sep. 21, 2018

    Accepted: Oct. 30, 2018

    Published Online: Jul. 30, 2019

    The Author Email: Chaolun Wan (353382420@qq.com)

    DOI:10.3788/LOP56.071505

    Topics