Acta Optica Sinica, Volume. 38, Issue 8, 0810001(2018)

Human Action Recognition by Decision-Making Level Fusion Based on Spatial-Temporal Features

Yandi Li* and Xiping Xu*
Author Affiliations
  • College of Photoelectrical Engineering, Changchun University of Science and Technology, Changchun 130022, China
  • show less
    Figures & Tables(26)
    Target contour extraction process. (a) Original video; (b) motion detection; (c) target contour extraction
    (a) Template image and (b) test image of POSER 3D simulation samples
    Sampling results
    Distribution of contour points in polar coordinates
    Shape histogram of different contour sampling points. (a) Sampling point 1; (b) sampling point 2; (c) sampling point 3
    Matching results
    Matching results of different sampling points
    Video sequences
    Matching process of feature sequence in spatial domain
    Match process of feature sequence in time domain
    Schematic diagram of DTW algorithm
    Schematic of typical local path constraint
    Diagram of "Morbid" twisting path
    Schematic of parameter of elliptic band
    Recognition rate of different weight distributions
    Influence of decision threshold values on recognition rate
    Schematic of three global constraint boundaries with the same warping window size
    Comparison of searching efficiency of different bands
    Searching efficiency of different global boundaries on large time series
    Classification accuracies of different boundaries sharps and sizes
    Classification accuracies of all warping window sizes with different frames
    Confusion matrix of classification results on KTH dataset. (a) Shape feature; (b) motion feature; (c) fusion feature
    Confusion matrix of classification results on Weizmann dataset. (a) Shape feature; (b) motion feature; (c) fusion feature
    • Table 1. Comparison ofaccuracy and computation time of different algorithms on KTH dataset

      View table

      Table 1. Comparison ofaccuracy and computation time of different algorithms on KTH dataset

      AlgorithmAverageaccuracy /%Computationtime /ms
      Method in Ref.[7]89.7023.9
      Method in Ref.[10]85.6730.3
      Proposed method (motion)84.8918.9
      Proposed method (shape)81.1119.3
      Proposed method (fusion)92.7021.7
    • Table 2. Comparison of average accuracy and computation time of different algorithms on Weizmann dataset

      View table

      Table 2. Comparison of average accuracy and computation time of different algorithms on Weizmann dataset

      AlgorithmAverageaccuracy /%Computationtime /ms
      Method in Ref.[11]89.2635.7
      Method in Ref.[8]90.0026.8
      Proposed method (motion)83.6917.9
      Proposed method (shape)82.8019.4
      Proposed method (fusion)93.2020.9
    • Table 3. Comparison of average accuracy of different algorithms on UCF101 dataset

      View table

      Table 3. Comparison of average accuracy of different algorithms on UCF101 dataset

      AlgorithmAverage accuracy /%
      Method in Ref.[9]78.67
      Method in Ref.[19]81.60
      Proposed method (motion)77.90
      Proposed method (shape)76.50
      Proposed method (fusion)81.20
    Tools

    Get Citation

    Copy Citation Text

    Yandi Li, Xiping Xu. Human Action Recognition by Decision-Making Level Fusion Based on Spatial-Temporal Features[J]. Acta Optica Sinica, 2018, 38(8): 0810001

    Download Citation

    EndNote(RIS)BibTexPlain Text
    Save article for my favorites
    Paper Information

    Category: Image Processing

    Received: Dec. 11, 2017

    Accepted: Mar. 20, 2018

    Published Online: Sep. 6, 2018

    The Author Email:

    DOI:10.3788/AOS201838.0810001

    Topics