Laser & Optoelectronics Progress, Volume. 58, Issue 6, 600004(2021)

Research on Video Abnormal Behavior Detection Based on Deep Learning

Peng Jiali, Zhao Yingliang*, and Wang Liming
Author Affiliations
  • Shanxi Key Laboratory of Signal Capturing and Processing, North University of China, Taiyuan, Shanxi 030051, China
  • show less
    Figures & Tables(5)
    Flow chart of the video abnormal behavior detection
    Abnormal behavior detection classification based on deep learning
    • Table 1. Advantages and disadvantages of the 3 abnormal behavior detection algorithms

      View table

      Table 1. Advantages and disadvantages of the 3 abnormal behavior detection algorithms

      AlgorithmAdvantageDisadvantage
      Supervised learningrelatively less training samples is needed;the most accurate;easy to understand and applyaccurate label is time-consuming;only predefined anomaly can be detected;hard to generalize
      Weakly supervised learningrelatively accurate with weak label;lower false alarm;relatively easy to usesplit the difference;relatively lower accuracy
      Unsupervised learningtraining without any label;only normal data needed;robust and easy to generalizehigher false positive rate;poor positioning accuracy;unable to classify anomaly behavior
    • Table 2. Comparison of commonly used anomaly behavior detection datasets

      View table

      Table 2. Comparison of commonly used anomaly behavior detection datasets

      DatasetVideoLengthAnnotationAnomaly category
      UCSD9810 minpixel-levelbiker, skater, wheelchair, car, walking on the grass
      Avenue3730 minframe-levelrun, throw, abnormal object
      UMN55 minframe-levelgroup escape
      UCF-Crime1900128 hvideo-levelabuse, arrest, arson, assault, accident, burglary, fighting, robbery
    • Table 3. Performance comparison of different algorithms unit: %

      View table

      Table 3. Performance comparison of different algorithms unit: %

      AlgorithmUCSD Ped1UCSD Ped2Avenue
      Frame-levelPixel-levelFrame-levelPixel-levelFrame-level
      EERAUCEERAUCEERAUCEERAUCEERAUC
      DSTCNN[12]--99.74------99.94--------
      LDA-Net[13]--------5.6397.8712.9192.96----
      FCN+LSTM[17]------------6.698.2----
      TW-C3D[18]6.2996.739.2295.275.5996.3711.8093.51----
      MISVM[31]22------16------2184.5
      AlgorithmUCSD Ped1UCSD Ped2Avenue
      Frame-levelPixel-levelFrame-levelPixel-levelFrame-level
      EERAUCEERAUCEERAUCEERAUCEERAUC
      MLEP[32]----------------24.892.8
      AMDN[34]16.092.140.167.217.090.8--------
      OC SVM[35]--------10.69317.388----
      GMFC-VAE[36]11.394.936.371.412.692.219.278.222.783.4
      MGFC-AAE[37]2085--72.61691.6--8822.384.2
      CAE[39]--89.5------54.7------75.4
      STAE[40]15.392.3----16.791.2----24.480.9
      LSTM AE[43]12.589.9----12.087.4------80.3
      3D-LSTM AE[44]15.990.9----15.893.6----20.781.8
      S2-VAE[45]14.3----94.2511.5495.7714.2890.83--87.6
      GAN[48]897.43570.31493.5--------
      Predict-GAN[51]--83.1------95.4------84.9
      ST U-Net[52]22.383.82----8.796.56------84.59
      Bi-Prediction[53]--89.0------96.6----21.587.8
    Tools

    Get Citation

    Copy Citation Text

    Peng Jiali, Zhao Yingliang, Wang Liming. Research on Video Abnormal Behavior Detection Based on Deep Learning[J]. Laser & Optoelectronics Progress, 2021, 58(6): 600004

    Download Citation

    EndNote(RIS)BibTexPlain Text
    Save article for my favorites
    Paper Information

    Category: Reviews

    Received: Jun. 19, 2020

    Accepted: --

    Published Online: Mar. 6, 2021

    The Author Email: Yingliang Zhao (zhaoyl18@nuc.edu.cn)

    DOI:10.3788/LOP202158.0600004

    Topics