Laser & Optoelectronics Progress, Volume. 57, Issue 14, 141504(2020)

Micro-Expression Recognition Algorithm Based on Multiple Motive Feature Fusion

Yuting Su, Mengmeng Wang, Jing Liu*, Yunpeng Fei, and Xu He
Author Affiliations
  • School of Electrical and Information Engineering, Tianjin University, Tianjin 300072 China
  • show less
    Figures & Tables(6)
    Overall network framework
    Diagram of LMF detection process. (a) Example of 68 monitoring points in face; (b) LMF visualization
    Diagram of optical flow and optical strain. (a) Start frame of micro-expression; (b) peak frame of micro-expression;(c) optical flow visualization image; (d) optical strain visualization image
    • Table 1. Performance comparison of different data in CNN module

      View table

      Table 1. Performance comparison of different data in CNN module

      Input dataAccuracy /%
      Optical strain47.98
      LMF45.70
      Optical flow41.50
      Original data36.65
    • Table 2. Result comparison of single feature map and multiple feature fusion map

      View table

      Table 2. Result comparison of single feature map and multiple feature fusion map

      ExperimentNo.OpticalstrainLMFOpticalflowAccuracy /%
      152.45
      251.38
      350.54
      458.53
    • Table 3. Comparison of indicators of different algorithms

      View table

      Table 3. Comparison of indicators of different algorithms

      AlgorithmAccuracy /%UAR /%F1-score /%
      LBP-TOP*45.9530.9429.41
      LBP-SIPr46.5644.80
      FDMo45.9340.53
      ELRCN-TE*50.0039.3743.4
      MRWo46.1543.07
      STCLQPo58.3958.36
      MDMOr44.2544.16
      Bi-WOOFo57.8961.25
      Proposed algorithm58.5348.0752.82
    Tools

    Get Citation

    Copy Citation Text

    Yuting Su, Mengmeng Wang, Jing Liu, Yunpeng Fei, Xu He. Micro-Expression Recognition Algorithm Based on Multiple Motive Feature Fusion[J]. Laser & Optoelectronics Progress, 2020, 57(14): 141504

    Download Citation

    EndNote(RIS)BibTexPlain Text
    Save article for my favorites
    Paper Information

    Category: Machine Vision

    Received: Mar. 12, 2020

    Accepted: May. 8, 2020

    Published Online: Jul. 28, 2020

    The Author Email: Jing Liu (jliu_tju@tju.edu.cn)

    DOI:10.3788/LOP57.141504

    Topics