Chinese Journal of Liquid Crystals and Displays, Volume. 37, Issue 3, 386(2022)

Micro-expression recognition based on video magnification and dual-branch network

LI Zhao-feng1,2、* and ZHU Ming1
Author Affiliations
  • 1[in Chinese]
  • 2[in Chinese]
  • show less

    Micro-expression refers to the expression that people spontaneously generate when they want to hide their true emotions. The duration is within 1/5 s. Their facial muscles are short and small in amplitude. The limited data set makes feature extraction difficult. These factors bring huge challenges to its recognition. In response to these problems, this paper proposes a recognition method based on image preprocessing technology and dual-branch network. Firstly, an advanced face alignment network is used to obtain effective facial regions, and then Euler video magnification technology is used to capture the subtle changes in facial movements. Optical flow information is used as the feature of the video sequence, and the feature maps of different combinations of optical flow information are input into the two-branch classification network to obtain the expression label output. Experiments aere performed on the two public data sets of SMIC and CASME Ⅱ, and the leave-one-subject-out(LOSO) is employed for cross-validation. The accuracy can reach 0.545 and 0.584, respectively. The quantitative and qualitative analysis of the experimental results verify the effectiveness of the proposed method.

    Tools

    Get Citation

    Copy Citation Text

    LI Zhao-feng, ZHU Ming. Micro-expression recognition based on video magnification and dual-branch network[J]. Chinese Journal of Liquid Crystals and Displays, 2022, 37(3): 386

    Download Citation

    EndNote(RIS)BibTexPlain Text
    Save article for my favorites
    Paper Information

    Category:

    Received: Dec. 19, 2021

    Accepted: --

    Published Online: Jul. 21, 2022

    The Author Email: LI Zhao-feng (lzf0215@163.com)

    DOI:10.37188/cjlcd.2021-0320

    Topics