Laser & Optoelectronics Progress, Volume. 61, Issue 14, 1437001(2024)

Microexpression Recognition Algorithm Based on a Two-Branch Lightweight Network

Bo Zhang and Yufan Wu*
Author Affiliations
  • College of Computer Science and Technology, Shenyang University of Chemical Technology, Shenyang 110142, Liaoning , China
  • show less

    One of the common challenges encountered in microexpression recognition using convolutional neural networks is the heightened complexity caused by increased accuracy. To address this challenge, this study introduces an enhanced lightweight dual-stream attention network, called the enhanced dual-stream MISEViT network (EDSMISEViTNet), for microexpression recognition. First, microexpression samples are preprocessed, and peak frames are extracted as spatial features. Additionally, the TV-L1 optical flow method is used to extract the temporal features between the start frame and the vertex frame of each sample. Furthermore, this study improves the MobileViT network by designing an MI module that combines Inception and SE modules and introduces an attention module for efficient feature extraction. Temporal and spatial features are separately fed into this network, and the resultant features are concatenated, fused, and subsequently subjected to classification. To enhance precision, the CASME II, SAMM, and SMIC datasets are combined into a composite dataset for experimentation. The results reveal that the proposed algorithm model requires a training parameter count of only 3.9×106 and processes a single sample in just 71.8 ms. Compared with the existing methods, this approach achieves excellent accuracy while maintaining a low parameter count.

    Keywords
    Tools

    Get Citation

    Copy Citation Text

    Bo Zhang, Yufan Wu. Microexpression Recognition Algorithm Based on a Two-Branch Lightweight Network[J]. Laser & Optoelectronics Progress, 2024, 61(14): 1437001

    Download Citation

    EndNote(RIS)BibTexPlain Text
    Save article for my favorites
    Paper Information

    Category: Digital Image Processing

    Received: Jul. 13, 2023

    Accepted: Oct. 30, 2023

    Published Online: Jul. 8, 2024

    The Author Email: Yufan Wu (z2021360@stu.syuct.edu.cn)

    DOI:10.3788/LOP231714

    CSTR:32186.14.LOP231714

    Topics