Researching | Microexpression Recognition Algorithm Based on a Two-Branch Lightweight Network

Laser & Optoelectronics Progress, Volume. 61, Issue 14, 1437001(2024)

Microexpression Recognition Algorithm Based on a Two-Branch Lightweight Network

Bo Zhang and Yufan Wu^*

Author Affiliations

College of Computer Science and Technology, Shenyang University of Chemical Technology, Shenyang 110142, Liaoning , China

show less

Abstract Get PDF(in Chinese)

Figures&Tables (15)

References (35)

Paper Information

References(35)

[1] Pfister T, Li X B, Zhao G Y et al. Recognising spontaneous facial micro-expressions[C], 1449-1456(2012).

[2] Ruiz-Hernandez J A, Pietikäinen M. Encoding Local Binary Patterns using the re-parametrization of the second order Gaussian jet[C](2013).

[3] Huang X H, Wang S J, Zhao G Y et al. Facial micro-expression recognition using spatiotemporal local binary pattern with integral projection[C](2016).

[4] Polikovsky S, Kameda Y, Ohta Y. Facial micro-expressions recognition using high speed camera and 3D-gradient descriptor[C](2009).

[5] Liu Y J, Zhang J K, Yan W J et al. A main directional mean optical flow feature for spontaneous micro-expression recognition[J]. IEEE Transactions on Affective Computing, 7, 299-310(2016).

[6] Ma H Y, An G Y, Ruan Q Q. Mean histogram of oriented optical flow feature for micro-expression recognition[J]. Journal of Signal Processing, 34, 279-288(2018).

[7] Happy S L, Routray A. Fuzzy histogram of optical flow orientations for micro-expression recognition[J]. IEEE Transactions on Affective Computing, 10, 394-406(2019).

[8] Kim D H, Baddar W J, Ro Y M. Micro-expression recognition with expression-state constrained spatio-temporal feature representations[C], 382-386(2016).

[9] Wang S J, Li B J, Liu Y J et al. Micro-expression recognition with small sample size by transferring long-term convolutional neural network[J]. Neurocomputing, 312, 251-262(2018).

[10] Liu Y J, Li Y G, Yi X H et al. Lightweight ViT model for micro-expression recognition enhanced by transfer learning[J]. Frontiers in Neurorobotics, 16, 922761(2022).

[11] Zhou D Q, Kang B Y, Jin X J et al. DeepViT: towards deeper vision transformer[EB/OL]. https://arxiv.org/abs/2103.11886

[12] Ma N N, Zhang X Y, Zheng H T, Ferrari V, Hebert M, Sminchisescu C et al. ShuffleNet V2: practical guidelines for efficient CNN architecture design[M]. Computer vision-ECCV 2018. Lecture notes in computer science, 11218, 122-138(2018).

[13] Howard A, Sandler M, Chen B et al. Searching for MobileNetV3[C], 1314-1324(2020).

[14] Xu W, Zheng H, Yang Z et al. Micro-expression recognition base on optical flow features and improved MobileNetV2[J]. KSII Transactions on Internet and Information Systems, 15, 1981-1995(2021).

[15] Ma H L, Xia X, Wang X et al. MoCoViT: mobile convolutional vision transformer[EB/OL]. https://arxiv.org/abs/2205.12635

[16] Mehta S, Rastegari M. MobileViT: light-weight, general-purpose, and mobile-friendly vision transformer[EB/OL]. https://arxiv.org/abs/2110.02178

[17] Wang L M, Xiong Y J, Wang Z et al. Towards good practices for very deep two-stream ConvNets[EB/OL]. https://arxiv.org/abs/1507.02159

[18] Liong S T, Gan Y S, Zheng D N et al. Evaluation of the spatio-temporal features and GAN for micro-expression recognition system[J]. Journal of Signal Processing Systems, 92, 705-725(2020).

[19] Manohar V, Goldgof D, Sarkar S et al. Facial strain pattern as a soft forensic evidence[C], 42(2007).

[20] Liong S T, See J, Phan R C W et al. Spontaneous subtle expression detection and recognition based on facial strain[J]. Signal Processing: Image Communication, 47, 170-182(2016).

[21] Li Y T, Huang X H, Zhao G Y. Can micro-expression be recognized based on single apex frame?[C], 3094-3098(2018).

[22] Chollet F. Xception: deep learning with depthwise separable convolutions[C], 1800-1807(2017).

[23] Arnab A, Dehghani M, Heigold G et al. ViViT: a video vision transformer[C], 6816-6826(2022).

[24] Szegedy C, Liu W, Jia Y Q et al. Going deeper with convolutions[C](2015).

[25] Hu J, Shen L, Sun G. Squeeze-and-Excitation networks[C], 7132-7141(2018).

[26] Woo S, Park J, Lee J Y, Ferrari V, Hebert M, Sminchisescu C et al. CBAM: convolutional block attention module[M]. Computer vision-ECCV 2018. Lecture notes in computer science, 11211, 3-19(2018).

[27] Li X B, Pfister T, Huang X H et al. A Spontaneous Micro-expression Database: inducement, collection and baseline[C](2013).

[28] Yan W J, Li X B, Wang S J et al. CASME II: an improved spontaneous micro-expression database and the baseline evaluation[J]. PLoS One, 9, e86041(2014).

[29] Davison A K, Lansley C, Costen N et al. SAMM: a spontaneous micro-facial movement dataset[J]. IEEE Transactions on Affective Computing, 9, 116-129(2016).

[30] Peng M, Wang C Y, Bi T et al. A novel apex-time network for cross-dataset micro-expression recognition[C](2019).

[31] Gan Y S, Liong S T, Yau W C et al. OFF-ApexNet on micro-expression recognition system[J]. Signal Processing: Image Communication, 74, 129-139(2019).

[32] Sandler M, Howard A, Zhu M L et al. MobileNetV2: inverted residuals and linear bottlenecks[C], 4510-4520(2018).

[33] Touvron H, Cord M, Douze M et al. Training data-efficient image transformers & distillation through attention[EB/OL]. https://arxiv.org/abs/2012.12877

[34] Dosovitskiy A, Beyer L, Kolesnikov A et al. An image is worth 16 x 16 words: transformers for image recognition at scale[EB/OL]. https://arxiv.org/abs/2010.11929

[35] Li S C, Zhou S Y, Zhu H et al. Micro-expression recognition based on combination of multi-attention mechanism and intermediate frame sequence[J]. Radio Engineering, 53, 636-643(2023).

Tools

Get Citation

Copy Citation Text

Bo Zhang, Yufan Wu. Microexpression Recognition Algorithm Based on a Two-Branch Lightweight Network[J]. Laser & Optoelectronics Progress, 2024, 61(14): 1437001

Download Citation

EndNote(RIS)BibTex Plain Text

Set citation alerts for article

Save article for my favorites

Paper Information

Category: Digital Image Processing

Received: Jul. 13, 2023

Accepted: Oct. 30, 2023

Published Online: Jul. 8, 2024

The Author Email: Yufan Wu (z2021360@stu.syuct.edu.cn)

DOI:10.3788/LOP231714

CSTR:32186.14.LOP231714

Topics

laser devices and laser physics

Lasers and Laser Optics

laser manufacturing

Instrumentation, Measurement and Metrology