Laser & Optoelectronics Progress, Volume. 60, Issue 6, 0610006(2023)

Lightweight Network Based on Multiregion Fusion for Facial Expression Recognition

Hong Tang1,2, Junling Xiang1,2、*, Haitao Chen3, Lü Rongcheng1, and Zehao Xia3
Author Affiliations
  • 1College of Communication and Information Engineering, Chongqing University of Posts and Telecommunications, Chongqing 400065, China
  • 2Chongqing Key Laboratory of Mobile Communication Technology, Chongqing University of Posts and Telecommunications, Chongqing 400065, China
  • 3International College, Chongqing University of Posts and Telecommunications, Chongqing 400065, China
  • show less
    References(32)

    [2] Wu T F, Bartlett M S, Movellan J R. Facial expression recognition using Gabor motion energy filters[C], 42-47(2010).

    [3] Russakovsky O, Deng J, Su H et al. ImageNet large scale visual recognition challenge[J]. International Journal of Computer Vision, 115, 211-252(2015).

    [4] Hamester D, Barros P, Wermter S. Face expression recognition with a 2-channel Convolutional Neural Network[C], 1-8(2015).

    [5] Hasani B, Mahoor M H. Facial expression recognition using enhanced deep 3D convolutional neural networks[C], 2278-2288(2017).

    [6] Ji Y L, Hu Y H, Yang Y et al. Cross-domain facial expression recognition via an intra-category common feature and inter-category distinction feature fusion network[J]. Neurocomputing, 333, 231-239(2019).

    [7] Baddar W J, Ro Y M. Bilateral hemiface feature representation learning for pose robust facial expression recognition[C](2016).

    [8] Happy S L, Routray A. Automatic facial expression recognition using features of salient facial patches[J]. IEEE Transactions on Affective Computing, 6, 14948838(2015).

    [9] Majumder A, Behera L, Subramanian V K. Automatic facial expression recognition system using deep network-based data fusion[J]. IEEE Transactions on Cybernetics, 48, 103-114(2018).

    [10] Minaee S, Minaei M, Abdolrashidi A. Deep-emotion: facial expression recognition using attentional convolutional network[J]. Sensors, 21, 3046(2021).

    [11] Wang K, Peng X J, Yang J F et al. Region attention networks for pose and occlusion robust facial expression recognition[J]. IEEE Transactions on Image Processing, 29, 4057-4069(2020).

    [12] Gan Y L, Chen J Y, Yang Z K et al. Multiple attention network for facial expression recognition[J]. IEEE Access, 8, 7383-7393(2020).

    [13] Ma H, Celik T, Li H C. Lightweight attention convolutional neural network through network slimming for robust facial expression recognition[J]. Signal, Image and Video Processing, 15, 1507-1515(2021).

    [14] Shen H, Meng Q H, Liu Y B. Facial expression recognition by merging multilayer features of lightweight convolutional networks[J]. Laser & Optoelectronics Progress, 58, 0610005(2021).

    [15] Yin P B, Pan W M, Zhang H J. Lightweight facial expression recognition method based on convolutional attention[J]. Laser & Optoelectronics Progress, 58, 1210023(2021).

    [16] Ioffe S, Szegedy C. Batch normalization: accelerating deep network training by reducing internal covariate shift[C], 448-456(2015).

    [17] Fan Y, Lam J C K, Li V O K. Muti-region ensemble convolutional neural network for facial expression recognition[M]. Hammer B, Maglogiannis I. Artificial neural networks and machine learning. Lecture notes in computer science, 11139, 84-94(2018).

    [18] Tang H, Xiang J L, Wei H Y. Facial expression recognition based on double-channel facial images with robust occlusion[J]. Journal of Network Intelligence, 6, 606-623(2021).

    [19] Dong X Y, Yan Y, Ouyang W L et al. Style aggregated network for facial landmark detection[C], 379-388(2018).

    [20] Sagonas C, Tzimiropoulos G, Zafeiriou S et al. 300 faces in-the-wild challenge: the first facial landmark localization challenge[C], 397-403(2013).

    [21] Liu Z, Li J G, Shen Z Q et al. Learning efficient convolutional networks through network slimming[C], 2755-2763(2017).

    [22] Li S, Deng W H, Du J P. Reliable crowdsourcing and deep locality-preserving learning for expression recognition in the wild[C], 2584-2593(2017).

    [23] Mollahosseini A, Hasani B, Mahoor M H. AffectNet: a database for facial expression, valence, and arousal computing in the wild[J]. IEEE Transactions on Affective Computing, 10, 18-31(2019).

    [24] Zhang K P, Zhang Z P, Li Z F et al. Joint face detection and alignment using multitask cascaded convolutional networks[J]. IEEE Signal Processing Letters, 23, 1499-1503(2016).

    [25] He K M, Zhang X Y, Ren S Q et al. Deep residual learning for image recognition[C], 770-778(2016).

    [27] Cao S, Yao Y Q, An G Y. E2-capsule neural networks for facial expression recognition using AU-aware attention[J]. IET Image Processing, 14, 2417-2424(2020).

    [28] Li Z Y, Han S Z, Khan A S et al. Pooling map adaptation in convolutional neural network for facial expression recognition[C], 1108-1113(2019).

    [29] Li S, Deng W H. Reliable crowdsourcing and deep locality-preserving learning for unconstrained facial expression recognition[J]. IEEE Transactions on Image Processing, 28, 356-370(2019).

    [30] Lu Y, Wang S G, Zhao W T et al. WGAN-based robust occluded facial expression recognition[J]. IEEE Access, 7, 93594-93610(2019).

    [31] Wang C, Wang S F, Liang G. Identity- and pose-robust facial expression recognition through adversarial feature learning[C], 238-246(2019).

    [32] Li Y J, Lu G M, Li J X et al. Facial expression recognition in the wild using multi-level features and attention mechanisms[J]. IEEE Transactions on Affective Computing, 1, 1-15(2020).

    Tools

    Get Citation

    Copy Citation Text

    Hong Tang, Junling Xiang, Haitao Chen, Lü Rongcheng, Zehao Xia. Lightweight Network Based on Multiregion Fusion for Facial Expression Recognition[J]. Laser & Optoelectronics Progress, 2023, 60(6): 0610006

    Download Citation

    EndNote(RIS)BibTexPlain Text
    Save article for my favorites
    Paper Information

    Category: Image Processing

    Received: Dec. 13, 2021

    Accepted: Jan. 17, 2022

    Published Online: Mar. 16, 2023

    The Author Email: Junling Xiang (390098758@qq.com)

    DOI:10.3788/LOP213204

    Topics