Laser & Optoelectronics Progress, Volume. 57, Issue 12, 121015(2020)

An Attention Model-Based Facial Expression Recognition Algorithm

Jinghui Chu, Wenhao Tang, Shan Zhang, and Wei Lü*
Author Affiliations
  • School of Electrical and Information Engineering, Tianjin University, Tianjin 300072, China
  • show less
    Figures & Tables(10)
    CSACNN model structure
    Channel attention branch
    Spatial attention branch
    Attention model integration and residual learning unit
    68 face landmarks
    Cropping of key areas of facial expression. (a) Original image; (b) facial mask; (c) cropped image
    • Table 1. Effect of hyper-parameters on network performance

      View table

      Table 1. Effect of hyper-parameters on network performance

      VariableValueAccuracy /%
      197.35
      d497.45
      897.25
      895.72
      r1697.45
      3295.41
    • Table 2. Effect of attention model location on network performance

      View table

      Table 2. Effect of attention model location on network performance

      DatasetLocationAccuracy /%
      After conv96.64
      CK+Before pooling97.45
      After pooling95.72
      After conv72.69
      MMIBefore pooling74.73
      After pooling72.59
    • Table 3. Performance comparison of different expression recognition methods

      View table

      Table 3. Performance comparison of different expression recognition methods

      MethodExperimentalsettingAccuracy /%
      CK+MMI
      3DCNN[32]Sequence-based85.9053.20
      LBP-TOP[33]Sequence-based88.9959.51
      HOG 3D[34]Sequence-based91.4460.89
      STM-ExpLet[35]Sequence-based94.1975.12
      DTGAN[18]Sequence-based97.25-
      Island Loss[25]Image-based94.3974.68
      IACNN[22]Image-based95.3771.55
      DLPCNN[24]Image-based95.78-
      DeRL[36]Image-based97.3073.23
      Ref.[19]Image-based97.37-
      PPDN[37]Image-based97.30-
      VGG16(ours)Image-based91.7264.13
      ResNet5(ours)Image-based86.8757.09
      CSACNN(ours)Image-based97.4574.73
    • Table 4. Performance comparison of different modules

      View table

      Table 4. Performance comparison of different modules

      ModelAccuracy /%
      CK+MMI
      Base94.7367.61
      Base+CA95.2171.47
      Base+SA95.6270.17
      Base+Crop95.8271.41
      Base+CA+SA96.4372.98
      Base+CA+SA+Crop97.4574.73
    Tools

    Get Citation

    Copy Citation Text

    Jinghui Chu, Wenhao Tang, Shan Zhang, Wei Lü. An Attention Model-Based Facial Expression Recognition Algorithm[J]. Laser & Optoelectronics Progress, 2020, 57(12): 121015

    Download Citation

    EndNote(RIS)BibTexPlain Text
    Save article for my favorites
    Paper Information

    Category: Image Processing

    Received: Sep. 9, 2019

    Accepted: Nov. 2, 2019

    Published Online: Jun. 3, 2020

    The Author Email: Lü Wei (luwei@tju.edu.cn)

    DOI:10.3788/LOP57.121015

    Topics