Chinese Journal of Liquid Crystals and Displays, Volume. 39, Issue 7, 939(2024)
Multi-attention micro-expression recognition based on color and optical flow
Fig. 1. Dual-attention micro-expression recognition framework based on color and optical flow
Fig. 2. Comparison between RGB color space and CIE Luv color space
Fig. 10. Experiment of attention mechanism visualization and category prediction
Fig. 11. Experiment on the characteristics of non-attention mechanism
Table 1. Comparison of data set sample size
View tableView in ArticleTable 1. Comparison of data set sample size
样本类别 CASME Ⅱ SAMM 原始 扩充后 原始 扩充后 积极 32 128 26 78 消极 69 136 80 79 惊讶 28 112 15 75 其他 128 128 38 74 总数量 255 504 159 306
Table 2. Information about hyperparameter settings
View tableView in ArticleTable 2. Information about hyperparameter settings
超参数 数值 学习率 0.000 1 批量大小 16 Dropout 0.4 优化器 Adam 训练次数 50 激活函数 ReLU
Table 3. Comparison of micro-expression recognition rate in CASME Ⅱ and SAMM dataset
View tableView in ArticleTable 3. Comparison of micro-expression recognition rate in CASME Ⅱ and SAMM dataset
方法 CASME Ⅱ SAMM 准确率 F1值 准确率 F1值 LBP-TOP［ 17 ］63.14 60.80 39.54 41.02 LBP-SIP［ 18 ］45.72 42.53 41.51 40.20 Bi-WOOF［ 19 ］57.89 61.00 49.75 49.10 CNN-LSTM［ 20 ］60.98 59.34 55.46 54.23 ELRCN［ 21 ］52.44 50.00 53.12 51.30 3D-FCNN［ 22 ］59.11 56.78 57.35 54.56 Micro-Attention ［ 23 ］51.30 48.20 49.16 48.16 所提方法 72.38 70.85 69.18 67.04
Get Citation
Copy Citation Text
Kai HUANG, Feng WANG, Ye WANG, Yiting CHANG. Multi-attention micro-expression recognition based on color and optical flow[J]. Chinese Journal of Liquid Crystals and Displays, 2024, 39(7): 939
Category: Research Articles
Received: Jun. 28, 2023
Accepted: --
Published Online: Jul. 23, 2024
The Author Email: Feng WANG (wangfeng@tyut.edu.cn)
