Laser & Optoelectronics Progress, Volume. 61, Issue 4, 0437002(2024)
Micro-Video Event Detection Based on Deep Dynamic Semantic Correlation
Figures & Tables(9)
Fig. 5. Influence of parameters on model performance. (a) Influence of the number of hidden attributes; (b) influence of the number of important frames
Fig. 6. Influence of parameters on model performance. (a) Influence of α and β; (b) influence of γ
Table 1. Influence of different modules on the experimental results
View tableTable 1. Influence of different modules on the experimental results
Module R P mAP FIE 0.723 0.708 0.754 FIE+ISAE 0.729 0.715 0.768 FIE+ISAE+DCU 0.731 0.719 0.772 FIE+ISAE+HAAU 0.742 0.736 0.783 FIE+HAAU+DCU 0.763 0.754 0.794 ISAE+HAAU+DCU 0.712 0.697 0.759 Ours 0.774 0.769 0.817
Table 2. Performance comparison of different methods on the Flickr dataset
View tableTable 2. Performance comparison of different methods on the Flickr dataset
Method R P mAP Training time /s C3D 0.552 0.630 0.663 16560.490 ResNet3D 0.632 0.672 0.694 36720.080 SRRS 0.617 0.625 0.656 91440.120 DTSL 0.622 0.672 0.679 83160.370 NI-SVM 0.691 0.727 0.749 3048.720 RegNet 0.753 0.749 0.785 4505.810 KPGNN 0.705 0.731 0.756 2856.950 TSN 0.727 0.731 0.762 2568.560 Gated-VIGAT 0.733 0.746 0.778 2603.050 EventGraph 0.736 0.725 0.766 2516.970 EITEST 0，753 0.750 0.784 2478.230 PP-GCN 0.730 0.747 0.772 2756.280 TSM 0.732 0.726 0.757 2586.630 EfficientNet 0.745 0.752 0.781 2441.970 X3D 0.761 0.757 0.796 2391.710 Ours 0.774 0.769 0.817 2370.560
Table 3. Comparison of mAP of different methods on UCF101 and HMDB51 datasets
View tableTable 3. Comparison of mAP of different methods on UCF101 and HMDB51 datasets
Method UCF-101 HMDB51 C3D 0.785 0.533 ResNet3D 0.814 0.572 SRRS 0.763 0.517 DTSL 0.791 0.556 NI-SVM 0.827 0.573 RegNet 0.857 0.595 KPGNN 0.832 0.578 TSN 0.839 0.581 Gated-VIGAT 0.848 0.586 EventGraph 0.842 0.581 EITEST 0.846 0.575 PP-GCN 0.850 0.599 TSM 0.838 0.577 EfficientNet 0.856 0.595 X3D 0.867 0.608 Ours 0.885 0.622
Tools
Get Citation
Copy Citation Text
Peiguang Jing, Xiaoyi Song, Yuting Su. Micro-Video Event Detection Based on Deep Dynamic Semantic Correlation[J]. Laser & Optoelectronics Progress, 2024, 61(4): 0437002
Paper Information
Category: Digital Image Processing
Received: Mar. 30, 2023
Accepted: Jun. 1, 2023
Published Online: Feb. 26, 2024
The Author Email: Peiguang Jing (pgjing@tju.edu.cn)
CSTR:32186.14.LOP230994
© Copyright 2018-2021 | Chinese Laser Press.
All Rights Reserved 沪ICP备15018463号-20