Opto-Electronic Engineering, Volume. 49, Issue 7, 210429(2022)
Interactive instance proposal network for HOI detection
Figures & Tables(13)
Fig. 2. Overview of human object interaction detection based on interactive instance proposal network
Fig. 5. Comparison of IIPN (bottom row) with Faster-RCNN (upper row)
Table 1. Experimental results on HICO-DET test set of different approaches
View tableView in ArticleTable 1. Experimental results on HICO-DET test set of different approaches
Method Default Known Object Full Rare Non-Rare Full Rare Non-Rare Shen et al.[ 27 ]6.46 4.24 7.12 - - - HO-RCNN[ 9 ]7.81 5.37 8.54 10.41 8.94 10.85 iCAN[ 8 ]14.84 10.45 16.15 16.26 11.33 17.73 RPNN[ 11 ]17.35 12.78 18.71 - - - PMFNet[ 31 ]17.46 15.65 18.00 20.34 17.47 21.20 DRG[ 7 ]19.26 17.74 19.71 23.40 21.75 23.89 Peyre et al.[ 32 ]19.40 14.60 20.90 - - - VCL[ 10 ]19.43 16.55 20.29 22.00 19.09 22.87 BaseLine 19.05 14.72 20.35 21.22 18.06 22.88 IIPN(Ours) 19.90 15.84 21.12 23.13 19.08 24.33
Table 2. Experimental results on V-COCO test set of different approaches
View tableView in ArticleTable 2. Experimental results on V-COCO test set of different approaches
Method mAParole Gupta et al.[ 39 ]31.8 GPNN[ 24 ]44.0 iCAN[ 8 ]45.3 RPNN[ 11 ]47.5 VCL[ 10 ]48.3 PMFNet w/o human pose[ 31 ]48.6 PMFNet[ 31 ]52.0 IIPN(Ours) 50.3
Table 3. Ablation studies of the proposed module on HICO-DET
View tableView in ArticleTable 3. Ablation studies of the proposed module on HICO-DET
Method Default(Full) Known Object(Full) BaseLine 19.05 21.22 BaseLine + IIPN w/o attention 19.33 21.92 BaseLine + IIPN with attention 19.72 22.33 BaseLine + CIFM w/o attention 19.26 21.74 BaseLine + CIFM with attention 19.60 21.89 BaseLine + IIPN + CIFM (Ours) 19.90 23.13
Table 4. Effects of different M and N on experimental results
View tableView in ArticleTable 4. Effects of different M and N on experimental results
Default Full Rare Non-Rare M=6, N=2 19.53 15.12 20.43 M=6, N=3 19.77 15.74 20.99 M=6, N=4 19.56 15.71 20.03 M=8, N=2 19.66 15.67 20.86 M=8, N=3 19.90 15.84 21.12 M=8, N=4 19.60 15.70 20.76
Table 5. Influence of different characteristics on experimental results
View tableView in ArticleTable 5. Influence of different characteristics on experimental results
fh fo SP fu fsem mAP ✓ ✗ ✗ ✗ ✗ 19.03 ✓ ✓ ✗ ✗ ✗ 19.35 ✓ ✓ ✓ ✗ ✗ 19.63 ✓ ✓ ✗ ✓ ✗ 19.78 ✓ ✓ ✗ ✓ ✓ 19.90
Table 6. Influence of different kon experimental results
View tableView in ArticleTable 6. Influence of different kon experimental results
Number of k Result on V-COCO Result on HICO-DET k=1 49.4 19.81 k=2 50.3 19.90 k=3 49.9 19.85
Tools
Get Citation
Copy Citation Text
Lixia Xue, Kaijian Yin, Ronggui Wang, Juan Yang. Interactive instance proposal network for HOI detection[J]. Opto-Electronic Engineering, 2022, 49(7): 210429
Paper Information
Category: Article
Received: Jan. 10, 2022
Accepted: --
Published Online: Aug. 1, 2022
The Author Email: Yang Juan (yangjuan6985@163.com)
© Copyright 2018-2021 | Chinese Laser Press.
All Rights Reserved 沪ICP备15018463号-20