Opto-Electronic Engineering, Volume. 50, Issue 7, 230136(2023)
Infrared-visible person re-identification based on multi feature aggregation
Figures & Tables(11)
Fig. 5. Inter-class intra-class distance and feature distribution diagram
Table 1. Comparison results on SYSU-MM01 datasets
View tableView in ArticleTable 1. Comparison results on SYSU-MM01 datasets
Method Setting All search Indoor search rank-1 rank-10 rank-20 mAP mINP rank-1 rank-10 rank-20 mAP mINP One-stream[ 14 ]12.04 49.68 66.74 13.67 - 16.94 63.55 82.10 22.95 - Two-stream[ 14 ]11.65 47.99 65.50 12.85 - 15.60 61.18 81.02 21.49 - Zero-Padding[ 14 ]14.80 54.12 71.33 15.59 - 20.58 68.38 85.79 26.92 - HCML[ 18 ]14.32 53.16 69.17 16.16 - 24.52 73.25 86.73 30.08 - BDTR[ 17 ]27.32 66.96 81.07 27.32 - 31.92 77.18 89.28 41.86 - D2RL[ 4 ]28.90 70.60 82.40 29.20 - - - - - - AlignGAN[ 19 ]42.03 85.25 93.73 41.48 - 45.86 90.17 95.39 55.18 - AGW[ 16 ]47.58 84.45 92.11 47.69 35.30 54.29 91.14 95.99 63.02 59.23 Xmodal[ 20 ]49.92 89.79 95.96 50.73 - - - - - - DDAG[ 8 ]53.61 89.17 95.30 52.02 39.62 58.37 91.92 97.42 65.44 62.61 CM-NAS[ 21 ]62.04 92.92 97.31 60.00 - 67.03 97.02 99.34 72.97 - CAJ[ 9 ]68.23 95.59 98.49 65.32 53.61 74.01 97.79 99.67 78.52 76.79 MPANet[ 6 ]70.07 95.39 98.39 67.07 - 76.35 97.56 99.48 80.16 - PIC[ 23 ]57.5 - - 55.1 - 60.4 - - 67.7 - DART[ 24 ]68.72 96.39 98.96 66.29 53.26 72.52 97.84 99.46 78.17 74.94 SPOT[ 10 ]65.34 92.73 97.04 62.25 48.86 69.42 96.22 99.12 74.63 70.48 DML[ 7 ]58.40 91.20 95.80 56.10 - 62.40 95.20 98.70 69.50 - PMT[ 12 ]67.53 95.36 98.64 64.98 51.86 71.66 96.73 99.25 76.52 72.74 SFANet[ 25 ]65.74 92.98 97.05 60.83 - 71.60 96.60 99.45 80.05 - SIDA[ 26 ]68.36 95.91 98.56 64.19 - 73.28 97.35 99.52 77.49 - MTMFE[ 27 ]69.47 96.42 99.11 66.41 - 72.56 96.98 99.20 76.58 - Ours 71.77 96.15 98.7 68.43 55.21 78.24 98.23 99.49 81.9 78.44
Table 2. Comparison results on RegDB datasets
View tableView in ArticleTable 2. Comparison results on RegDB datasets
Method Setting Visible to infrared Infrared to visible rank-1 rank-10 rank-20 mAP mINP rank-1 rank-10 rank-20 mAP mINP Zero-Padding[ 14 ]17.75 34.21 44.35 18.90 - 16.63 34.68 44.25 17.82 - HCML[ 18 ]24.44 47.53 56.78 20.08 - 21.70 45.02 55.58 22.24 - BDTR[ 17 ]33.56 58.61 67.43 32.76 - 32.92 58.46 68.43 31.96 - D2RL[ 4 ]43.40 66.10 76.30 44.10 - - - - - AGW[ 16 ]70.05 86.21 91.55 66.37 50.19 70.49 87.21 91.84 65.90 51.24 Xmodal[ 20 ]62.21 83.13 91.72 60.18 - - - - - - DDAG[ 8 ]69.34 85.77 89.98 63.19 49.24 64.77 83.85 88.90 58.54 48.62 CM-NAS[ 21 ]84.54 95.18 97.85 80.32 - 82.56 94.52 97.37 78.31 - MCLNet[ 22 ]80.31 92.70 96.03 73.07 - 75.93 90.93 94.59 69.49 - CAJ[ 9 ]84.72 95.17 97.38 78.70 65.33 84.09 94.79 97.11 77.25 61.56 PIC[ 23 ]83.6 - - 79.6 - 79.5 - - 77.4 - DART[ 24 ]78.23 - - 67.04 48.36 75.04 - - 64.38 43.32 SPOT[ 10 ]80.35 93.48 96.44 72.46 56.19 79.37 92.79 96.01 72.26 56.06 DML[ 7 ]77.60 - - 84.30 - 77.00 - - 83.60 - PMT[ 12 ]84.83 - - 76.55 - 84.16 - - 75.13 - SFANet[ 25 ]76.31 91.02 94.27 68.00 - 70.15 85.24 89.27 63.77 - SIDA[ 26 ]81.73 - 96.55 75.07 - 79.71 - 95.47 72.60 - MTMFE[ 27 ]85.04 94.38 97.22 82.52 - 81.11 92.35 96.19 79.59 - Ours 85.38 95.39 97.54 79.49 65.72 84.58 95.27 97.23 78.02 62.22
Table 3. Ablation study of four different settings on the SYSU-MM01 dataset
View tableView in ArticleTable 3. Ablation study of four different settings on the SYSU-MM01 dataset
Settings All search Indoor search AFAM MSAM rank-1 rank-10 rank-20 mAP mINP rank-1 rank-10 rank-20 mAP mINP 68.23 95.59 98.49 65.32 51.90 74.01 97.79 99.67 78.52 74.78 √ 69.30 95.69 98.41 65.95 52.14 75.27 97.84 99.48 79.51 75.79 √ 70.89 95.88 98.52 67.61 54.3 77.69 97.43 99.25 81.09 77.48 √ √ 71.77 96.15 98.70 68.43 55.21 78.24 98.23 99.49 81.90 78.44
Table 4. Multi scale feature aggregation module receptive field analysis
View tableView in ArticleTable 4. Multi scale feature aggregation module receptive field analysis
Settings Receptive field All search Indoor search rank-1 rank-10 rank-20 mAP mINP rank-1 rank-10 rank-20 mAP mINP 1，3，5，7 69.41 95.82 98.54 66.27 52.96 75.34 97.96 99.66 79.98 76.53 1，2，3，4 70.17 95.51 98.51 67.14 54.1 76.44 98.09 99.6 80.65 77.22 1，3，5 70.5 95.77 98.54 67.11 53.68 76.66 97.81 99.51 80.54 76.99 1，2，3 70.53 95.86 98.67 67.21 53.77 76.59 97.88 99.37 80.68 77.22 1，3 71.77 96.15 98.70 68.43 55.21 78.24 98.23 99.49 81.90 78.44
Tools
Get Citation
Copy Citation Text
Haijun Zheng, Bin Ge, Chenxing Xia, Cheng Wu. Infrared-visible person re-identification based on multi feature aggregation[J]. Opto-Electronic Engineering, 2023, 50(7): 230136
Paper Information
Category: Article
Received: Jun. 15, 2023
Accepted: Aug. 11, 2023
Published Online: Sep. 25, 2023
The Author Email:
© Copyright 2018-2021 | Chinese Laser Press.
All Rights Reserved 沪ICP备15018463号-20