Cross-Modal Person Re-Identification Based on Mask Reconstruction with Dynamic Attention

Fig. 7. Feature distribution visualization. (a) Baseline feature dimensionality reduction results; (b) MRDA network feature dimensionality reduction results; (c) baseline feature distance distribution; (d) MRDA network feature distance distribution

Download full size

Fig. 8. Grad-CAM visualization results. (a) Input images; (b) MRDA network visualization results

Download full size

Fig. 9. Top-10 retrieval results obtained on the SYSU-MM01 dataset. (a) Baseline retrieval results; (b) MRDA network retrieval results

Download full size

Table 1. Comparison of DAM and other attention modules
View table
Table 1. Comparison of DAM and other attention modules
Module Rank-1 /% mAP /%
DAM 70.55 63.89
BAM 66.63 62.17
CBAM 66.74 60.95
IWPAM 67.79 61.29

Table 2. Experimental results in all-search single-shot mode of the SYSU-MM01 dataset
View table
Table 2. Experimental results in all-search single-shot mode of the SYSU-MM01 dataset
Baseline MRM DAM Rank-1 /% mAP /%
√ 63.21 59.87
√ √ 68.39 61.82
√ √ 68.47 63.09
√ √ √ 70.55 63.89

Table 3. Comparison results with other networks in the all-search mode of the SYSU-MM01 dataset

View table

Table 3. Comparison results with other networks in the all-search mode of the SYSU-MM01 dataset

Network	Rank-1 /%	Rank-10 /%	Rank-20 /%	mAP /%
Zero-Pad^［2］	14.80	54.12	71.33	15.95
cmGAN^［5］	26.97	67.51	80.56	27.80
D2RL^［26］	28.90	70.60	82.40	29.20
Hi-CMD^［27］	34.94	77.58	—	35.94
DDAG^［18］	54.75	90.39	95.81	53.02
AGW^［1］	47.50	84.39	92.14	47.65
MCLNet^［7］	65.40	93.33	97.14	61.98
DML^［28］	58.40	91.20	95.80	56.10
MAUMG^［29］	61.59	—	—	59.96
MSFF^［30］	62.93	93.68	97.67	60.62
MRDA	70.55	94.90	98.53	63.89

Table 4. Comparison results with other networks in the indoor-search mode of the SYSU-MM01 dataset

View table

Table 4. Comparison results with other networks in the indoor-search mode of the SYSU-MM01 dataset

Network	Rank-1 /%	Rank-10 /%	Rank-20 /%	mAP /%
Zero-Pad^［2］	20.58	68.38	85.79	26.92
cmGAN^［5］	31.63	77.23	89.18	42.19
DDAG^［18］	61.02	94.06	98.41	67.98
AGW^［1］	54.17	91.14	95.98	62.97
MCLNet^［7］	72.56	96.88	99.20	76.58
DML^［28］	62.40	95.20	98.70	69.50
MAUMG^［29］	67.07	—	—	73.58
MSFF^［30］	68.09	95.71	98.22	54.51
MRDA	72.69	97.15	98.73	77.14

Table 5. Comparison results with other networks in the visible-to-infrared mode of the RegDB dataset

View table

Table 5. Comparison results with other networks in the visible-to-infrared mode of the RegDB dataset

Network	Rank-1 /%	Rank-10 /%	Rank-20 /%	mAP /%
Zero-Pad^［2］	17.75	34.21	44.35	18.90
cmGAN^［5］	24.44	47.53	56.78	20.08
D2RL^［26］	43.40	66.10	76.30	44.10
Hi-CMD^［27］	34.94	77.58	—	35.94
DDAG^［18］	72.37	—	—	69.09
AGW^［1］	70.05	86.21	91.55	66.37
MCLNet^［7］	80.31	92.70	96.03	73.07
DML^［28］	77.60	—	—	84.30
MAUMG^［29］	83.39	—	—	78.75
MSFF^［30］	78.06	91.36	96.12	72.43
MRDA	91.80	97.46	98.67	82.08

Tools

Get Citation

Copy Citation Text

Kuo Zhang, Xinyue Fan, Jiahui Li, Gan Zhang. Cross-Modal Person Re-Identification Based on Mask Reconstruction with Dynamic Attention[J]. Laser & Optoelectronics Progress, 2024, 61(10): 1015001

Download Citation

EndNote(RIS)BibTex Plain Text

Set citation alerts for article

Save article for my favorites

Paper Information

Category: Machine Vision

Received: Jul. 17, 2023

Accepted: Oct. 9, 2023

Published Online: Apr. 2, 2024

The Author Email: Zhang Kuo (s210101189@stu.cqupt.edu.cn)

DOI:10.3788/LOP231742

Topics

laser devices and laser physics

Lasers and Laser Optics

Laser physics

laser manufacturing

Instrumentation, Measurement and Metrology

Table 1. Comparison of DAM and other attention modules

Table 1. Comparison of DAM and other attention modules

Table 2. Experimental results in all-search single-shot mode of the SYSU-MM01 dataset

Table 2. Experimental results in all-search single-shot mode of the SYSU-MM01 dataset

Table 3. Comparison results with other networks in the all-search mode of the SYSU-MM01 dataset

Table 3. Comparison results with other networks in the all-search mode of the SYSU-MM01 dataset

Table 4. Comparison results with other networks in the indoor-search mode of the SYSU-MM01 dataset

Table 4. Comparison results with other networks in the indoor-search mode of the SYSU-MM01 dataset

Table 5. Comparison results with other networks in the visible-to-infrared mode of the RegDB dataset

Table 5. Comparison results with other networks in the visible-to-infrared mode of the RegDB dataset