Opto-Electronic Engineering, Volume. 51, Issue 9, 240119-1(2024)

Quadrupl-stream input-guided feature complementary visible-infrared person re-identification

Bin Ge1...2,*, Nuo Xu1, Chenxing Xia1 and Haijun Zheng1 |Show fewer author(s)
Author Affiliations
  • 1School of Computer Science and Engineering, Anhui University of Science and Technology, Huainan, Anhui 232001, China
  • 2Institute of Energy, Hefei Comprehensive National Science Center, Hefei, Anhui 230031, China
  • show less
    Figures & Tables(11)
    QFCNet structure diagram
    Modal reweighted recovery module
    Sub-critical features complementary module
    Channel attention
    Feature distribution diagram and intra-class and inter-class distances. (a) Baseline feature distribution diagram; (b) QFCNet feature distribution diagram; (c) Baseline intra-class and inter-class distances; (d) QFCNet intra-class and inter-class distances
    Visualization of the heat map
    Visual sorting results on SYSU-MM01
    • Table 1. Comparison results on SYSU-MM01 dataset/%

      View table
      View in Article

      Table 1. Comparison results on SYSU-MM01 dataset/%

      MethodPublishSetting
      All searchIndoor search
      rank-1rank-10rank-20mAPrank-1rank-10rank-20mAP
      AlignGAN[23]ICCV1942.485.093.740.745.987.694.454.3
      D2RL[24]CVPR 1928.9070.6082.4029.20----
      X-Modality[15]AAAI 2049.989.89650.7----
      DDAG[8]ECCV 2053.6189.1795.352.0258.3791.9297.4265.44
      Hi-CMD[9]CVPR 2034.977.6-35.9----
      JSIA-ReID[25]AAAI2038.180.789.936.943.886.294.252.9
      MPANet[5]CVPR 2170.696.298.868.276.297.299.376.9
      AGW[16]TPAMI 2147.5884.4592.1147.6954.2991.1495.9963.02
      CAJ[17]CVPR 2169.995.798.566.976.397.999.580.4
      MCLNet[26]ICCV 2165.493.397.162.072.697.099.276.6
      DSCNet[7]TIFS 2273.8996.2798.8469.4779.3598.3299.7782.65
      FMCNet[9]CVPR 2266.3--62.568.2--74.1
      PIC[27]TIP 2257.5--55.160.4--67.7
      PMT[28]AAAI 2367.5395.3698.6451.8671.6696.7399.2576.52
      MTMFE[29]PR2362.5693.8597.6360.5765.0695.1798.1773.86
      AGMNet[30]J-STSP2369.6396.2798.8266.1174.6897.5199.1478.30
      CSVI[31]IF2470.1396.1598.7965.3271.0096.9698.9975.21
      TMD[32]TMM2468.1893.0896.8463.9676.3197.2898.9174.52
      QFCNetOurs76.1297.2399.1471.5180.4398.7599.5883.61
    • Table 2. Comparison results on RegDB dataset/%

      View table
      View in Article

      Table 2. Comparison results on RegDB dataset/%

      MethodPublishSetting
      Visible to infraredInfrared to visible
      rank-1rank-10rank-20mAPrank-1rank-10rank-20mAP
      AlignGAN[23]ICCV1957.9--53.656.3--53.40
      D2RL[24]CVPR 1943.4066.1076.3044.10----
      X-Modality[15]AAAI 2062.2183.1391.7260.18----
      DDAG[8]ECCV 2069.3485.7789.9863.1964.7783.8588.9058.54
      Hi-CMD[9]CVPR 2070.986.4-66.0----
      JSIA-ReID[25]AAAI2048.1--48.948.5--49.3
      MPANet[5]CVPR 2183.7--80.982.8--80.7
      AGW[16]TPAMI 2170.0586.2191.5566.3770.4987.2191.8465.9
      CAJ[17]CVPR 2184.7295.1797.3878.7084.0994.7997.1177.25
      MCLNet[26]ICCV 2180.3192.7096.0373.0775.9390.9394.5969.49
      DSCNet[7]TIFS 2285.39--77.383.5--75.19
      FMCNet[9]CVPR 2289.12--84.4388.38--83.86
      PIC[27]TIP 2283.6--79.679.5--77.4
      PMT[28]PR2376.1088.8692.4174.3972.1887.0692.3871.04
      MTMFE[29]AAAI 2384.83--76.5584.16--75.13
      AGMNet[30]J-STSP2388.4095.1096.9481.4585.3494.5697.4881.19
      CSVI[31]IF2491.4197.7298.9285.1490.0697.4698.7483.86
      TMD[32]TMM2487.0495.4997.5781.1983.5494.5696.8477.92
      QFCNetOurs93.2897.9499.0488.8992.3597.7299.1488.10
    • Table 3. Ablation experiments on the SYSU-MM01 dataset/%

      View table
      View in Article

      Table 3. Ablation experiments on the SYSU-MM01 dataset/%

      SettingAll searchIndoor search
      QSFMSFCMrank-1rank-10rank-20mAPrank-1rank-10rank-20mAP
      47.5884.4592.1147.6954.2991.1495.9963.02
      73.2196.6098.9070.3579.6398.2099.6282.81
      72.9196.4699.0669.8479.8898.1799.4382.90
      76.1297.2399.1471.5180.4398.7599.5883.61
    • Table 4. Experimental results of SFCM insertion positions under SYSU-MM01 dataset/%

      View table
      View in Article

      Table 4. Experimental results of SFCM insertion positions under SYSU-MM01 dataset/%

      MethodSYSU-MM01
      rank-1mAP
      Baseline47.5847.69
      在stage0后插入SFCM70.3567.42
      在stage1后插入SFCM71.7567.66
      在stage2后插入SFCM72.6069.68
      在stage3后插入 SFCM72.9169.84
      在stage4后插入SFCM70.6568.78
    Tools

    Get Citation

    Copy Citation Text

    Bin Ge, Nuo Xu, Chenxing Xia, Haijun Zheng. Quadrupl-stream input-guided feature complementary visible-infrared person re-identification[J]. Opto-Electronic Engineering, 2024, 51(9): 240119-1

    Download Citation

    EndNote(RIS)BibTexPlain Text
    Save article for my favorites
    Paper Information

    Category: Article

    Received: May. 23, 2024

    Accepted: Aug. 18, 2024

    Published Online: Dec. 12, 2024

    The Author Email:

    DOI:10.12086/oee.2024.240119

    Topics