Infrared and Laser Engineering, Volume. 51, Issue 4, 20210291(2022)

Infrared and visible image fusion using improved generative adversarial networks

Li Min1, Sijian Cao1, Huaici Zhao2、*, and Pengfei Liu2
Author Affiliations
  • 1School of Mechanical Engineering, Shenyang Jianzhu University, Shenyang 110168, China
  • 2Key Laboratory of Optical-Electronics Information Processing, Shenyang Institute of Automation, Chinese Academy of Sciences, Shenyang 110169, China
  • show less
    Figures & Tables(8)
    Overall framework of network structure
    Generator network structure
    Discriminator network structure
    Comparative experimental results of the TNO dataset
    Comparative experimental results of the RoadScene dataset. (a) Infrared image;(b) Visible image;(c) DRTV;(d) CNN;(e) FusionGAN;(f) DIDFuse;(g) DDcGAN;(h) Proposed method
    Loss function curve
    • Table 1. Objective evaluation results of two comparison experiment

      View table
      View in Article

      Table 1. Objective evaluation results of two comparison experiment

      DatasetMethodsAGSF${Q^{AB/F}}$${Q_{CB}}$
      TNODRTV3.7619.6390.3190.411
      CNN4.70011.4890.3320.463
      FusionGAN4.01410.0060.3130.425
      DIDFuse4.64411.7710.3950.472
      DDcGAN5.52913.0440.3560.456
      Proposed method5.86114.4540.4010.504
      Road sceneDRTV3.2218.6960.3680.384
      CNN4.48410.5360.3980.384
      FusionGAN3.2908.4260.2780.387
      DIDFuse5.25314.1490.4690.452
      DDcGAN5.20013.5800.4230.461
      Proposed method5.85515.2430.4800.494
    • Table 2. Evaluation results of ablation experiment

      View table
      View in Article

      Table 2. Evaluation results of ablation experiment

      MethodsAGSF${Q^{AB/F}}$${Q_{CB}}$
      DDcGAN5.52913.0440.3560.456
      DDcGAN+SN5.67013.0620.3680.469
      DDcGAN+GSFB5.74613.8410.3880.484
      DDcGAN+GSFB+SN5.86114.4540.4010.504
    Tools

    Get Citation

    Copy Citation Text

    Li Min, Sijian Cao, Huaici Zhao, Pengfei Liu. Infrared and visible image fusion using improved generative adversarial networks[J]. Infrared and Laser Engineering, 2022, 51(4): 20210291

    Download Citation

    EndNote(RIS)BibTexPlain Text
    Save article for my favorites
    Paper Information

    Category: Image processing

    Received: May. 2, 2021

    Accepted: --

    Published Online: May. 18, 2022

    The Author Email: Zhao Huaici (hczhao@sia.cn)

    DOI:10.3788/IRLA20210291

    Topics