Acta Photonica Sinica, Volume. 50, Issue 9, 0910004(2021)

Infrared and Visible Image Fusion Method Based on Dual-path Cascade Adversarial Mechanism

Lili TANG1,2, Gang LIU1、*, and Gang XIAO2
Author Affiliations
  • 1College of Automation Engineering, Shanghai Electric Power University, Shanghai200090, China
  • 2College of Aeronautics and Astronautics Aerospace, Shanghai Jiao Tong University, Shanghai0040, China
  • show less

    The thermal target information of infrared image and some detail information of visible images are usually ignored in image fusion method based on generative adversarial network. To address the problem, an infrared and visible image fusion method based on dual-path cascade adversarial mechanism is proposed. In the stage of the generator model, a dual-path cascade is used to extract features of infrared and visible images, respectively. To improve the quality of fusion, structural similarity is introduced into the loss function. In the stage of the discriminator model, a dual discriminator is used to distinguish the generated image from the true natural visual images. The proposed method is experimented on the public data, and compared with eight state-of-the-art image fusion methods. The experimental results show that the fusion image not only retains more the target information of infrared images, but also retains more detail information of visible images, which is superior to state-of-the-art methods in subjective evaluation and objective assessment.

    Tools

    Get Citation

    Copy Citation Text

    Lili TANG, Gang LIU, Gang XIAO. Infrared and Visible Image Fusion Method Based on Dual-path Cascade Adversarial Mechanism[J]. Acta Photonica Sinica, 2021, 50(9): 0910004

    Download Citation

    EndNote(RIS)BibTexPlain Text
    Save article for my favorites
    Paper Information

    Category: Image Processing

    Received: Mar. 9, 2021

    Accepted: Apr. 15, 2021

    Published Online: Oct. 22, 2021

    The Author Email: LIU Gang (Liugang@shiep.edu.cn)

    DOI:10.3788/gzxb20215009.0910004

    Topics