Infrared Technology, Volume. 43, Issue 6, 566(2021)

A Visible and Infrared Image Fusion Method based on Generative Adversarial Networks and Attention Mechanism

Di LUO1,2, Congqing WANG1,2, and Yongjun ZHOU2、*
Author Affiliations
  • 1[in Chinese]
  • 2[in Chinese]
  • show less

    A new fusion method for visible and infrared images based on generative adversarial networks is proposed to solve the problem of recognizing targets in low-light images; the method can be directly applied to the fusion of RGB three-channel visible images and infrared images. In generative adversarial networks, the generator adopts a U-Net structure with encoding and decoding layers. The discriminator adopts a Markovian discriminator, and the attention mechanism is introduced to force the fused image to pay more attention to the high-intensity information on infrared images. The experimental results show that the proposed method not only maintains the detailed texture information of visible images but also introduces the main target information of infrared images to generate fusion images with good visual effects and high target identification, and it performs well in information entropy, structural similarity, and other objective indexes.

    Tools

    Get Citation

    Copy Citation Text

    LUO Di, WANG Congqing, ZHOU Yongjun. A Visible and Infrared Image Fusion Method based on Generative Adversarial Networks and Attention Mechanism[J]. Infrared Technology, 2021, 43(6): 566

    Download Citation

    EndNote(RIS)BibTexPlain Text
    Save article for my favorites
    Paper Information

    Category:

    Received: Sep. 8, 2020

    Accepted: --

    Published Online: Aug. 26, 2021

    The Author Email: Yongjun ZHOU (478992155@qq.com)

    DOI:

    Topics