Electronics Optics & Control, Volume. 31, Issue 8, 58(2024)

An Infrared and Visible Light Image Fusion Algorithm Based on GAN Lightweight Improvement

LU Xiaohan, LI Yang, TAI Yubo, XU Yu, and JIA Yaodong
Author Affiliations
  • [in Chinese]
  • show less

    Ordinary neural networks are difficult to generate infrared and visible light fusion images that conform to human vision,and the network model is complex and occupies too much memory.The existing Generative Adversarial Network (GAN) framework is improved.Firstly,deep convolution and point by point convolution are integrated into the generator,and a convolutional network with small convolution kernels is designed to reduce network parameters.Secondly,mask processing is applied to the source image to reduce the loss of source image information during feature extraction.Then,the processed image and the fused image obtained by the generator are jointly input into the discriminator to enhance the networks ability to retain source image information for visible light images.Finally,in the performance evaluation stage,the loss functions are set as gradient loss,adversarial loss,and content loss functions to constrain the fusion image to contain more background information of visible light images and target information of infrared images.The results of simulation experiments on the TNO image fusion dataset show that the proposed algorithm can obtain fused images with rich details and clear targets while reducing network complexity and operational parameters.

    Tools

    Get Citation

    Copy Citation Text

    LU Xiaohan, LI Yang, TAI Yubo, XU Yu, JIA Yaodong. An Infrared and Visible Light Image Fusion Algorithm Based on GAN Lightweight Improvement[J]. Electronics Optics & Control, 2024, 31(8): 58

    Download Citation

    EndNote(RIS)BibTexPlain Text
    Save article for my favorites
    Paper Information

    Received: Aug. 24, 2023

    Accepted: --

    Published Online: Oct. 22, 2024

    The Author Email:

    DOI:10.3969/j.issn.1671-637x.2024.08.009

    Topics