Laser & Optoelectronics Progress, Volume. 60, Issue 14, 1410018(2023)

Infrared and Visible Image Fusion Based on Adaptive Feature Enhancement and Generator Path Interaction

Yejun Yang1, Gang Liu1、*, Gang Xiao2, and Xinjie Gu1
Author Affiliations
  • 1School of Automation Engineering, Shanghai University of Electric Power, Shanghai 200090, China
  • 2School of Aeronautics and Astronautics, Shanghai Jiao Tong University, Shanghai 200240, China
  • show less

    For infrared and visible image fusion based on generation countermeasure networks, a deep fusion method based on adaptive feature enhancement and generator path interaction is proposed to solve problems, such as edge blurring between different objects in the fusion result, insufficient extraction of source image information, and imbalance of fusion information. First, the adaptive enhancement block sharpens the edge information of different objects in the source image according to the weight map. After the adaptive feature enhancement loss, intensity loss, and gradient loss are jointly constrained, the contrast and texture details of the fused image can be enhanced simultaneously. Second, the generator path interaction structure can fully extract the source image information by adding an interactive convolution layer between the two main paths, and the transmission of the feature map can be enhanced using a densely connected convolution network. In addition, a content loss function, designed based on the primary, secondary, and dual discriminator introduced in the network structure, ensures the balance between contrast and texture details in the fusion results. Experimental results show that the proposed method has very competitive results in both subjective visual and objective quantitative evaluations and is faster than the other methods.

    Tools

    Get Citation

    Copy Citation Text

    Yejun Yang, Gang Liu, Gang Xiao, Xinjie Gu. Infrared and Visible Image Fusion Based on Adaptive Feature Enhancement and Generator Path Interaction[J]. Laser & Optoelectronics Progress, 2023, 60(14): 1410018

    Download Citation

    EndNote(RIS)BibTexPlain Text
    Save article for my favorites
    Paper Information

    Category: Image Processing

    Received: Aug. 2, 2022

    Accepted: Sep. 27, 2022

    Published Online: Jul. 25, 2023

    The Author Email: Liu Gang (liugang@shiep.edu.cn)

    DOI:10.3788/LOP222204

    Topics