Laser & Optoelectronics Progress, Volume. 60, Issue 14, 1410018(2023)

Infrared and Visible Image Fusion Based on Adaptive Feature Enhancement and Generator Path Interaction

Yejun Yang1, Gang Liu1、*, Gang Xiao2, and Xinjie Gu1
Author Affiliations
  • 1School of Automation Engineering, Shanghai University of Electric Power, Shanghai 200090, China
  • 2School of Aeronautics and Astronautics, Shanghai Jiao Tong University, Shanghai 200240, China
  • show less
    References(34)

    [1] Piella G. A general framework for multiresolution image fusion: from pixels to regions[J]. Information Fusion, 4, 259-280(2003).

    [2] Zhang Y, Zhu G Y, Shi T J et al. Small object detection in remote sensing images based on feature fusion and attention[J]. Acta Optica Sinica, 42, 2415001(2022).

    [3] He Z F, Chen G C, Chen J S et al. Multi-scale feature fusion lightweight real-time infrared pedestrian detection at night[J]. Chinese Journal of Lasers, 49, 1709002(2022).

    [4] Wang L, Fang Y, Wang S C et al. Line-structured light imaging method of rail profile based on polarization fusion[J]. Acta Optica Sinica, 40, 2211001(2020).

    [5] Li S T, Kang X D, Fang L Y et al. Pixel-level image fusion: a survey of the state of the art[J]. Information Fusion, 33, 100-112(2017).

    [6] Xiao W X, Li H F, Zhang Y F et al. Medical image fusion based on multi-scale feature learning and edge enhancement[J]. Laser & Optoelectronics Progress, 59, 0617029(2022).

    [7] Chen J, Li X J, Luo L B et al. Infrared and visible image fusion based on target-enhanced multiscale transform decomposition[J]. Information Sciences, 508, 64-78(2020).

    [8] Yang Y, Zhang Y M, Huang S Y et al. Infrared and visible image fusion using visual saliency sparse representation and detail injection model[J]. IEEE Transactions on Instrumentation and Measurement, 70, 5001715(2021).

    [9] Pei P P, Yang Y C, Dang J W et al. Infrared and visible image fusion method based on rolling guidance filter and convolution sparse representation[J]. Laser & Optoelectronics Progress, 59, 1210001(2022).

    [10] Zhang L B, Zhang J. A new adaptive fusion method based on saliency analysis for remote sensing images[J]. Chinese Journal of Lasers, 42, 0114001(2015).

    [11] Wang Z S, Xu J W, Jiang X L et al. Infrared and visible image fusion via hybrid decomposition of NSCT and morphological sequential toggle operator[J]. Optik, 201, 163497(2020).

    [12] Paramanandham N, Rajendiran K. Multi sensor image fusion for surveillance applications using hybrid image fusion algorithm[J]. Multimedia Tools and Applications, 77, 12405-12436(2018).

    [13] Xu H, Ma J Y, Jiang J J et al. U2Fusion: a unified unsupervised image fusion network[J]. IEEE Transactions on Pattern Analysis and Machine Intelligence, 44, 502-518(2022).

    [14] Zhang H, Ma J Y. SDNet: a versatile squeeze-and-decomposition network for real-time image fusion[J]. International Journal of Computer Vision, 129, 2761-2785(2021).

    [15] Chen G Y, Wu X J, Xu T Y. Unsupervised infrared image and visible image fusion algorithm based on deep learning[J]. Laser & Optoelectronics Progress, 59, 0410010(2022).

    [16] Li H, Wu X J. DenseFuse: a fusion approach to infrared and visible images[J]. IEEE Transactions on Image Processing, 28, 2614-2623(2019).

    [17] Zhang Y, Liu Y, Sun P et al. IFCNN: a general image fusion framework based on convolutional neural network[J]. Information Fusion, 54, 99-118(2020).

    [18] Ma J Y, Yu W, Liang P W et al. FusionGAN: a generative adversarial network for infrared and visible image fusion[J]. Information Fusion, 48, 11-26(2019).

    [19] Ma J, Xu H, Jiang J et al. DDcGAN: a dual-discriminator conditional generative adversarial network for multi-resolution image fusion[J]. IEEE Transactions on Image Processing, 29, 4980-4995(2020).

    [20] Ma J Y, Zhang H, Shao Z F et al. GANMcC: a generative adversarial network with multiclassification constraints for infrared and visible image fusion[J]. IEEE Transactions on Instrumentation and Measurement, 70, 1-14(2021).

    [21] Zhang H, Le Z L, Shao Z F et al. MFF-GAN: an unsupervised generative adversarial network with adaptive and gradient joint constraints for multi-focus image fusion[J]. Information Fusion, 66, 40-53(2021).

    [22] Huang G, Liu Z, van der Maaten L et al. Densely connected convolutional networks[C], 2261-2269(2017).

    [25] Roberts J W, van Aardt J A, Ahmed F B. Assessment of image fusion procedures using entropy, image quality, and multispectral classification[J]. Journal of Applied Remote Sensing, 2, 023522(2008).

    [26] Han Y, Cai Y Z, Cao Y et al. A new image fusion performance metric based on visual information fidelity[J]. Information Fusion, 14, 127-135(2013).

    [27] Deshmukh M, Bhosale U. Image fusion and image quality assessment of fused images[J]. International Journal of Image Processing (IJIP), 4, 484-508(2010).

    [28] Aslantas V, Bendes E. A new image quality metric for image fusion: the sum of the correlations of differences[J]. AEU-International Journal of Electronics and Communications, 69, 1890-1896(2015).

    [29] Wang Z, Simoncelli E P, Bovik A C. Multiscale structural similarity for image quality assessment[C], 1398-1402(2003).

    [30] Haghighat M, Razian M A. Fast-FMI: Non-reference image fusion metric[C](2014).

    [31] Li H, Wu X J, Kittler J. MDLatLRR: a novel decomposition method for infrared and visible image fusion[J]. IEEE Transactions on Image Processing, 29, 4733-4746(2020).

    [32] Bavirisetti D P, Xiao G, Liu G. Multi-sensor image fusion based on fourth order partial differential equations[C](2017).

    [34] Ma J Y, Chen C, Li C et al. Infrared and visible image fusion via gradient transfer and total variation minimization[J]. Information Fusion, 31, 100-109(2016).

    Tools

    Get Citation

    Copy Citation Text

    Yejun Yang, Gang Liu, Gang Xiao, Xinjie Gu. Infrared and Visible Image Fusion Based on Adaptive Feature Enhancement and Generator Path Interaction[J]. Laser & Optoelectronics Progress, 2023, 60(14): 1410018

    Download Citation

    EndNote(RIS)BibTexPlain Text
    Save article for my favorites
    Paper Information

    Category: Image Processing

    Received: Aug. 2, 2022

    Accepted: Sep. 27, 2022

    Published Online: Jul. 25, 2023

    The Author Email: Liu Gang (liugang@shiep.edu.cn)

    DOI:10.3788/LOP222204

    Topics