Journal of Applied Optics, Volume. 45, Issue 1, 107(2024)

Saliency-based dual discriminator GAN image fusion algorithm

Yibo XIE, Weiguo LIU*, Shun ZHOU, and Menghan LI
Author Affiliations
  • School of Photoelectric Engineering, Xi'an Technological University, Xi'an 710021, China
  • show less
    References(27)

    [1] LI H, WU X J, KITTLER J. Infrared and visible image fusion using a deep learning framework[C](2018).

    [3] LIU Y, LIU S P, WANG Z F. A general framework for image fusion based on multi-scale transform and sparse representation[J]. Information Fusion, 24, 147-164(2015).

    [4] YANG B, LI S T. Multifocus image fusion and restoration with sparse representation[J]. IEEE Transactions on Instrumentation & Measurement, 59, 884-892(2010).

    [5] HARSANYI J C, CHANG C I. Hyperspectral image classification and dimensionality reduction: an orthogonal subspace projection approach[J]. IEEE Transactions on Geoscience and Remote Sensing, 32, 779-785(1994).

    [6] HAN J G, PAUWELS E J, ZEEUW P D. Fast saliency-aware multi-modality image fusion[J]. Neurocomputing, 111, 70-80(2013).

    [7] MA J Y, CHEN C, LI C et al. Infrared and visible image fusion via gradient transfer and total variation minimization[J]. Information Fusion, 31, 100-109(2016).

    [9] LI H, WU X J. DenseFuse: a fusion approach to infrared and visible images[J]. IEEE Transactions on Image Processing, 28, 2614-2623(2018).

    [10] MA J Y, TANG L F, XU M L et al. STDFusionNet: an infrared and visible image fusion network based on salient target detection[J]. IEEE Transactions on Instrumentation and Measurement, 70, 1-13(2021).

    [11] LI J, HUO H T, LI C et al. Multi-grained attention network for infrared and visible image fusion[J]. IEEE Transactions on Instrumentation and Measurement, 70, 1-12(2020).

    [12] HUANG W, XIAO L, WEI Z et al. A new pan-sharpening method with deep neural networks[J]. IEEE Geoscience and Remote Sensing Letters, 12, 1037-1041(2015).

    [13] MA J Y, WEI Y, LIANG P W et al. FusionGAN: a generative adversarial network for infrared and visible image fusion[J]. Information Fusion, 48, 11-26(2019).

    [14] MA J Y, XU H, JIANG J J et al. DDcGAN: a dual-discriminator conditional generative adversarial network for multi-resolution image fusion[J]. IEEE Transactions on Image Processing, 29, 4980-4995(2020).

    [15] HOU J L, ZHANG D Z, WU W et al. A generative adversarial network for infrared and visible image fusion based on semantic segmentation[J]. Entropy, 23, 376(2021).

    [16] GOODFELLOW I, POUGET-ABADIE J, MIRZA M et al. Generative adversarial nets[C](2014).

    [17] HUO Xing, ZOU Yun, CHEN Ying et al. Dual-scale decomposition and saliency analysis based infrared and visible image fusion[J]. Journal of Image and Graphics, 26, 13(2021).

    [18] XIE Yibo. Image processing and system research of distributed aperture imaging array[D](2022).

    [19] WANG Ying, YU Lanxu, WANG Chunxi et al. Remote sensing image fusion algorithm based on improved IHS, PCA and wavelet transform[J]. Computer & Digital Engineering, 49, 797-803(2021).

    [20] LU Yue. Research on image super-resolution algorithm based on Laplacian pyramid structure[D](2020).

    [21] SHAO Tingting, BAI Zongwen, ZHOU Meili. Decomposition and reconstruction of signal based on DWT[J]. Computer Technology and Development, 24, 159-161(2014).

    [22] BAVIRISETTI D P, DHULI R. Two-scale image fusion of visible and infrared images using saliency detection[J]. Infrared physics and technology, 76, 52-64(2016).

    [23] MA J Y, ZHANG H, SHAO Z F et al. GANMcC: a generative adversarial network with multiclassification constraints for infrared and visible image fusion[J]. IEEE Transactions on Instrumentation and Measurement, 70, 1-1(2020).

    [24] XIE Yibo, XU Naitao, ZHOU Shun et al. Research on super-resolution image reconstruction of distributed infrared array camera[J]. Laser & Optoelectronics Progress, 59, 254-261(2022).

    [25] LIU Z, SONG Y Q, SHENG V S et al. MRI and PET image fusion using the nonparametric density model and the theory of variable-weight[J]. Computer Methods & Programs in Biomedicine, 175, 73-82(2019).

    [26] DI Jing, WANG Guodong, MA Shuai et al. Infrared and visible image fusion based on MSPCNN and FCM[J]. Infrared Technology, 45, 69-76(2023).

    [27] ZHANG Xiaoli, LI Xiongfei, LI Jun. Validation and correlation analysis of metrics for evaluating performance of image fusion[J]. Acta Automatica Sinica, 40, 306-315(2014).

    Tools

    Get Citation

    Copy Citation Text

    Yibo XIE, Weiguo LIU, Shun ZHOU, Menghan LI. Saliency-based dual discriminator GAN image fusion algorithm[J]. Journal of Applied Optics, 2024, 45(1): 107

    Download Citation

    EndNote(RIS)BibTexPlain Text
    Save article for my favorites
    Paper Information

    Category: Research Articles

    Received: Apr. 3, 2023

    Accepted: --

    Published Online: May. 28, 2024

    The Author Email: Weiguo LIU (刘卫国(1964—))

    DOI:10.5768/JAO202445.0102005

    Topics