Chinese Optics, Volume. 15, Issue 4, 675(2022)

Fusion of infrared and visible light images based on visual saliency weighting and maximum gradient singular value

Bo-yang CHENG*, Ting LI, and Yu-lin WANG
Author Affiliations
  • Institute of Remote Sensing Satellite, China Academy of Space Technology, Beijing 100094, China
  • show less
    References(40)

    [1] CHEN Q J, ZHANG Y B, CHAI Y ZH, . Fusion of infrared and visible images based on finite discrete shearlet domain[J]. Chinese Optics, 9, 523-531(2016).

    [2] WANG CH, ZHANG Y CH. Night image enhancement based on pixel level adaptive image fusion[J]. Chinese Journal of Liquid Crystals and Displays, 34, 888-896(2019).

    [3] CHEN G Q, GAO Y H, CAI H, . Image fusion algorithm based on local NSST and PCNN[J]. Chinese Journal of Liquid Crystals and Display, 30, 701-712(2015).

    [4] CHEN G Q, CHEN Y C, LI J Y, . Infrared and visible image fusion based on discrete nonseparable shearlet transform and convolutional sparse representation[J]. Journal of Jilin University (Engineering and Technology Edition), 51, 996-1010(2021).

    [5] PRAKASH O, PARK C M, KHARE A, et al. Multiscale fusion of multimodal medical images using lifting scheme based biorthogonal wavelet transform[J]. Optik, 182, 995-1014(2019).

    [6] TAO T W, LIU M X, HOU Y K, et al. Latent low-rank representation with sparse consistency constraint for infrared and visible image fusion[J]. Optik, 261, 169102(2022).

    [7] LIU Y Y, HE K J, XU D, et al. Infrared and visible image fusion based on visibility enhancement and hybrid multiscale decomposition[J]. Optik, 258, 168914(2022).

    [8] ANOOP SURAJ A, FRANCIS M, KAVYA T S, et al. Discrete wavelet transform based image fusion and de-noising in FPGA[J]. Journal of Electrical Systems and Information Technology, 1, 72-81(2014).

    [9] DONOHO D L, DUNCAN M R. Digital curvelet transform: strategy, implementation, and experiments[J]. Proceedings of SPIE, 4056, 12-30(2000).

    [10] CUNHA A L D, ZHOU J, DO M N. The nonsubsampled contourlet transform: theory, design, and applications[J]. IEEE Transactions on Image Processing, 15, 3089-3101(2006).

    [11] GUO K H, LABATE D. Optimally sparse multidimensional representation using shearlets[J]. SIAM Journal on Mathematical Analysis, 39, 298-318(2007).

    [12] KONG W W, MIAO Q G, LEI Y, et al. Guided filter random walk and improved spiking cortical model based image fusion method in NSST domain[J]. Neurocomputing, 488, 509-527(2022).

    [13] CHEN G Q, LIANG X W, DUAN J, . Multistage directional guided filter and its application in multi-sensor image fusion[J]. Journal of Jilin University (Science Edition), 57, 129-138(2019).

    [14] [14] ZHANG Q, SHEN X Y, XU L, et al.. Rolling guidance filter[C]. Proceedings of the 13th European Conference on Computer Vision, Springer, 2014: 815830.

    [15] [15] CHENG B Y. Research on fusion of infrared visible light image based on rolling guidance shearlet transfm[D]. Changchun: Changchun Institute of Optics, Fine Mechanics Physics, Chinese Academy of Sciences, 2020.

    [16] GUO ZH Y, YU X T, DU Q L. Infrared and visible image fusion based on saliency and fast guided filtering[J]. Infrared Physics & Technology, 123, 104178(2022).

    [17] LI W SH, LI R Y, FU J, et al. MSENet: a multi-scale enhanced network based on unique features guidance for medical image fusion[J]. Biomedical Signal Processing and Control, 74, 103534(2022).

    [18] CHAO ZH, DUAN X G, JIA SH F, et al. Medical image fusion via discrete stationary wavelet transform and an enhanced radial basis function neural network[J]. Applied Soft Computing, 118, 108542(2022).

    [19] [19] GUO Y N, LI X, GAO A, et al.. A scaleaware pansharpening method with rolling guidance filter[C]. Proceedings of 2017 IEEE International Geoscience Remote Sensing Symposium, IEEE, 2017: 51215124.

    [20] LIU B, HAN G L, LUO H Y. Image fusion algorithm based on multi-scale detail Siamese convolutional neural network[J]. Chinese Journal of Liquid Crystals and Displays, 36, 1283-1293(2021).

    [21] XIANG I B, YU Z, FU G Z. Quadtree-based multi-focus image fusion using a weighted focus-measure[J]. Inform. Fusion, 22, 105-118(2015).

    [22] JOSE J, GAUTAM N, TIWARI M, et al. An image quality enhancement scheme employing adolescent identity search algorithm in the NSST domain for multimodal medical image fusion[J]. Biomedical Signal Processing and Control, 66, 102480(2021).

    [23] [23] ACHANTA R, HEMAMI S, ESTRADA F, et al. . Frequencytuned salient region detection[C]. Proceedings of 2009 IEEE Conference on Computer Vision Pattern Recognition, IEEE, 2009: 15971604.

    [24] CHENG B Y, JIN L X, LI G N. Adaptive fusion framework of infrared and visual image using saliency detection and improved dual-channel PCNN in the LNSST domain[J]. Infrared Physics & Technology, 79, 30-43(2018).

    [25] CHENG B Y, JIN L X, LI G N. Infrared and visual image fusion using LNSST and an adaptive dual-channel PCNN with triple-linking strength[J]. Neurocomputing, 310, 135-147(2018).

    [26] CHEN G Q, GAO Y H, DUAN J, . Fusion algorithm of infrared and visible images based on singular value decomposition and PCNN[J]. Chinese Journal of Liquid Crystals and Displays, 30, 126-136(2015).

    [27] NENCINI F, GARZELLI A, BARONTI S, et al. Remote sensing image fusion using the curvelet transform[J]. Information Fusion, 8, 143-156(2007).

    [28] LIU Y, LIU SH P, WANG Z F. A general framework for image fusion based on multi-scale transform and sparse representation[J]. Information Fusion, 24, 147-164(2015).

    [29] BAVIRISETTI D P, DHULI R. Fusion of infrared and visible sensor images based on anisotropic diffusion and karhunen-loeve transform[J]. IEEE Sensors Journal, 16, 203-209(2016).

    [30] JIN L M, ZHI Q Z, BO W. Infrared and visible image fusion based on visual saliency map and weighted least square optimization[J]. Infrared Physics & Technology, 82, 8-17(2017).

    [31] NAIDU V P S. Image fusion technique using multi-resolution singular value decomposition[J]. Defence Science Journal, 61, 479-484(2011).

    [32] BAVIRISETTI D P, DHULI R. Two-scale image fusion of visible and infrared images using saliency detection[J]. Infrared Physics & Technology, 76, 52-64(2016).

    [33] D. P. B, R. D. Two-scale image fusion of visible and infrared images using saliency detection[J]. Infrared Physics & Technology, 76, 52-64(2016).

    [34] LIN Y C, CAO D X, ZHOU X C. Adaptive infrared and visible image fusion method by using rolling guidance filter and saliency detection[J]. Optik, 262, 169218(2022).

    [35] ZHE L, YU Q S, VICTOR S. MRI and PET image fusion using the nonparametric density model and the theory of variable-weight[J]. Computer Methods and Programs in Biomedicine, 175, 73-82(2019).

    [36] BAI X ZH, ZHANG Y, ZHOU F G, et al. Quadtree-based multi-focus image fusion using a weighted focus-measure[J]. Information Fusion, 22, 105-118(2015).

    [37] FARID M S, MAHMOOD A, AL-MAADEED S A. Multi-focus image fusion using Content Adaptive Blurring[J]. Information Fusion, 45, 96-112(2019).

    [38] YIN M, DUAN P H, LIU W, et al. A novel infrared and visible image fusion algorithm based on shift-invariant dual-tree complex shearlet transform and sparse representation[J]. Neurocomputing, 226, 182-191(2017).

    [39] [39] KONG X Y, LIU L, QIAN Y SH, et al. . Infrared visible image fusion using structuretransferring fusion method[J]. Infrared Physics & Technology, 2019, 98: 161173. ASLANTAS V, BENDES E. A new image quality metric f image fusion: the sum of the crelations of differences[J]. AEU International Journal of Electronics Communications, 2015, 69(12): 18901896.

    [40] ASLANTAS V, BENDES E. A new image quality metric for image fusion: the sum of the correlations of differences[J]. AEU - International Journal of Electronics and Communications, 69, 1890-1896(2015).

    CLP Journals

    [1] Jing DI, Chan LIANG, Ji-zhao LIU, Jing LIAN. Infrared and visible image fusion guided by cross-domain interactive attention and contrastive learning[J]. Chinese Optics, 2025, 18(2): 317

    [2] De-min ZHAO, Yang SUN, Zai-ping LIN, Wei XIONG. Infrared small target detection via L1−2 spatial-temporal total variation regularization[J]. Chinese Optics, 2023, 16(5): 1066

    Tools

    Get Citation

    Copy Citation Text

    Bo-yang CHENG, Ting LI, Yu-lin WANG. Fusion of infrared and visible light images based on visual saliency weighting and maximum gradient singular value[J]. Chinese Optics, 2022, 15(4): 675

    Download Citation

    EndNote(RIS)BibTexPlain Text
    Save article for my favorites
    Paper Information

    Category: Original Article

    Received: Jun. 13, 2022

    Accepted: --

    Published Online: Sep. 6, 2022

    The Author Email:

    DOI:10.37188/CO.2022-0124

    Topics