Laser & Optoelectronics Progress, Volume. 61, Issue 10, 1037008(2024)

Infrared and Visible Image Fusion Based on Saliency Adaptive Weight Map

Haiyang Ding1,2, Mingli Dong1,2,3、*, Chenhua Liu1,2,3, Xitian Lu1,2,3, and Chentong Guo1,2,3
Author Affiliations
  • 1Key Laboratory of Optoelectronic Measurement Technology and Instrument, Ministry of Education, School of Instrument Science and Opto-Electronics Engineering, Beijing Information Science & Technology University, Beijing 100192, China
  • 2Beijing Laboratory of Optical Fiber Sensing and System, Beijing Information Science & Technology University, Beijing 100016, China
  • 3Guangzhou Nansha Intelligent Photonic Sensing Research Institute, Guangzhou 511462, Guangdong , China
  • show less
    References(26)

    [1] Kavita P, Alli D R, Rao A B. Study of image fusion optimization techniques for medical applications[J]. International Journal of Cognitive Computing in Engineering, 3, 136-143(2022).

    [2] Pajares G, de la Manuel Cruz J. A wavelet-based image fusion tutorial[J]. Pattern Recognition, 37, 1855-1872(2004).

    [3] Jiang M, Sha G J, Li N. Infrared and visible image fusion with guided filtering and dual-tree complex wavelet transform[J]. Laser & Optoelectronics Progress, 60, 1010008(2023).

    [4] Farbman Z, Fattal R, Lischinski D et al. Edge-preserving decompositions for multi-scale tone and detail manipulation[J]. ACM Transactions on Graphics, 27, 1-10.

    [5] Petschnigg G, Szeliski R, Agrawala M et al. Digital photography with flash and no-flash image pairs[J]. ACM Transactions on Graphics, 23, 664-672.

    [6] Shreyamsha Kumar B K. Image fusion based on pixel significance using cross bilateral filter[J]. Signal, Image and Video Processing, 9, 1193-1204(2015).

    [7] Zhang Q, Shen X Y, Xu L, Fleet D, Pajdla T, Schiele B et al. Rolling guidance filter[M]. Computer vision–ECCV 2014, 8691, 815-830(2014).

    [8] Ma J L, Zhou Z Q, Wang B et al. Infrared and visible image fusion based on visual saliency map and weighted least square optimization[J]. Infrared Physics & Technology, 82, 8-17(2017).

    [9] Naidu A R, Bhavana D, Revanth P et al. Fusion of visible and infrared images via saliency detection using two-scale image decomposition[J]. International Journal of Speech Technology, 23, 815-824(2020).

    [10] Bavirisetti D P, Dhuli R. Fusion of infrared and visible sensor images based on anisotropic diffusion and Karhunen-Loeve transform[J]. IEEE Sensors Journal, 16, 203-209(2016).

    [11] Pei P P, Yang Y C, Dang J W et al. Infrared and visible light image fusion method based on rolling guidance filter and convolution sparse representation[J]. Laser & Optoelectronics Progress, 59, 1210001(2022).

    [12] Lin Y C, Cao D X, Zhou X C. Adaptive infrared and visible image fusion method by using rolling guidance filter and saliency detection[J]. Optik, 262, 169218(2022).

    [13] Liang J M, Yang S, Tian L F. Infrared and visible image fusion based on image enhancement and rolling guidance filtering[J]. Laser & Optoelectronics Progress, 60, 0210006(2023).

    [14] Lindeberg T. Scale-space theory: a basic tool for analyzing structures at different scales[J]. Journal of Applied Statistics, 21, 225-270(1994).

    [15] Jiang Y, Wang M H. Image fusion using multiscale edge-preserving decomposition based on weighted least squares filter[J]. IET Image Processing, 8, 183-190(2014).

    [16] Zhai Y, Shah M. Visual attention detection in video sequences using spatiotemporal cues[C], 815-824(2006).

    [17] Rao Y J. In-fibre Bragg grating sensors[J]. Measurement Science and Technology, 8, 355-375(1997).

    [18] Rajkumar S, Mouli P V S S R C, Satapathy S C, Avadhani P S, Udgata S K et al. Infrared and visible image fusion using entropy and neuro-fuzzy concepts[M]. ICT and Critical Infrastructure: proceedings of the 48th annual convention of computer society of India-Vol I, 248, 93-100(2014).

    [19] Sheikh H R, Bovik A C. Image information and visual quality[J]. IEEE Transactions on image processing, 15, 430-444(2006).

    [20] Jin H Y, Jiao L C, Liu F et al. Fusion of infrared and visual images based on contrast pyramid directional filter banks using clonal selection optimizing[J]. Optical Engineering, 47, 027002(2008).

    [21] Aslantas V, Bendes E. A new image quality metric for image fusion: the sum of the correlations of differences[J]. AEU-International Journal of Electronics and Communications, 69, 1890-1896(2015).

    [22] Roberts J W, van Aardt J A, Ahmed F B. Assessment of image fusion procedures using entropy, image quality, and multispectral classification[J]. Journal of Applied Remote Sensing, 2, 023522(2008).

    [23] Eskicioglu A M, Fisher P S. Image quality measures and their performance[J]. IEEE Transactions on Communications, 43, 2959-2965(1995).

    [24] Bavirisetti D P, Xiao G, Liu G. Multi-sensor image fusion based on fourth order partial differential equations[C](2017).

    [25] Liu J Y, Fan X, Huang Z B et al. Target-aware dual adversarial learning and a multi-scenario multi-modality benchmark to fuse infrared and visible for object detection[C], 5792-5801(2022).

    [26] Zhang Y, Zhang L J, Bai X Z et al. Infrared and visual image fusion through infrared feature extraction and visual information preservation[J]. Infrared Physics & Technology, 83, 227-237(2017).

    Tools

    Get Citation

    Copy Citation Text

    Haiyang Ding, Mingli Dong, Chenhua Liu, Xitian Lu, Chentong Guo. Infrared and Visible Image Fusion Based on Saliency Adaptive Weight Map[J]. Laser & Optoelectronics Progress, 2024, 61(10): 1037008

    Download Citation

    EndNote(RIS)BibTexPlain Text
    Save article for my favorites
    Paper Information

    Category: Digital Image Processing

    Received: Aug. 24, 2023

    Accepted: Oct. 9, 2023

    Published Online: Apr. 29, 2024

    The Author Email: Mingli Dong (dongml@bistu.edu.cn)

    DOI:10.3788/LOP231977

    CSTR:32186.14.LOP231977

    Topics