Laser & Optoelectronics Progress, Volume. 60, Issue 14, 1410005(2023)

Infrared and Visible Image Fusion Based on Contrast and Structure Extraction

Jiawen Song, Daming Zhu*, Zhitao Fu, and Sijing Chen
Author Affiliations
  • Faculty of Land Resources Engineering, Kunming University of Science and Technology, Kunming 650031, Yunnan, China
  • show less
    References(30)

    [1] Ma J Y, Ma Y, Li C. Infrared and visible image fusion methods and applications: a survey[J]. Information Fusion, 45, 153-178(2019).

    [2] Li H, Qi X B, Xie W Y. Fast infrared and visible image fusion with structural decomposition[J]. Knowledge-Based Systems, 204, 106182(2020).

    [3] Zhou Z Q, Wang B, Li S et al. Perceptual fusion of infrared and visible images through a hybrid multi-scale decomposition with Gaussian and bilateral filters[J]. Information Fusion, 30, 15-26(2016).

    [4] Lahmyed R, Ansari M E, Ellahyani A. A new thermal infrared and visible spectrum images-based pedestrian detection system[J]. Multimedia Tools and Applications, 78, 15861-15885(2019).

    [5] Ariffin S M Z, Jamil N, Rahman P N M A. Can thermal and visible image fusion improve ear recognition?[C], 780-784(2017).

    [6] Kansal K, Subramanyam A V, Wang Z et al. SDL: spectrum-disentangled representation learning for visible-infrared person re-identification[J]. IEEE Transactions on Circuits and Systems for Video Technology, 30, 3422-3432(2020).

    [7] Yang Y C, Pei P P, Dang J W et al. Infrared and visible image fusion based on an alternating gradient filter and improved PCNN[J]. Optics and Precision Engineering, 30, 1123-1138(2022).

    [8] Jin H Y, Jiao L C, Liu F et al. The fusion of infrared and visual images based on contrast pyramid directional filter banks using clonal selection optimising[J]. Optical Engineering, 47, 027002(2008).

    [9] Chen J, Li X J, Luo L B et al. Infrared and visible image fusion based on target-enhanced multiscale transform decomposition[J]. Information Sciences, 508, 64-78(2020).

    [10] Toet A, van Ruyven L J, Valeton J M. Merging thermal and visual images by a contrast pyramid[J]. Optical Engineering, 28, 789-792(1989).

    [11] Madheswari K, Venkateswaran N. Swarm intelligence based optimisation in thermal image fusion using dual tree discrete wavelet transform[J]. Quantitative InfraRed Thermography Journal, 14, 24-43(2017).

    [12] Fu Z Z, Wang X, Li X F et al. Infrared and visible image fusion based on visual saliency and NSCT[J]. Journal of University of Electronic Science and Technology of China, 46, 357-362(2017).

    [13] Lin J P, Liao Y P. A novel image fusion method with fractional saliency detection and QFWA in NSST[J]. Optics and Precision Engineering, 29, 1406-1419(2021).

    [14] Ma J L, Zhou Z Q, Wang B et al. Infrared and visible image fusion based on visual saliency map and weighted least square optimisation[J]. Infrared Physics & Technology, 82, 8-17(2017).

    [15] Ma J Y, Chen C, Li C et al. Infrared and visible image fusion via gradient transfer and total variation minimisation[J]. Information Fusion, 31, 100-109(2016).

    [16] Liu Y, Liu S P, Wang Z F. A general framework for image fusion based on multi-scale transform and sparse representation[J]. Information Fusion, 24, 147-164(2015).

    [17] Huang Y, Bi D Y, Wu D P. Infrared and visible image fusion is based on different constraints in the non-subsampled shearlet transform domain[J]. Sensors, 18, 1169(2018).

    [18] Zhou Z Q, Dong M J, Xie X Z et al. The fusion of infrared and visible images for night-vision context enhancement[J]. Applied Optics, 55, 6480-6490(2016).

    [19] Li X S, Zhou F Q, Tan H S et al. Multimodal medical image fusion based on a joint bilateral filter and local gradient energy[J]. Information Sciences, 569, 302-325(2021).

    [20] Li X S, Zhou F Q, Tan H S et al. Multi-focus image fusion based on nonsubsampled contourlet transform and residual removal[J]. Signal Processing, 184, 108062(2021).

    [21] Liu Y, Liu S P, Wang Z F. Multi-focus image fusion with dense SIFT[J]. Information Fusion, 23, 139-155(2015).

    [22] Liu C, Yuen J, Torralba A. SIFT flow: dense correspondence across scenes and its applications[J]. IEEE Transactions on Pattern Analysis and Machine Intelligence, 33, 978-994(2011).

    [23] Hayat N, Imran M. Ghost-free multiexposure image fusion technique using dense SIFT descriptor and guided filter[J]. Journal of Visual Communication and Image Representation, 62, 295-308(2019).

    [24] Bavirisetti D P, Dhuli R. The fusion of infrared and visible sensor images based on anisotropic diffusion and Karhunen-Loeve transform[J]. IEEE Sensors Journal, 16, 203-209(2016).

    [25] Liu Y, Chen X, Cheng J. Infrared and visible image fusion with convolutional neural networks[J]. International Journal of Wavelets, Multiresolution and Information Processing, 16, 1850018(2018).

    [26] Bavirisetti D P, Xiao G, Liu G. Multi-sensor image fusion based on the fourth order partial differential equations[C](2017).

    [27] Zhang Y, Zhang L J, Bai X Z et al. Infrared and visual image fusion through infrared feature extraction and visual information preservation[J]. Infrared Physics & Technology, 83, 227-237(2017).

    [28] Bavirisetti D P, Dhuli R. Two-scale image fusion of visible and infrared images using saliency detection[J]. Infrared Physics & Technology, 76, 52-64(2016).

    [29] Nejati M, Karimi M, Soroushmehr S M R et al. Fast exposure fusion using exposedness function[C], 2234-2238(2017).

    [30] Zhang X C, Ye P, Xiao G. VIFB: a visible and infrared image fusion benchmark[C], 468-478(2020).

    Tools

    Get Citation

    Copy Citation Text

    Jiawen Song, Daming Zhu, Zhitao Fu, Sijing Chen. Infrared and Visible Image Fusion Based on Contrast and Structure Extraction[J]. Laser & Optoelectronics Progress, 2023, 60(14): 1410005

    Download Citation

    EndNote(RIS)BibTexPlain Text
    Save article for my favorites
    Paper Information

    Category: Image Processing

    Received: Jul. 21, 2022

    Accepted: Aug. 29, 2022

    Published Online: Jul. 14, 2023

    The Author Email: Zhu Daming (634617255@qq.com)

    DOI:10.3788/LOP222132

    Topics