Chinese Journal of Liquid Crystals and Displays, Volume. 38, Issue 7, 933(2023)

Fusion of NSCT infrared and visible images based on improved FT saliency detection

Xian-tao WANG1,2 and Jin-yu ZHAO1、*
Author Affiliations
  • 1Changchun Institute of Optics,Fine Mechanics and Physics,Chinese Academy of Sciences,Changchun 130033,China
  • 2University of Chinese Academy of Sciences,Beijing 100049,China
  • show less

    In order to overcome the problems of low contrast, serious lack of details and textures in traditional algorithms, and noise sensitivity, weak adaptability and anti-interference ability of saliency-based detection algorithms, a non-subsampled contourlet transform (NSCT) infrared and visible light fusion method based on improved frequency tuning (FT) saliency detection is proposed. Firstly, an improved saliency map extraction algorithm is used to target the infrared image to distinguish the target from the background. Secondly, the infrared image and visible light image are decomposed into high and low frequency subbands using NSCT. The coefficients are used to guide the fusion, which can well preserve the contrast between the target and the background. For the high-frequency part, the rule of local weighted energy is used to make a decision, the weighted least squares (WLS) optimization can obtain more detailed information and reduce the influence of noise, and the fused high-frequency and low-frequency subbands coefficients are processed. Finally, the fused image is obtained by inverse NSCT transform. The experimental comparison results of four sets of images show that the method in this paper has better visual effect than other methods in terms of prominent target, rich details extraction, and obvious elimination of edge artifacts, subjectively. It is in the best state on the average gradient (AG), information entropy (IE), spatial frequency (SF), and mutual information (MI) of four objective evaluation indicators. Compared with the average of the five comparison methods, the AG, IE, SF, and MI are increased by 8.19%, 5.34%, 8.54%, and 68.18%, respectively. Thus, the proposed method is reliable and effective.

    Tools

    Get Citation

    Copy Citation Text

    Xian-tao WANG, Jin-yu ZHAO. Fusion of NSCT infrared and visible images based on improved FT saliency detection[J]. Chinese Journal of Liquid Crystals and Displays, 2023, 38(7): 933

    Download Citation

    EndNote(RIS)BibTexPlain Text
    Save article for my favorites
    Paper Information

    Category: Research Articles

    Received: Sep. 1, 2022

    Accepted: --

    Published Online: Jul. 31, 2023

    The Author Email: Jin-yu ZHAO (zhaojy@ciomp.ac.cn)

    DOI:10.37188/CJLCD.2022-0286

    Topics