Infrared Technology, Volume. 44, Issue 5, 497(2022)

Multi-modality Image Fusion Algorithm Based on NSST-DWT-ICSAPCNN

Xiaona WANG*, Qing PAN, and Nili TIAN
Author Affiliations
  • [in Chinese]
  • show less

    To increase the information of the fused image, this paper proposes an improved multi-modality image fusion algorithm that combines the complementary advantages of the non-subsampled shearlet transform (NSST) and discrete wavelet transform (DWT). NSST was used to decompose the two source images in multiscale and multi-direction to obtain the corresponding high-frequency and low-frequency sub-bands. The low-frequency sub-bands were further decomposed into low-frequency energy sub-bands and low-frequency detail sub-bands by the DWT, and the low-frequency energy sub-bands were fused by the maximum selection rules. An adaptive pulse-coupled neural network with improved connection strength (ICSAPCNN) was used to fuse the detailed sub-bands and high-frequency sub-bands, and the energy sub-bands and detailed sub-bands were fused by inverse DWT to obtain the fused low-frequency sub-bands. The NSST inverse transform was used to reconstruct the fusion image with rich details. The experimental results verified that the proposed algorithm is superior to the other algorithms in both subjective vision and objective evaluation and can be applied to the fusion of both infrared and visible source images and medical source images.


    Get Citation

    Copy Citation Text

    WANG Xiaona, PAN Qing, TIAN Nili. Multi-modality Image Fusion Algorithm Based on NSST-DWT-ICSAPCNN[J]. Infrared Technology, 2022, 44(5): 497

    Download Citation

    EndNote(RIS)BibTexPlain Text
    Save article for my favorites
    Paper Information


    Received: Sep. 2, 2021

    Accepted: --

    Published Online: Jun. 16, 2022

    The Author Email: Xiaona WANG (



    Please enter the answer below before you can view the full text.