Laser & Optoelectronics Progress, Volume. 58, Issue 20, 2010004(2021)

Infrared and Visible Images Fusion Algorithm Based on NSST and IFCNN

Yanchun Yang*, Xiaoyu Gao, Jianwu Dang, and Yangping Wang
Author Affiliations
  • School of Electronic and Information Engineering, Lanzhou Jiaotong University, Lanzhou, Gansu 730070, China
  • show less

    Aiming at the problem of insufficient edge detail preservation in image fusion, infrared and visible images fusion algorithm based on non-subsampled shear-wave transform (NSST) and convolutional neural network image fusion framework (IFCNN) is proposed. First, infrared and visible images are decomposed by NSST. Then, in order to make the low-frequency sub-band image better highlight the contour information, the image is fused using similarity matching fusion rule; for the high-frequency sub-band images, the feature layers are extracted using IFCNN, and the maximum weight image of feature layer can be obtained through L2 regularization, convolution operation, and maximum selection strategy processing, and the high frequency fusion rule can be determined according to the maximum weight image. Finally, the NSST inverse transform is used to obtain the final fusion image. The experimental results show that the proposed algorithm retains the details of image edges and textures, reduces artifacts and noises, and has good visual effects.

    Tools

    Get Citation

    Copy Citation Text

    Yanchun Yang, Xiaoyu Gao, Jianwu Dang, Yangping Wang. Infrared and Visible Images Fusion Algorithm Based on NSST and IFCNN[J]. Laser & Optoelectronics Progress, 2021, 58(20): 2010004

    Download Citation

    EndNote(RIS)BibTexPlain Text
    Save article for my favorites
    Paper Information

    Category: Image Processing

    Received: Dec. 7, 2020

    Accepted: Jan. 2, 2021

    Published Online: Oct. 12, 2021

    The Author Email: Yang Yanchun (yangyanchun102@sina.com)

    DOI:10.3788/LOP202158.2010004

    Topics