Laser & Optoelectronics Progress, Volume. 57, Issue 8, 081013(2020)

An Infrared and Visible Image Fusion Algorithm Based on ResNet152

Heng Li1、*, Liming Zhang2,3、**, Meirong Jiang2, and Yulong Li1
Author Affiliations
  • 1School of Electronics and Information Engineering, Lanzhou Jiaotong University, Lanzhou, Gansu 730070, China
  • 2Faculty of Geomatics, Lanzhou Jiaotong University, Lanzhou, Gansu 730070, China
  • 3Gansu Provincial Engineering Laboratory for National Geographic State Monitoring, Lanzhou, Gansu 730070, China
  • show less

    In order to improve the details of fusion image from infrared and visible image and reduce artifacts and noise, an infrared and visible image fusion algorithm based on ResNet152 deep learning model is proposed. Firstly, the source image is decomposed into the low frequency part and the high frequency part. The low frequency part is fused by the average weighting strategy to put a new low frequency part. The high frequency part is extracted by ResNet152 to obtain multiple feature layers.The L1 regularization, convolution operation, bilinear interpolation upsampling, and maximum selection strategy for the feature layers to obtain the maximum weight layer. Multiplying the maximum weight layer and the high frequency part to obtain a new high frequency part. Finally, the image is reconstructed by the new low frequency part and high frequency part. Experimental results show that the proposed algorithm can get more texture information while retaining the significant features of the image, and effectively reduces artifacts and noise. The subjective evaluation and objective evaluation are better than the comparison algorithm.

    Tools

    Get Citation

    Copy Citation Text

    Heng Li, Liming Zhang, Meirong Jiang, Yulong Li. An Infrared and Visible Image Fusion Algorithm Based on ResNet152[J]. Laser & Optoelectronics Progress, 2020, 57(8): 081013

    Download Citation

    EndNote(RIS)BibTexPlain Text
    Save article for my favorites
    Paper Information

    Category: Image Processing

    Received: Jul. 1, 2019

    Accepted: Sep. 16, 2019

    Published Online: Apr. 3, 2020

    The Author Email: Li Heng (453984016@qq.com), Zhang Liming (zhanglm8@gmail.com)

    DOI:10.3788/LOP57.081013

    Topics