Journal of Optoelectronics · Laser, Volume. 33, Issue 3, 283(2022)

Infrared and visible image fusion based on multiscale local extrema decomposition and ResNet152

CHEN Guangqiu*, WANG Shuai, HUANG Dandan, and DUAN Jin
Author Affiliations
  • [in Chinese]
  • show less

    In order to further improving the performance of infrared and visible image fusion method,an infrared and visible image fusion method based on multiscale local extrema decomposition (MLED) and deep learning network ResNet152 is proposed in this paper.Firstly,the source images are decomposed into approximate images and many detail images using MLED,which can separate out the overlapped important feature information.Secondly,the residual network ResNet152 is used to extract the multi-dimensional deep features of the source images,and the l1-norm is used as the activity level measure to generate the salient feature maps,the weighted average fusion algorithm is carried out for the approximate images,which can keep the energy and residual details not lost.For the detail images,the initial decision map is obtained by the rule “coefficient absolute max”.The source images are used as the guided images,and the initial decision maps are used as the input images for guided filtering.So the optimized decision maps are obtained,the weighted local energy is calculated to get the energy saliency maps.The weighted average algorithm is carried out for the detail images,which can make the fusion image having rich texture details and good visual edge perception.Finally,the fusion image is obtained by reconstructing the fused approximate image and detail images.The experimental results show that,compared with the existing typical fusion methods,the proposed method can achieve state-of-the-art results in terms of both objective evaluation and visual quality.

    Tools

    Get Citation

    Copy Citation Text

    CHEN Guangqiu, WANG Shuai, HUANG Dandan, DUAN Jin. Infrared and visible image fusion based on multiscale local extrema decomposition and ResNet152[J]. Journal of Optoelectronics · Laser, 2022, 33(3): 283

    Download Citation

    EndNote(RIS)BibTexPlain Text
    Save article for my favorites
    Paper Information

    Received: Jun. 1, 2021

    Accepted: --

    Published Online: Oct. 9, 2024

    The Author Email: CHEN Guangqiu (guangqiu_chen@126.com)

    DOI:10.16136/j.joel.2022.03.0372

    Topics