Laser & Optoelectronics Progress, Volume. 61, Issue 14, 1437013(2024)

Multiscale Dilated U-Net Based Multifocus Image Fusion Algorithm

Fenghao Nie, Mengxia Li*, Mengxiang Zhou, Yuxue Dong, Zhiliang Li, and Long Li
Author Affiliations
  • College of Computer Science, Yangtze University, Jingzhou 434023, Hubei , China
  • show less

    Current multifocus fusion algorithms use only a single-image feature extraction scale, leading to problems such as loss of detail edges and local blurring in imaging. In response to these algorithms, this paper proposes a multifocus image fusion algorithm based on multiscale null U-Net. First, in the encoder part of U-Net, a multiscale null module was introduced to replace the traditional convolution module, which fully uses sensory fields with various scales to capture local and global information more comprehensively. In addition, to enhance the image feature characterization further, a RFB-s module was employed in the middle layer of U-Net to optimize the localization ability of multiscale features. The proposed fusion algorithm adopted the end-to-end supervised learning method in deep learning. This method was divided into three modules: feature extraction, feature fusion, and image reconstruction. Among these, the feature extraction module used U-Net containing multiscale null modules. Experimental results show that the fused images obtained using the proposed algorithm have clear detailed texture and are free of overlapping artifacts. Among all multifocus image fusion algorithms used for comparison, the proposed algorithm is optimal in terms of average gradient, visual information fidelity, and mutual information evaluation metrics. Additionally, this algorithm achieves suboptimal results close to the optimal results in edge information retention metrics. Meanwhile, the ablation experiment results further verify that the proposed multiscale null module can remarkably enhance the feature extraction capability of the network, thereby improving the quality of image fusion.

    Keywords
    Tools

    Get Citation

    Copy Citation Text

    Fenghao Nie, Mengxia Li, Mengxiang Zhou, Yuxue Dong, Zhiliang Li, Long Li. Multiscale Dilated U-Net Based Multifocus Image Fusion Algorithm[J]. Laser & Optoelectronics Progress, 2024, 61(14): 1437013

    Download Citation

    EndNote(RIS)BibTexPlain Text
    Save article for my favorites
    Paper Information

    Category: Digital Image Processing

    Received: Nov. 6, 2023

    Accepted: Jan. 10, 2024

    Published Online: Jul. 8, 2024

    The Author Email: Mengxia Li (limengxia@yangtzeu.edu.cn)

    DOI:10.3788/LOP232443

    CSTR:32186.14.LOP232443

    Topics