Laser & Optoelectronics Progress, Volume. 59, Issue 24, 2410004(2022)

Multi-Focus Image Fusion Method Based on Cooperative Detection via a Deep Dense Convolutional Neural Network

Wei Yang1, Liye Mei2, Chuan Xu3, Huan Zhang3, Chuanwen Hu4、*, and Qianchuang Deng1
Author Affiliations
  • 1School of Information Science and Engineering, Wuchang Shouyi University, Wuhan 430064, Hubei, China
  • 2The Institute of Technological Sciences, Wuhan University, Wuhan 430072, Hubei, China
  • 3School of Computer Science, Hubei University of Technology, Wuhan 430068, Hubei, China
  • 4Zhejiang Academy of Surveying and Mapping, Hangzhou 311100, Zhejiang, China
  • show less

    Traditional methods cannot fully mine image-focus association information, thereby leading to the distortion of fusion details. In this study, a multi-focus image fusion method based on collaborative detection via densely connected convolutional neural networks is proposed to address this issue. Multi-focused source images are integrated to detect focused features collaboratively, and the features of deep dense convolutional networks, such as feature reuse, and the combination of low-level and high-level features are used to enhance the multi-focused image feature representation, which better mine the images' semantic information. By leveraging feature reuse, multi-focus source images are integrated to achieve collaborative focus feature detection. The multi-scale pyramid pooling strategy is used to aggregate the global context information of different focus regions to enhance the ability to distinguish the focused and defocused areas and obtain a rough fusion-probability decision graph. Furthermore, a convolution conditional random field (CRF) is adopted to optimize the decision graph and the refined probabilistic decision graph is obtained. Finally, the fused image is obtained with its details preserved. A pair of multi-focused images are combined into six channels and fed into the network for training, thus ensuring that the focused areas are correlated. The proposed method is evaluated subjectively and objectively using public data sets. The experimental results show that the proposed method produces effective fusion and fully mines the focused association information and retains sufficient image detail.

    Tools

    Get Citation

    Copy Citation Text

    Wei Yang, Liye Mei, Chuan Xu, Huan Zhang, Chuanwen Hu, Qianchuang Deng. Multi-Focus Image Fusion Method Based on Cooperative Detection via a Deep Dense Convolutional Neural Network[J]. Laser & Optoelectronics Progress, 2022, 59(24): 2410004

    Download Citation

    EndNote(RIS)BibTexPlain Text
    Save article for my favorites
    Paper Information

    Category: Image Processing

    Received: Sep. 13, 2021

    Accepted: Oct. 27, 2021

    Published Online: Jan. 11, 2023

    The Author Email: Hu Chuanwen (Chuanwenhu@qq.com)

    DOI:10.3788/LOP202259.2410004

    Topics