Laser & Optoelectronics Progress, Volume. 60, Issue 2, 0210003(2023)

Multi-Scale Dilated Convolutional Neural Network Based Multi-Focus Image Fusion Algorithm

Haitao Yin* and Wei Zhou
Author Affiliations
  • College of Automation and College of Artificial Intelligence, Nanjing University of Posts and Telecommunications, Nanjing 210023, Jiangsu, China
  • show less
    References(36)

    [1] Li S T, Kang X D, Fang L Y et al. Pixel-level image fusion: a survey of the state of the art[J]. Information Fusion, 33, 100-112(2017).

    [2] Zhan K, Li Q Q, Teng J C et al. Multifocus image fusion using phase congruency[J]. Journal of Electronic Imaging, 24, 033014(2015).

    [3] Liu Y, Wang Z F. Simultaneous image fusion and denoising with adaptive sparse representation[J]. IET Image Processing, 9, 347-357(2015).

    [4] Wang W C, Chang F L. A multi-focus image fusion method based on Laplacian pyramid[J]. Journal of Computers, 6, 2559-2566(2011).

    [5] Li S T, Yang B. Multifocus image fusion by combining curvelet and wavelet transform[J]. Pattern Recognition Letters, 29, 1295-1301(2008).

    [6] Nencini F, Garzelli A, Baronti S et al. Remote sensing image fusion using the curvelet transform[J]. Information Fusion, 8, 143-156(2007).

    [7] Zhang Q, Guo B L. Multifocus image fusion using the nonsubsampled contourlet transform[J]. Signal Processing, 89, 1334-1346(2009).

    [8] Li J, Yang Y C, Dang J W et al. Multi-focus image fusion based on NSCT and guided filtering[J]. Laser & Optoelectronics Progress, 55, 071007(2018).

    [9] Yang B, Li S T. Multifocus image fusion and restoration with sparse representation[J]. IEEE Transactions on Instrumentation and Measurement, 59, 884-892(2010).

    [10] Zhang Y X, Chen L, Zhao Z H et al. Multi-focus image fusion based on robust principal component analysis and pulse-coupled neural network[J]. Optik, 125, 5002-5006(2014).

    [11] Bai X Z, Zhang Y, Zhou F G et al. Quadtree-based multi-focus image fusion using a weighted focus-measure[J]. Information Fusion, 22, 105-118(2015).

    [12] Zhou Z Q, Li S, Wang B. Multi-scale weighted gradient-based fusion for multi-focus images[J]. Information Fusion, 20, 60-72(2014).

    [13] Liu Y, Liu S P, Wang Z F. Multi-focus image fusion with dense SIFT[J]. Information Fusion, 23, 139-155(2015).

    [14] Li S T, Kwok J T, Wang Y N. Combination of images with diverse focuses using the spatial frequency[J]. Information Fusion, 2, 169-176(2001).

    [15] Long J, Shelhamer E, Darrell T. Fully convolutional networks for semantic segmentation[C], 3431-3440(2015).

    [16] He K M, Gkioxari G, Dollár P et al. Mask R-CNN[C], 2980-2988(2017).

    [17] Ma Y J, Liu P P. Convolutional neural network based on DenseNet evolution for image classification algorithm[J]. Laser & Optoelectronics Progress, 57, 241001(2020).

    [18] Gan J W, Sha Y, Zhang G Y. Image denoising based on asymmetric convolutional neural networks[J]. Laser & Optoelectronics Progress, 57, 221018(2020).

    [19] Chen X Y, Zhang W J, Sun W Z et al. Super-resolution reconstruction of images based on multi-scale and multi-residual network[J]. Laser & Optoelectronics Progress, 57, 181009(2020).

    [20] Liu Y, Chen X, Peng H et al. Multi-focus image fusion with a deep convolutional neural network[J]. Information Fusion, 36, 191-207(2017).

    [21] Tang H, Xiao B, Li W S et al. Pixel convolutional neural network for multi-focus image fusion[J]. Information Sciences, 433/434, 125-141(2018).

    [22] Ma B Y, Zhu Y, Yin X et al. SESF-Fuse: an unsupervised deep model for multi-focus image fusion[J]. Neural Computing and Applications, 33, 5793-5804(2021).

    [23] Prabhakar K R, Srikar V S, Babu R V. DeepFuse: a deep unsupervised approach for exposure fusion with extreme exposure image pairs[C], 4724-4732(2017).

    [24] Zhang Y, Liu Y, Sun P et al. IFCNN: a general image fusion framework based on convolutional neural network[J]. Information Fusion, 54, 99-118(2020).

    [25] Zang Y S, Zhou D M, Wang C C et al. UFA-FUSE: a novel deep supervised and hybrid model for multifocus image fusion[J]. IEEE Transactions on Instrumentation and Measurement, 70, 1-17(2021).

    [26] He K M, Zhang X Y, Ren S Q et al. Deep residual learning for image recognition[C], 770-778(2016).

    [27] Hu J, Shen L, Sun G. Squeeze-and-excitation networks[C], 7132-7141(2018).

    [29] Lin T Y, Maire M, Belongie S et al. Microsoft COCO: common objects in context[M]. Fleet D, Pajdla T, Schiele B, et al. Computer vision-ECCV 2014, 8693, 740-755(2014).

    [30] Li S T, Kang X D, Hu J W et al. Image matting for fusion of multi-focus images in dynamic scenes[J]. Information Fusion, 14, 147-162(2013).

    [31] Li H, Wu X J. DenseFuse: a fusion approach to infrared and visible images[J]. IEEE Transactions on Image Processing, 28, 2614-2623(2019).

    [32] Nejati M, Samavi S, Shirani S. Multi-focus image fusion using dictionary-based sparse representation[J]. Information Fusion, 25, 72-84(2015).

    [33] Song H H, Yu S Y, Song L et al. Fusion of multispectral and panchromatic satellite images based on contourlet transform and local average gradient[J]. Optical Engineering, 46, 020502(2007).

    [34] Shah P, Merchant S N, Desai U B. Multifocus and multispectral image fusion based on pixel significance using multiresolution decomposition[J]. Signal, Image and Video Processing, 7, 95-109(2013).

    [35] Han Y, Cai Y Z, Cao Y et al. A new image fusion performance metric based on visual information fidelity[J]. Information Fusion, 14, 127-135(2013).

    [36] Xydeas C S, Petrović V. Objective image fusion performance measure[J]. Electronics Letters, 36, 308-309(2000).

    Tools

    Get Citation

    Copy Citation Text

    Haitao Yin, Wei Zhou. Multi-Scale Dilated Convolutional Neural Network Based Multi-Focus Image Fusion Algorithm[J]. Laser & Optoelectronics Progress, 2023, 60(2): 0210003

    Download Citation

    EndNote(RIS)BibTexPlain Text
    Save article for my favorites
    Paper Information

    Category: Image Processing

    Received: Sep. 10, 2021

    Accepted: Nov. 10, 2021

    Published Online: Jan. 3, 2023

    The Author Email: Yin Haitao (haitaoyin@njupt.edu.cn)

    DOI:10.3788/LOP212488

    Topics