Multiscale Dilated U-Net Based Multifocus Image Fusion Algorithm

Fig. 9. Fused results of Lytro-01 image. (a)(b) Source images; (c) CNN; (d) SR; (e) DRPL; (f) GFF; (g) IFCNN; (h) MWGF; (i) NSCT; (j) SESF; (k) ZMFF; (l) U2Fusion; (m) MDUF-Net

Download full size

Fig. 10. Fused results of Lytro-19 image. (a)(b) Source images; (c) CNN; (d) SR; (e) DRPL; (f) GFF; (g) IFCNN; (h) MWGF; (i) NSCT; (j) SESF; (k) ZMFF; (l) U2Fusion; (m) MDUF-Net

Download full size

Table 1. Indexes of various fusion algorithms on the Lytro-01 image

View table

Table 1. Indexes of various fusion algorithms on the Lytro-01 image

Algorithm	$Q_{A G}$	$Q_{V I F}$	$Q_{A B / F}$	$Q_{M I}$
CNN	5.7695	0.9522	0.7510	5.2257
SR	5.7469	0.9392	0.7418	5.0395
DRPL	5.8567	0.9222	0.7480	5.1753
GFF	5.7939	0.9426	0.7504	5.0534
IFCNN	5.8395	0.9184	0.7207	4.3886
MWGF	5.7182	0.9512	0.7400	5.1323
NSCT	5.8206	0.9483	0.7512	5.2486
SESF	5.8297	0.9546	0.7488	5.2724
ZMFF	5.6614	0.9196	0.7062	4.1763
U2Fusion	5.8667	0.9026	0.6340	3.6650
MDUF-Net	6.0229	0.9781	0.7514	5.3169

Table 2. Indexes of various fusion algorithms on the Lytro-19 image

View table

Table 2. Indexes of various fusion algorithms on the Lytro-19 image

Algorithm	$Q_{A G}$	$Q_{V I F}$	$Q_{A B / F}$	$Q_{M I}$
CNN	6.2486	0.9134	0.7803	5.9004
SR	6.1928	0.8855	0.7670	5.5997
DRPL	6.3394	0.8846	0.7733	5.7115
GFF	6.2720	0.9093	0.7789	5.6647
IFCNN	6.2148	0.8518	0.7359	4.4883
MWGF	6.2979	0.9105	0.7772	5.7532
NSCT	6.2858	0.9054	0.7771	5.7122
SESF	6.2923	0.9135	0.7714	5.8819
ZMFF	6.0384	0.8601	0.7277	4.4961
U2Fusion	6.4774	0.7540	0.6915	3.9025
MDUF-Net	6.5289	0.9184	0.7787	6.0549

Table 3. Average indexes of various fusion algorithems on Lytro datast

View table

Table 3. Average indexes of various fusion algorithems on Lytro datast

Algorithm	$Q_{A G}$	$Q_{V I F}$	$Q_{A B / F}$	$Q_{M I}$
CNN	6.8339	0.9285	0.7643	5.8017
SR	6.7945	0.9184	0.7442	5.5437
DRPL	6.9131	0.9053	0.7501	5.6439
GFF	6.8544	0.9296	0.7543	5.6360
IFCNN	6.8684	0.8909	0.7231	4.7230
MWGF	6.8573	0.9345	0.7509	5.6644
NSCT	6.8683	0.9103	0.7531	5.6733
SESF	6.8756	0.9380	0.7507	5.7824
ZMFF	6.8159	0.9039	0.7114	4.9679
U2Fusion	6.8879	0.8671	0.6857	4.1807
MDUF-Net	7.0305	0.9486	0.7639	5.8725

Table 4. Average time calculated by different algorithms
View table
Table 4. Average time calculated by different algorithms
Algorithm Average time /s
CNN 299.64
SR 366.20
DRPL 0.62
GFF 1.18
IFCNN 0.37
MWGF 8.68
NSCT 160.71
SESF 0.41
ZMFF 1.58
U2Fusion 2.49
MDUF-Net 0.24

Table 5. Indexes of different variants of MDUF-Net
View table
Table 5. Indexes of different variants of MDUF-Net
Variant of MDUF-Net $Q_{A G}$ $Q_{V I F}$ $Q_{A B / F}$ $Q_{M I}$
U-Net 6.7721 0.9089 0.7217 4.9374
Without-MDCB 6.8304 0.9276 0.7471 5.2928
Without-RFB 6.9113 0.9395 0.7583 5.6835
MDUF-Net 7.0305 0.9486 0.7639 5.8725

Table 6. Ablation experiment with and without dilation convolution cascade module
View table
Table 6. Ablation experiment with and without dilation convolution cascade module
Variant of MDUF-Net $Q_{A G}$ $Q_{V I F}$ $Q_{A B / F}$ $Q_{M I}$
Without-Dilated 6.8739 0.9317 0.7536 5.5179
MDUF-Net 7.0305 0.9486 0.7639 5.8725

Tools

Get Citation

Copy Citation Text

Fenghao Nie, Mengxia Li, Mengxiang Zhou, Yuxue Dong, Zhiliang Li, Long Li. Multiscale Dilated U-Net Based Multifocus Image Fusion Algorithm[J]. Laser & Optoelectronics Progress, 2024, 61(14): 1437013

Download Citation

EndNote(RIS)BibTex Plain Text

Set citation alerts for article

Save article for my favorites