Medical Image Fusion Network for Cross‑Modality Perception and Spatial‑Frequency Interaction

Fig. 4. Visualization of the images before and after transforming the phase components. (a) MRI; (b) SPECT; (c) transformed MRI; (d) transformed SPECT

Download full size

Fig. 5. Subjective comparison of MRI-PET images fusion in mild Alzheimer’s disease. (a) MRI; (b) PET; (c) NSST; (d) CNP; (e) IFCNN; (f) SDNet; (g) DDcGAN; (h) EMFusion; (i) MATR; (j) PIAFusion; (k) GeSeNet; (l) TransMEF; (m) FATFusion; (n) ours

Download full size

Fig. 6. Subjective comparison of MRI-SPECT images fusion in metastatic bronchogenic carcinoma. (a) MRI; (b) SPECT; (c) NSST; (d) CNP; (e) IFCNN; (f) SDNet; (g) DDcGAN; (h) EMFusion; (i) MATR; (j) PIAFusion; (k) GeSeNet; (l) TransMEF; (m) FATFusion; (n) ours

Download full size

Fig. 7. Subjective comparison of MRI-CT images fusion in sarcoma. (a) CT; (b) MRI; (c) NSST; (d) CNP; (e) IFCNN; (f) SDNet; (g) DDcGAN; (h) EMFusion; (i) MATR; (j) PIAFusion; (k) GeSeNet; (l) TransMEF; (m) FATFusion; (n) ours

Download full size

Fig. 8. Objective evaluation under different values of loss function parameters $λ_{1}$ , $λ_{2}$ , and $λ_{3}$ . (a) $λ_{1}$ ; (b) $λ_{2}$ ; (c) $λ_{3}$

Download full size

Fig. 9. Subjective comparison of ablation experiments. (a) MRI; (b) SPECT; (c) W/O CMPM; (d) W/O SFCFM; (e) W/O L_structural; (f) W/O L_spectral; (g) all

Download full size

Fig. 10. Subjective comparison of abdominal CT-PET images fusion. (a) CT; (b) PET; (c) NSST; (d) CNP; (e) IFCNN; (f) SDNet; (g) DDcGAN; (h) EMFusion; (i) MATR; (j) PIAFusion; (k) GeSeNet; (l) TransMEF; (m) FATFusion; (n) ours

Download full size

Fig. 11. Objective indexes comparison of abdominal CT-PET images fusion

Download full size

Fig. 12. Subjective comparison of GFP-PC images fusion in Arabidopsis thaliana cell. (a) GFP; (b) PC; (c) NSST; (d) CNP; (e) IFCNN; (f) SDNet; (g) DDcGAN; (h) EMFusion; (i) MATR; (j) PIAFusion; (k) GeSeNet; (l) TransMEF; (m) FATFusion; (n) ours

Download full size

Fig. 13. Objective indexes comparison of GFP-PC images fusion in Arabidopsis thaliana cell

Download full size

Table 1. Objective evaluation indexes of MRI-PET images fusion in mild Alzheimer’s disease

View table

Table 1. Objective evaluation indexes of MRI-PET images fusion in mild Alzheimer’s disease

Method	AG	MI	SF	Q^AB/F	CC	VIF
NSST	7.8726	2.5372	31.8064	0.2450	0.6002	0.2667
CNP	8.7138	2.5283	30.1134	0.2142	0.5987	0.2478
IFCNN	8.7641	2.7415	31.8546	0.5734	0.7625	0.4412
SDNet	5.9252	2.7271	18.4749	0.4334	0.7639	0.3680
DDcGAN	7.4418	2.7763	24.6753	0.4825	0.7547	0.3909
EMFusion	7.8234	2.8276	29.1811	0.6187	0.7670	0.4921
MATR	7.1690	3.0629	26.5145	0.6250	0.6722	0.5839
PIAFusion	9.2216	2.9624	34.1620	0.6311	0.7719	0.5085
GeSeNet	8.7095	3.0781	30.9970	0.6133	0.7865	0.4843
TransMEF	4.9402	2.9470	17.4362	0.3161	0.7658	0.4396
FATFusion	8.6511	3.0824	31.9499	0.6263	0.6891	0.5808
Ours	9.9213	3.2768	36.4857	0.6562	0.7724	0.6225

Table 2. Objective evaluation indexes of MRI-SPECT images fusion in metastatic bronchogenic carcinoma

View table

Table 2. Objective evaluation indexes of MRI-SPECT images fusion in metastatic bronchogenic carcinoma

Method	AG	MI	SF	Q^AB/F	CC	VIF
NSST	7.0553	2.5477	27.6850	0.2653	0.6779	0.6779
CNP	5.1744	2.8504	18.4927	0.5477	0.8309	0.8309
IFCNN	5.2620	2.8874	19.4426	0.6006	0.8563	0.8594
SDNet	4.1723	3.1115	13.4854	0.5167	0.8395	0.8395
DDcGAN	4.1246	3.3795	14.7612	0.5524	0.7640	0.7640
EMFusion	5.1735	3.0924	19.4014	0.6257	0.8090	0.8092
MATR	4.4757	3.9251	15.9699	0.6644	0.7995	0.7995
PIAFusion	5.6785	3.3369	20.2107	0.6428	0.8331	0.8331
GeSeNet	4.9450	3.2423	18.2937	0.6212	0.8825	0.8450
TransMEF	2.9104	3.1897	10.7775	0.3501	0.8598	0.8125
FATFusion	5.5015	3.0793	21.1682	0.6558	0.8146	0.8146
Ours	6.1199	3.9575	27.7411	0.6874	0.8650	0.8677

Table 3. Objective evaluation indexes of MRI-CT image fusion in sarcoma

View table

Table 3. Objective evaluation indexes of MRI-CT image fusion in sarcoma

Method	AG	MI	SF	Q^AB/F	CC	VIF
NSST	8.9917	2.6691	32.3246	0.3085	0.6966	0.3090
CNP	8.2166	2.6009	34.1761	0.3197	0.6743	0.3085
IFCNN	7.3004	2.9814	30.8987	0.5227	0.8092	0.4299
SDNet	4.7867	3.2732	14.0871	0.4132	0.7937	0.4901
DDcGAN	5.4429	3.5363	25.7876	0.5416	0.7137	0.6739
EMFusion	5.0941	3.3206	18.8327	0.4683	0.7948	0.5698
MATR	4.7976	3.7411	25.1896	0.5216	0.6143	0.7625
PIAFusion	7.6194	3.2587	32.4582	0.5908	0.7949	0.5061
GeSeNet	8.6032	3.0101	36.4693	0.5318	0.7936	0.4516
TransMEF	4.3705	3.2363	19.5086	0.3067	0.6292	0.3618
FATFusion	5.9983	3.2203	31.7580	0.5105	0.7321	0.6687
Ours	8.9066	4.3485	36.8964	0.6009	0.8984	0.7746

Table 4. Objective evaluation indexes of ablation experiments

View table

Table 4. Objective evaluation indexes of ablation experiments

Method	AG	MI	SF	Q^AB/F	CC	VIF
W/O CMPM	5.0161	2.5723	21.4285	0.4776	0.9218	0.5085
W/O SFCFM	5.1368	2.6110	20.2607	0.3033	0.9431	0.4921
W/O L_structural	4.0022	2.6445	22.0521	0.3287	0.9482	0.4412
W/O L_spectral	4.1396	2.9349	19.4457	0.4258	0.9149	0.4396
All	5.4868	3.0935	22.8228	0.5165	0.9542	0.5808

Tools

Get Citation

Copy Citation Text

Yu Shen, Shan Bai, Ziyi Wei, Bohao Li, Yangyang Li, Baoqu Gao, Jiaying Liu, Jiarong Yan, Zhenkai Qiang, Yuan Yan. Medical Image Fusion Network for Cross‑Modality Perception and Spatial‑Frequency Interaction[J]. Chinese Journal of Lasers, 2025, 52(9): 0907106

Download Citation

EndNote(RIS)BibTex Plain Text

Set citation alerts for article

Save article for my favorites

Paper Information

Category: Biomedical Optical Imaging

Received: Nov. 8, 2024

Accepted: Dec. 31, 2024

Published Online: Apr. 10, 2025

The Author Email: Shan Bai (15838636358@163.com)

DOI:10.3788/CJL241333

CSTR:32183.14.CJL241333

Topics

laser devices and laser physics

Lasers and Laser Optics

Laser physics

laser manufacturing

Instrumentation, Measurement and Metrology