Laser & Optoelectronics Progress, Volume. 59, Issue 22, 2215005(2022)
Medical Image Fusion Based on Semisupervised Learning and Generative Adversarial Network
Fig. 1. Schematic diagram of proposed semisupervised learning
Fig. 2. Architecture of generator network
Fig. 3. SE channel attention module
Fig. 4. Architecture of discriminator network
Fig. 5. Fused images of unsupervised learning and semisupervised learning. (a) MRI-T1 image; (b) MRI-T2 image; (c) (d) CT images; (e) (f) fused images of unsupervised training; (g) (h) fused images of semisupervised training
Fig. 6. Fused results of MRI-T1 and MRI-T2 images. (a) MRI-T1; (b) MRI-T2; (c) U2Fusion; (d) DDcGAN; (e) Deepfuse; (f) DIDFuse; (g) FusionGAN; (h) PF-GAN; (i) SSL-FWGAN
Fig. 7. Fused results of MRI-T1 and CT images. (a) MRI-T1; (b) CT; (c) U2Fusion; (d) DDcGAN; (e) Deepfuse; (f) DIDFuse; (g) FusionGAN; (h) PF-GAN; (i) SSL-FWGAN
Fig. 8. Fused results of MRI-T2 and CT images. (a) MRI-T1; (b) CT; (c) U2Fusion; (d) DDcGAN; (e) Deepfuse; (f) DIDFuse; (g) FusionGAN; (h) PF-GAN; (i) SSL-FWGAN
Fig. 9. Implementation of SSL-FWGAN for fusing MRI and PET images
Fig. 10. Fused results of MRI-T1 and PET images. (a) MRI-T1; (b) PET; (c) U2Fusion; (d) DDcGAN; (e) Deepfuse; (f) DIDFuse; (g) FusionGAN; (h) PF-GAN; (i) SSL-FWGAN
Fig. 11. Fused results of MRI-T2 and PET images. (a) MRI-T1; (b) PET; (c) U2Fusion; (d) DDcGAN; (e) Deepfuse; (f) DIDFuse; (g) FusionGAN; (h) PF-GAN; (i) SSL-FWGAN
|
|
|
Get Citation
Copy Citation Text
Haitao Yin, Yongying Yue. Medical Image Fusion Based on Semisupervised Learning and Generative Adversarial Network[J]. Laser & Optoelectronics Progress, 2022, 59(22): 2215005
Category: Machine Vision
Received: Aug. 12, 2021
Accepted: Oct. 13, 2021
Published Online: Sep. 23, 2022
The Author Email: Yin Haitao (haitaoyin@njupt.edu.cn)