Laser & Optoelectronics Progress, Volume. 59, Issue 22, 2215005(2022)
Medical Image Fusion Based on Semisupervised Learning and Generative Adversarial Network
To efficiently employ a small amount of labeled data, a medical image fusion network based on semisupervised learning and a generative adversarial network is developed. The developed fusion network comprises one generator and two discriminators. A semisupervised learning scheme is developed to train the network, including the supervised-training, unsupervised training, and parameters fine-tuning phases. Furthermore, the generator is constructed using a fusion inspired U-Net, squeeze and excitation attention modules. The discriminator contains three convolution layers, one fully connected layer, and a sigmoid activation function. The experimental findings on different multimodal medical images exhibit the proposed approach is competitive with six existing deep-learning based approaches in terms of visual effects and objective indexes. Moreover, the ablation investigations show the effectiveness of a semisupervised learning scheme that can enhance the quality of fused images.
Get Citation
Copy Citation Text
Haitao Yin, Yongying Yue. Medical Image Fusion Based on Semisupervised Learning and Generative Adversarial Network[J]. Laser & Optoelectronics Progress, 2022, 59(22): 2215005
Category: Machine Vision
Received: Aug. 12, 2021
Accepted: Oct. 13, 2021
Published Online: Sep. 23, 2022
The Author Email: Yin Haitao (haitaoyin@njupt.edu.cn)