Acta Optica Sinica, Volume. 40, Issue 20, 2010001(2020)

Multi-Band Image Synchronous Super-Resolution and Fusion Method Based on Improved WGAN-GP

Songwang Tian, Suzhen Lin*, Haiwei Lei*, Dawei Li, and Lifang Wang
Author Affiliations
  • College of Data Science and Technology, North University of China, Taiyuan, Shanxi 030051, China
  • show less
    Figures & Tables(9)
    Overall framework of the proposed method
    Generator network architecture
    Discriminator network architecture
    Effect of loss function on results. (a) Adversarial loss+content loss; (b) adversarial loss+perceptual loss; (c) adversarial loss+content loss+perceptual loss
    Influence of network structure on results. (a) Low-level image spatial combination information result; (b) high-level feature space combined information results
    Fusion results. (a) Low resolution infrared long wave images; (b) low-resolution infrared short wave images; (c) low resolution visible images; (d) CNN; (e) GAN; (f) Densefuse; (g) DGCNN; (h) proposed method
    Objective evaluation results.(a) Evaluation metrics for the first fused results; (b) evaluation metrics for the second fused results; (c) evaluation metrics for the third fused results; (d) evaluation metrics for the fourth fused results; (e) evaluation metrics for the fifth fused results; (f) evaluation metrics for the sixth fused results
    Fusion results. (a) Low resolution infrared long wave image; (b) low-resolution infrared short wave image; (c) low resolution visible image; (d) CNN; (e) GAN; (f) Densefuse; (g) DGCNN; (h) proposed method
    • Table 1. Objective evaluation index values

      View table

      Table 1. Objective evaluation index values

      MethodIEAGCSFEIICGM
      CNN7.013.0370.169.2532.643.0298.98
      GAN7.091.7327.854.6317.711.7286.73
      Densefuse7.592.1343.375.8222.422.1297.45
      DGCNN7.372.5249.316.9425.252.5177.43
      Proposed method7.444.2437.0210.3438.954.22107.52
    Tools

    Get Citation

    Copy Citation Text

    Songwang Tian, Suzhen Lin, Haiwei Lei, Dawei Li, Lifang Wang. Multi-Band Image Synchronous Super-Resolution and Fusion Method Based on Improved WGAN-GP[J]. Acta Optica Sinica, 2020, 40(20): 2010001

    Download Citation

    EndNote(RIS)BibTexPlain Text
    Save article for my favorites
    Paper Information

    Category: Image Processing

    Received: Apr. 9, 2020

    Accepted: Jul. 3, 2020

    Published Online: Oct. 17, 2020

    The Author Email: Lin Suzhen (lsz@nuc.edu.cn), Lei Haiwei (lsz@nuc.edu.cn)

    DOI:10.3788/AOS202040.2010001

    Topics