Journals Articles Conferences News About CLP
Submit a paper Email Alert
Search
Search
Articles
Journals
News
Advanced Search
Top Searches
2D MaterialsTransformation opticsQuantum PhotonicsSmall lasersSemiconductor UV PhotonicsSupersymmetric microring laser arrays

Acta Optica Sinica, Volume. 41, Issue 7, 0728003(2021)

Remote Sensing Image Mode Translation by Spatial Disentangled Representation Based GAN

Zishuo Han, Chunping Wang*, Qiang Fu, and Bin Zhao
Author Affiliations
  • Department of Electronic and Optical Engineering, Shijiazhuang Campus, Army Engineering University, Shijiazhuang, Hebei 050003, China
    • show less
    AbstractGet PDF(in Chinese)
    Figures&Tables (24)
    Equations (0)
    References (22)
    Cited By (5)
    Tools
    Paper Information
    Topics
    Figures & Tables(24)
    Basic framework of SDR-CycleGAN

    Fig. 1. Basic framework of SDR-CycleGAN

    Download full size
    Network structure of style encoder

    Fig. 2. Network structure of style encoder

    Download full size
    Network structure of content encoder

    Fig. 3. Network structure of content encoder

    Download full size
    Network structure of content domain translation module

    Fig. 4. Network structure of content domain translation module

    Download full size
    Network structure of decoder

    Fig. 5. Network structure of decoder

    Download full size
    Network structure of discriminator

    Fig. 6. Network structure of discriminator

    Download full size
    Working process diagram of discriminator

    Fig. 7. Working process diagram of discriminator

    Download full size
    Samples of SEN1-2 dataset

    Fig. 8. Samples of SEN1-2 dataset

    Download full size
    Samples of SARptical dataset

    Fig. 9. Samples of SARptical dataset

    Download full size
    Samples of WHU-SEN-City dataset. (a) SAR image; (b) ORS image

    Fig. 10. Samples of WHU-SEN-City dataset. (a) SAR image; (b) ORS image

    Download full size
    Image blocks of WHU-SEN-City dataset

    Fig. 11. Image blocks of WHU-SEN-City dataset

    Download full size
    Schematic diagram of image cutting. (a) Example of scene image; (b) image blocks

    Fig. 12. Schematic diagram of image cutting. (a) Example of scene image; (b) image blocks

    Download full size
    Examples of SAR image to ORS image translation on SEN1-2 dataset

    Fig. 13. Examples of SAR image to ORS image translation on SEN1-2 dataset

    Download full size
    Examples of ORS image to SAR image translation on SEN1-2 dataset

    Fig. 14. Examples of ORS image to SAR image translation on SEN1-2 dataset

    Download full size
    Examples of SAR image to ORS image translation on SARptical dataset

    Fig. 15. Examples of SAR image to ORS image translation on SARptical dataset

    Download full size
    Examples of ORS image to SAR image translation on SARptical dataset

    Fig. 16. Examples of ORS image to SAR image translation on SARptical dataset

    Download full size
    Examples of SAR image to ORS image translation on WHU-SEN-City dataset. (a) SAR images; (b) ORS images; (c) BRIT translation results; (d) CR-CycleGAN translation results; (e) MUNIT translation results; (f) S-CycleGAN translation results; (g) DSMAP translation results; (h) SDR-CycleGAN translation results

    Fig. 17. Examples of SAR image to ORS image translation on WHU-SEN-City dataset. (a) SAR images; (b) ORS images; (c) BRIT translation results; (d) CR-CycleGAN translation results; (e) MUNIT translation results; (f) S-CycleGAN translation results; (g) DSMAP translation results; (h) SDR-CycleGAN translation results

    Download full size
    Examples of ORS image to SAR image translation on WHU-SEN-City dataset. (a) SAR images; (b) ORS images; (c) BRIT translation results; (d) CR-CycleGAN translation results; (e) S-CycleGAN translation results; (f) MUNIT translation results; (g) DSMAP translation results; (h) SDR-CycleGAN translation results

    Fig. 18. Examples of ORS image to SAR image translation on WHU-SEN-City dataset. (a) SAR images; (b) ORS images; (c) BRIT translation results; (d) CR-CycleGAN translation results; (e) S-CycleGAN translation results; (f) MUNIT translation results; (g) DSMAP translation results; (h) SDR-CycleGAN translation results

    Download full size

    • Table 1. Quality assessments of SAR image to ORS image translation on SEN1-2 dataset

      View table

      Table 1. Quality assessments of SAR image to ORS image translation on SEN1-2 dataset

      MethodPSNR /dBSSIMFSIM
      DRIT10.1400.2560.582
      CR-CycleGAN10.1840.2010.629
      S-CycleGAN11.2630.2580.664
      MUINT13.5890.2460.670
      DSMAP14.9170.2880.653
      SDR-CycleGAN15.4660.3210.687

    • Table 2. Quality assessments of ORS image to SAR image translation on SEN1-2 dataset

      View table

      Table 2. Quality assessments of ORS image to SAR image translation on SEN1-2 dataset

      MethodPSNR /dBSSIMFSIM
      CR-CycleGAN9.2700.2310.685
      S-CycleGAN10.7940.2610.694
      DRIT11.4310.2520.682
      MUINT13.3720.2570.689
      DSMAP13.8490.2780.701
      SDR-CycleGAN13.9120.2930.711

    • Table 3. Quality assessments of SAR image to ORS image translation on SARptical dataset

      View table

      Table 3. Quality assessments of SAR image to ORS image translation on SARptical dataset

      MethodPSNR /dBSSIMFSIM
      DRIT10.6850.2730.652
      S-CycleGAN10.8500.2820.658
      CR-CycleGAN11.8080.3110.664
      MUNIT11.8540.2870.660
      DSMAP12.6850.2890.662
      SDR-CycleGAN13.3670.3230.687

    • Table 4. Quality assessments of ORS image to SAR image translation on SARptical dataset

      View table

      Table 4. Quality assessments of ORS image to SAR image translation on SARptical dataset

      MethodPSNR /dBSSIMFSIM
      DRIT14.5880.2100.723
      MUNIT14.6200.2110.720
      S-CycleGAN14.7180.2160.725
      CR-CycleGAN15.2630.2570.708
      DSMAP15.2670.2400.720
      SDR-CycleGAN16.0680.2470.728

    • Table 5. Quality assessment of SAR image to ORS image translation on WHU-SEN-City dataset

      View table

      Table 5. Quality assessment of SAR image to ORS image translation on WHU-SEN-City dataset

      MethodPSNR /dBSSIMFSIM
      DRIT8.7950.2100.565
      CR-CycleGAN11.3600.2480.649
      MUNIT13.1240.3170.699
      S-CycleGAN13.4720.3910.734
      DSMAP13.7290.4470.714
      SDR-CycleGAN14.1160.4720.763

    • Table 6. Quality assessment of ORS image to SAR image translation on WHU-SEN-City dataset

      View table

      Table 6. Quality assessment of ORS image to SAR image translation on WHU-SEN-City dataset

      MethodPSNR /dBSSIMFSIM
      DRIT9.0760.1520.696
      CR-CycleGAN10.9980.1120.687
      S-CycleGAN11.1970.2540.682
      MUNIT13.0330.3960.711
      DSMAP13.0760.3740.697
      SDR-CycleGAN13.1700.4050.732
    Tools

    Get Citation

    Copy Citation Text

    Zishuo Han, Chunping Wang, Qiang Fu, Bin Zhao. Remote Sensing Image Mode Translation by Spatial Disentangled Representation Based GAN[J]. Acta Optica Sinica, 2021, 41(7): 0728003

    Download Citation

    EndNote(RIS)BibTexPlain Text
    Set citation alerts for article
    Save article for my favorites
    Paper Information

    Category: Remote Sensing and Sensors

    Received: Sep. 27, 2020

    Accepted: Nov. 24, 2020

    Published Online: Apr. 11, 2021

    The Author Email: Wang Chunping (wang_c_p@163.com)

    DOI:10.3788/AOS202141.0728003

    Topics

    laser devices and laser physics
    Lasers and Laser Optics
    Laser physics
    laser manufacturing
    Instrumentation, Measurement and Metrology