Laser & Optoelectronics Progress, Volume. 59, Issue 2, 0210017(2022)

Satellite Image Translation Method Based on Attention Residual Network

Jinyu Wang, Changgong Zhang, Haitao Yang*, Bodi Feng, Gaoyuan Li, and Yuge Gao
Author Affiliations
  • School of Space Information, Space Engineering University, Beijing 101416, China
  • show less
    Figures & Tables(16)
    Generating adversarial network architecture
    Separating attention residual module
    Consistent principle of circulation
    Network architecture
    Generator
    Image data of SAR
    Dataset visualization
    Results of semantic translation
    FID change during generation phase
    Loss function curves. (a) CycleGAN; (b) proposed method
    Subjective evaluation of ablation experiments
    Translation results for other datasets. (a) Dataset 2; (b) dataset 3; (c) dataset 4
    • Table 1. Generator network configuration

      View table

      Table 1. Generator network configuration

      TypeProcedureNameNumberInput sizeOutput sizeNormalizationActivation functionPadding
      Encoder1Conv13×256×25664×256×256InReLUYes
      2Conv164×256×256128×128×128InReLUNo
      3Conv1128×128×128256×64×64InReLUNo
      Converter4SeparConv9256×64×64256×64×64InReLUYes
      5SERestnet9256×64×64256×64×64InReLUNo
      Decoder6DeConv1256×64×64128×128×128InReLUNo
      7DeConv1128×128×12864×256×256InReLUNo
      8DeConv164×256×2563×256×256InReLUYes
    • Table 2. Content of dataset

      View table

      Table 2. Content of dataset

      Type of translationDatasetTerrestrialDataADataBData sourceSizeData volume(A)Data volume(B)
      SemanticTranslation1CityMapsImagesCycleGAN1225610981096
      Style Translation2FactoryImagesImagesRSI-CB25625112445
      3VegetationImagesSARRSI-CB、GF-32562358848
      4FarmlandImagesSARRSI-CB、GF-32562491656
    • Table 3. Comparison of indicators

      View table

      Table 3. Comparison of indicators

      methodParameter /MBModel size /MBPSNRSSIMFID
      Map→imageImage→mapMap→imagImage→mapMap→imagImage→map
      CycleGAN13.743.414.0224.980.180.6190.36257.59
      Pixpix54.420714.9617.090.210.51233.69322.38
      Proposed method4.825.814.6726.680.220.67178.44197.56
    • Table 4. Objective evaluation of ablation experiments

      View table

      Table 4. Objective evaluation of ablation experiments

      AlgorithmParameter /MBModel size /MBFID(map→image)FID(image→map)
      CycleGAN13.743.4190.36257.59
      CycleGAN+A13.9↑43.7↑181.68↓208.89↓
      CycleGAN+B4.8↓25.5↓180.96↓200.61↓
      CycleGAN+C13.743.4181.74↓199.74↓
      SA-CycleGAN4.8↓25.8↓178.44↓197.56↓
    Tools

    Get Citation

    Copy Citation Text

    Jinyu Wang, Changgong Zhang, Haitao Yang, Bodi Feng, Gaoyuan Li, Yuge Gao. Satellite Image Translation Method Based on Attention Residual Network[J]. Laser & Optoelectronics Progress, 2022, 59(2): 0210017

    Download Citation

    EndNote(RIS)BibTexPlain Text
    Save article for my favorites
    Paper Information

    Category: Image Processing

    Received: Jul. 29, 2021

    Accepted: Sep. 2, 2021

    Published Online: Dec. 23, 2021

    The Author Email: Haitao Yang (767153436@qq.com)

    DOI:10.3788/LOP202259.0210017

    Topics