Laser & Optoelectronics Progress, Volume. 61, Issue 4, 0428012(2024)

Algorithm for Cloud Removal from Optical Remote Sensing Images Based on the Mechanism of Fusion and Refinement

Xiaoyu Wang*, Yuhang Liu**, and Yan Zhang
Author Affiliations
  • DFH Satellite Co., Ltd., Beijing 100094, China
  • show less
    Figures & Tables(13)
    Illustration of cloud removal network for remote sensing image
    Illustration of multi-scale cloud feature fusion pyramid
    Illustration of the feature fusion unit
    Illustration of multi-scale cloud edge feature refinement unit
    Illustration of the discriminator network
    Results of the RICE1 dataset. (a) Cloudy images; (b) cloud-free images, (c) CAP; (d) BCCR; (e) DCP; (f) DehazeNet; (g) MSCNN; (h) proposed algorithm
    Results of the RICE2 dataset. (a) Cloudy images; (b) cloud-free images, (c) CAP; (d) BCCR; (e) DCP; (f) DehazeNet; (g) MSCNN; (h) proposed algorithm
    Results of real images. (a) Cloudy images; (b) CAP; (c) BCCR; (d) DCP; (e) DehazeNet; (f) MSCNN; (g) proposed algorithm
    • Table 1. Quantitative analysis results of the RICE1 test set

      View table

      Table 1. Quantitative analysis results of the RICE1 test set

      AlgorithmEvaluation index
      SSIMPSNR /dB
      CAP0.795020.5820
      BCCR0.652517.1802
      DCP0.681416.7349
      DehazeNet0.801920.8613
      MSCNN0.754920.1289
      Proposed algorithm0.896423.9876
    • Table 2. Quantitative analysis results of the RICE2 test set

      View table

      Table 2. Quantitative analysis results of the RICE2 test set

      AlgorithmEvaluation index
      SSIMPSNR /dB
      CAP0.768320.7902
      BCCR0.590416.6502
      DCP0.553815.8937
      DehazeNet0.735120.8093
      MSCNN0.649917.4240
      Proposed algorithm0.839722.8645
    • Table 3. Quantitative analysis results of the ablation experiment of loss functions

      View table

      Table 3. Quantitative analysis results of the ablation experiment of loss functions

      DatasetRemoved loss functionEvaluation index
      SSIMPSNR /dB
      RICE1None(baseline)0.896423.9876
      Perceptual loss0.873722.9699
      Gradient loss0.869722.2485
      RICE2None(baseline)0.839722.8645
      Perceptual loss0.829821.1345
      Gradient loss0.817620.6549
    • Table 4. Quantitative analysis results of the ablation experiment of discriminator network

      View table

      Table 4. Quantitative analysis results of the ablation experiment of discriminator network

      DatasetDiscriminatorEvaluation index
      SSIMPSNR /dB
      RICE1None0.849420.0365
      Discriminator210.878921.0264
      Proposed0.896423.9876
      RICE2None0.794719.1643
      Discriminator210.809621.0645
      Proposed0.839722.8645
    • Table 5. Model parameters, FLOPs, and average running time

      View table

      Table 5. Model parameters, FLOPs, and average running time

      AlgorithmParameters /103FLOPs /106Running time /s
      CAP1.19
      BCCR2.92
      DCP1.35
      DehazeNet8.15.11.29
      MSCNN8.04.82.14
      Proposed algorithm964.126.91.21
    Tools

    Get Citation

    Copy Citation Text

    Xiaoyu Wang, Yuhang Liu, Yan Zhang. Algorithm for Cloud Removal from Optical Remote Sensing Images Based on the Mechanism of Fusion and Refinement[J]. Laser & Optoelectronics Progress, 2024, 61(4): 0428012

    Download Citation

    EndNote(RIS)BibTexPlain Text
    Save article for my favorites
    Paper Information

    Category: Remote Sensing and Sensors

    Received: Nov. 14, 2022

    Accepted: Mar. 6, 2023

    Published Online: Feb. 20, 2024

    The Author Email: Wang Xiaoyu (wxyhit197745@sina.com), Liu Yuhang (lyhang95@163.com)

    DOI:10.3788/LOP223038

    Topics