Acta Optica Sinica, Volume. 41, Issue 12, 1228002(2021)

SAR-Assisted Optical Remote Sensing Image Cloud Removal Method Based on Deep Learning

Mengyao Wang, Xiangchao Meng*, Feng Shao**, and Randi Fu
Author Affiliations
  • Faculty of Electrical Engineering and Computer Science, Ningbo University, Ningbo, Zhejiang 315211, China
  • show less
    References(38)

    [1] Shen H F, Li X H, Cheng Q et al. Missing information reconstruction of remote sensing data: a technical review[J]. IEEE Geoscience and Remote Sensing Magazine, 3, 61-85(2015).

    [3] Rakwatin P, Takeuchi W, Yasuoka Y. Restoration of Aqua MODIS band 6 using histogram matching and local least squares fitting[J]. IEEE Transactions on Geoscience and Remote Sensing, 47, 613-627(2009).

    [8] Yu C, Chen L F, Su L et al. Kriging interpolation method and its application in retrieval of MODIS aerosol optical depth[C]∥2011 19th International Conference on Geoinformatics, June 24-26, 2011, Shanghai, China., 1-6(2011).

    [11] Shen H F, Zhang L P. A MAP-based algorithm for destriping and inpainting of remotely sensed images[J]. IEEE Transactions on Geoscience and Remote Sensing, 47, 1492-1502(2009).

    [15] Shen H F, Wu J G, Cheng Q et al. A spatiotemporal fusion based cloud removal method for remote sensing images with land cover changes[J]. IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing, 12, 862-874(2019).

    [18] Zhao S. The image restoration algorithm based on texture synthesis[D]. Chengdu: University of Electronic Science and Technology of China(2014).

    [19] Chen J, Jönsson P, Tamura M et al. A simple method for reconstructing a high-quality NDVI time-series data set based on the Savitzky-Golay filter[J]. Remote Sensing of Environment, 91, 332-344(2004).

    [24] Liu L, Lei B. Can SAR images and optical images transfer with each other?[C]∥2018 IEEE International Geoscience and Remote Sensing Symposium, July 22-27, 2018, Valencia, Spain., 7019-7022(2018).

    [26] Grohnfeldt C, Schmitt M, Zhu X X. A conditional generative adversarial network to fuse sar and multispectral optical data for cloud removal from Sentinel-2 images[C]∥2018 IEEE International Geoscience and Remote Sensing Symposium, July 22-27, 2018, Valencia, Spain., 1726-1729(2018).

    [27] Goodfellow I, Pouget-Abadie J, Mirza M et al. Generative adversarial nets. [C]∥Neural Information Processing Systems, December 8-13, 2014, Montreal, Canada. New York: Curran Associates, 2672-2680(2014).

    [31] Isola P, Zhu J Y, Zhou T H et al. Image-to-image translation with conditional adversarial networks[C]∥2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), July 21-26, 2017, Honolulu, HI, USA., 5967-5976(2017).

    [32] Zuhlke M, Fomferra N, Brockmann C et al. SNAP (Sentinel Application Platform) and the ESA Sentinel 3 Toolbox. [C]∥Sentinel-3 for Science Workshop, June 2-5, 2015, Venice, Italy. Oxford: ESA Special Publication(SP-734), 978, 21(2015).

    [34] Zeiler M D, Taylor G W, Fergus R. Adaptive deconvolutional networks for mid and high level feature learning[C]∥2011 International Conference on Computer Vision, November 6-13, 2011, Barcelona, Spain., 2018-2025(2011).

    [35] Ronneberger O, Fischer P, Brox T. U-net: convolutional networks for biomedical image segmentation. [C]∥Proceedings of the 18th International Conference on Medical Image Computing and Computer-Assisted Intervention, October 5-9, 2015, Munich, Germany. Lecture Notes in Electrical Engineering, Singapore: Springer, 9351, 234-241(2015).

    [36] Ioffe S, Szegedy C. Batch normalization: accelerating deep network training by reducing internal covariate shift. [C]∥Proceedings of the 32nd International Conference on Machine Learning(ICML), July 6-11, 2015, Lille, France. JMLR Workshop and Conference Proceedings, 37, 448-456(2015).

    [37] Wang Z, Bovik A C, Sheikh H R et al. Image quality assessment: from error visibility to structural similarity[J]. IEEE Transactions on Image Processing, 13, 600-612(2004).

    [38] Kingma D P. -12-22)[2020-10-18]. https:∥arxiv., org/abs/1412, 6980(2014).

    Tools

    Get Citation

    Copy Citation Text

    Mengyao Wang, Xiangchao Meng, Feng Shao, Randi Fu. SAR-Assisted Optical Remote Sensing Image Cloud Removal Method Based on Deep Learning[J]. Acta Optica Sinica, 2021, 41(12): 1228002

    Download Citation

    EndNote(RIS)BibTexPlain Text
    Save article for my favorites
    Paper Information

    Category: Remote Sensing and Sensors

    Received: Jan. 6, 2021

    Accepted: Feb. 1, 2021

    Published Online: Jun. 2, 2021

    The Author Email: Meng Xiangchao (mengxiangchao@nbu.edu.cn), Shao Feng (shaofeng@nbu.edu.cn)

    DOI:10.3788/AOS202141.1228002

    Topics