SAR-Assisted Optical Remote Sensing Image Cloud Removal Method Based on Deep Learning

Fig. 3. Results of simulation experiments. (a) SAR images; (b) real optical images; (c) simulated optical images contaminated by clouds; (d) experimental results of cGAN model; (e) experimental results of pix2pix model; (f) experimental results of cGAN+SSIM model; (g) experimental results of proposed model

Download full size

Fig. 4. Results of real experiments. (a) SAR images; (b) optical images without cloud cover in a similar time phase; (c) optical remote sensing images with cloud cover; (d) experimental results of cGAN model; (e) experimental results of pix2pix model; (f) experimental results of cGAN+SSIM model; (g) experimental results of proposed model

Download full size

Table 1. Information about simulated experiments and real experiments
View table
Table 1. Information about simulated experiments and real experiments
Dataset Simulated experiment Real experiment
SAR Optical Simulatedcorrupted optical SAR Similar timephase optical Real corruptedoptical
Obtain time 2020.04.29 2020.04.28 2020.04.28 2020.05.23 2020.05.13 2020.06.17

Table 2. Quantitative evaluation results of simulation experiments (mean and 95% confidence interval)

View table

Table 2. Quantitative evaluation results of simulation experiments (mean and 95% confidence interval)

Model		Proposed model	cGAN+SSIM	pix2pix	cGAN
SSIM	Mean	0.8655	$\bar{0.8604}$	0.8558	0.7241
	95% confidence interval	(0.860,0.871)	$\overset{0.855,0.866}{(}$	(0.850,0.861)	(0.718,0.730)
CC	Mean	0.8443	$\bar{0.8399}$	0.8349	0.3732
	95% confidence interval	(0.836,0.852)	$\overset{0.832,0.848}{(}$	(0.827,0.843)	(0.359,0.388)
PSNR	Mean	27.5886	$\bar{27.5141}$	27.3213	16.2218
	95% confidence interval	(27.218,27.960)	$\overset{27.126,27.902}{(}$	(26.937,27.705)	(16.158,16.285)
ERGAS	Mean	20.2244	$\bar{20.2382}$	20.8326	76.6522
	95% confidence interval	(19.640,20.809)	$\overset{19.630,20.846}{(}$	(20.208,21.457)	(72.501,80.803)
SAM	Mean	1.9194	2.0704	$\bar{2.0117}$	6.5556
	95% confidence interval	(1.874,1.965)	(2.028,2.113)	$\overset{1.979,2.056}{(}$	(6.415,6.696)

Table 3. Quantitative evaluation results of real experiments (mean and 95% confidence interval)

View table

Table 3. Quantitative evaluation results of real experiments (mean and 95% confidence interval)

Model		Proposed model	cGAN+SSIM	pix2pix	cGAN
SSIM	Mean	0.7467	$\bar{0.7371}$	0.7073	0.6149
	95% confidence interval	(0.737,0.756)	$\overset{0.728,0.747}{(}$	(0.697,0.718)	(0.601,0.629)
CC	Mean	0.5820	$\bar{0.5655}$	0.5455	0.4398
	95% confidence interval	(0.558,0.606)	$\overset{0.542,0.589}{(}$	(0.522,0.569)	(0.415,0.465)
PSNR	Mean	23.8033	$\bar{23.5446}$	23.3409	20.5477
	95% confidence interval	(23.448,24.158)	$\overset{23.199,23.891}{(}$	(22.998,23.684)	(20.215,20.880)
ERGAS	Mean	29.9719	$\bar{31.0080}$	31.4202	43.5042
	95% confidence interval	(28.981,30.963)	$\overset{30.062,31.955}{(}$	(30.453,32.388)	(42.023,44.986)
SAM	Mean	4.3423	4.7061	$\bar{4.5815}$	5.3864
	95% confidence interval	(4.202,4.483)	(4.570,4.842)	$\overset{4.440,4.723}{(}$	(5.213,5.560)

Tools

Get Citation

Copy Citation Text

Mengyao Wang, Xiangchao Meng, Feng Shao, Randi Fu. SAR-Assisted Optical Remote Sensing Image Cloud Removal Method Based on Deep Learning[J]. Acta Optica Sinica, 2021, 41(12): 1228002

Download Citation

EndNote(RIS)BibTex Plain Text

Set citation alerts for article

Save article for my favorites

Paper Information

Category: Remote Sensing and Sensors

Received: Jan. 6, 2021

Accepted: Feb. 1, 2021

Published Online: Jun. 2, 2021

The Author Email: Meng Xiangchao (mengxiangchao@nbu.edu.cn), Shao Feng (shaofeng@nbu.edu.cn)

DOI:10.3788/AOS202141.1228002

Topics

laser devices and laser physics

Lasers and Laser Optics

Laser physics

laser manufacturing

Instrumentation, Measurement and Metrology

Table 1. Information about simulated experiments and real experiments

Table 1. Information about simulated experiments and real experiments

Table 2. Quantitative evaluation results of simulation experiments (mean and 95% confidence interval)

Table 2. Quantitative evaluation results of simulation experiments (mean and 95% confidence interval)

Table 3. Quantitative evaluation results of real experiments (mean and 95% confidence interval)

Table 3. Quantitative evaluation results of real experiments (mean and 95% confidence interval)