A Method for Cloud Removal Using Optical and Synthetic Aperture Radar Image Fusion

Xunqiang Gong; Qirui Fang; Zhaoyang Hou; Zhihua Zhang; Yuanping Xia

doi:10.3788/AOS240550

Acta Optica Sinica, Volume. 44, Issue 24, 2428003(2024)

A Method for Cloud Removal Using Optical and Synthetic Aperture Radar Image Fusion

Xunqiang Gong^1,2,3, Qirui Fang¹, Zhaoyang Hou⁴, Zhihua Zhang⁵, and Yuanping Xia^1、*

¹Key Laboratory of Regional Mining Environmental Monitoring and Control of Poyang Lake, Ministry of Natural Resources, East China University of Technology, Nanchang 330013, Jiangxi , China

²State Key Laboratory of Information Engineering in Surveying, Mapping, and Remote Sensing, Wuhan University, Wuhan 430079, Hubei , China

³Jiangxi Academy of Eco-Environmental Sciences and Planning, Nanchang 330039, Jiangxi , China

⁴Faculty of Geomatics, Lanzhou Jiaotong University, Lanzhou 730070, Gansu , China

⁵The Sixth Geological Brigade, Jiangxi Bureau of Geology, Yingtan 335000, Jiangxi , China

show less

Abstract Get PDF(in Chinese)

Figures & Tables(13)

Fig. 1. Flowchart of cloud removal

Download full size

Fig. 2. Cloud removal results of each method in the first set of experiment. (a) Panchromatic image; (b) SAR image; (c) AHF; (d) S-EBII; (e) NSST-PAPCNN; (f) WA-PAPCNN; (g) MSF; (h) LLVF; (i) HF-BF; (j) HF-PCNN; (k) LF-WA; (l) proposed method

Download full size

Fig. 3. Cloud removal results of each method in the second set of experiment. (a) Panchromatic image; (b) SAR image; (c) AHF; (d) S-EBII; (e) NSST-PAPCNN; (f) WA-PAPCNN; (g) MSF; (h) LLVF; (i) HF-BF; (j) HF-PCNN; (k) LF-WA; (l) proposed method

Download full size

Fig. 4. Cloud removal results of each method in the third set of experiment. (a) Panchromatic image; (b) SAR image; (c) AHF; (d) S-EBII; (e) NSST-PAPCNN; (f) WA-PAPCNN; (g) MSF; (h) LLVF; (i) HF-BF; (j) HF-PCNN; (k) LF-WA; (l) proposed method

Download full size

Fig. 5. Cloud removal results of each method in the fourth set of experiment. (a) Panchromatic image; (b) SAR image; (c) AHF; (d) S-EBII; (e) NSST-PAPCNN; (f) WA-PAPCNN; (g) MSF; (h) LLVF; (i) HF-BF; (j) HF-PCNN; (k) LF-WA; (l) proposed method

Download full size

Fig. 6. Cloud removal results of each method in the fifth set of experiment. (a) Panchromatic image; (b) SAR image; (c) AHF; (d) S-EBII; (e) NSST-PAPCNN; (f) WA-PAPCNN; (g) MSF; (h) LLVF; (i) HF-BF; (j) HF-PCNN; (k) LF-WA; (l) proposed method

Download full size

Fig. 7. Cloud removal results of each method in the sixth set of experiment. (a) Panchromatic image; (b) SAR image; (c) AHF; (d) S-EBII; (e) NSST-PAPCNN; (f) WA-PAPCNN; (g) MSF; (h) LLVF; (i) HF-BF; (j) HF-PCNN; (k) LF-WA; (l) proposed method

Download full size

Table 1. Quantitative evaluation results of the first set of experiment

View table

Table 1. Quantitative evaluation results of the first set of experiment

Method	EN	AG	SF	SSIM	PSNR	RMSE
AHF	6.676	8.232	19.110	0.286	12.245	63.150
S-EBII	7.595	12.238	22.559	0.488	12.644	60.942
NSST-PAPCNN	7.626	11.942	22.183	0.529	13.281	55.322
WA-PAPCNN	6.464	12.741	22.251	0.388	12.204	62.603
MSF	7.229	12.044	22.665	0.543	13.176	62.094
LLVF	7.376	12.703	21.140	0.531	13.304	63.575
HF-BF	7.407	12.715	22.642	0.541	13.325	55.352
HF-PCNN	7.652	11.947	22.613	0.515	13.226	55.628
LF-WA	6.481	11.050	21.557	0.409	12.506	60.437
Proposed	7.668	12.745	22.951	0.558	13.369	54.916

Table 2. Quantitative evaluation results of the second set of experiment

View table

Table 2. Quantitative evaluation results of the second set of experiment

Method	EN	AG	SF	SSIM	PSNR	RMSE
AHF	6.848	6.228	13.921	0.364	12.302	61.921
S-EBII	7.263	10.283	19.693	0.507	14.982	46.064
NSST-PAPCNN	7.252	13.690	24.496	0.590	14.748	47.087
WA-PAPCNN	6.782	12.807	23.188	0.490	13.067	57.573
MSF	7.249	13.864	25.178	0.532	10.026	59.384
LLVF	7.264	15.190	26.494	0.553	9.552	57.063
HF-BF	7.104	14.317	26.107	0.513	9.692	58.940
HF-PCNN	7.255	11.482	21.463	0.583	14.673	47.413
LF-WA	6.791	14.076	25.470	0.508	13.365	56.353
Proposed	7.343	15.223	26.961	0.613	15.049	46.191

Table 3. Quantitative evaluation results of the third set of experiment

View table

Table 3. Quantitative evaluation results of the third set of experiment

Method	EN	AG	SF	SSIM	PSNR	RMSE
AHF	7.042	7.373	16.389	0.395	12.985	58.002
S-EBII	7.329	10.394	19.893	0.479	14.972	46.824
NSST-PAPCNN	7.344	14.275	25.545	0.572	15.158	44.532
WA-PAPCNN	6.883	13.472	24.440	0.472	13.370	55.048
MSF	7.147	11.115	20.966	0.555	13.986	45.541
LLVF	7.280	13.967	24.889	0.589	13.293	45.980
HF-BF	7.331	14.361	26.647	0.592	13.170	46.431
HF-PCNN	7.346	12.435	23.105	0.571	15.206	44.283
LF-WA	6.891	14.908	26.894	0.493	13.649	53.838
Proposed	7.433	15.986	28.210	0.596	15.304	44.045

Table 4. Quantitative evaluation results of the fourth set of experiment

View table

Table 4. Quantitative evaluation results of the fourth set of experiment

Method	EN	AG	SF	SSIM	PSNR	RMSE
AHF	7.354	6.451	14.575	0.384	11.466	68.958
S-EBII	7.428	15.601	27.467	0.542	13.204	59.865
NSST-PAPCNN	7.448	15.605	27.414	0.547	13.069	60.473
WA-PAPCNN	7.060	14.883	26.582	0.477	11.522	70.374
MSF	7.504	11.606	22.457	0.493	13.821	59.855
LLVF	7.242	12.137	22.503	0.525	13.205	59.868
HF-BF	7.212	12.510	23.030	0.549	12.631	58.353
HF-PCNN	7.476	14.245	25.637	0.554	13.355	59.396
LF-WA	7.070	16.415	29.284	0.495	12.013	68.164
Proposed	7.535	17.444	30.427	0.577	13.877	58.029

Table 5. Quantitative evaluation results of the fifth set of experiment

View table

Table 5. Quantitative evaluation results of the fifth set of experiment

Method	EN	AG	SF	SSIM	PSNR	RMSE
AHF	6.141	5.762	18.616	0.267	9.149	89.617
S-EBII	7.290	6.821	14.559	0.439	10.530	75.863
NSST-PAPCNN	7.356	12.124	24.951	0.557	13.064	62.644
WA-PAPCNN	6.960	11.460	24.030	0.484	11.549	71.144
MSF	7.279	10.358	22.044	0.540	9.362	61.486
LLVF	7.401	12.701	25.947	0.562	8.957	60.438
HF-BF	7.168	10.692	23.789	0.537	9.036	61.814
HF-PCNN	7.384	9.510	19.130	0.555	13.094	62.389
LF-WA	6.957	12.187	26.244	0.490	11.861	69.785
Proposed	7.427	13.018	27.446	0.578	13.939	60.355

Table 6. Quantitative evaluation results of the sixth set of experiment

View table

Table 6. Quantitative evaluation results of the sixth set of experiment

Method	EN	AG	SF	SSIM	PSNR	RMSE
AHF	5.867	6.597	20.699	0.265	10.969	72.691
S-EBII	7.259	6.771	15.205	0.500	13.895	51.497
NSST-PAPCNN	7.344	10.058	20.867	0.593	14.170	50.761
WA-PAPCNN	6.882	9.563	19.929	0.478	12.479	61.205
MSF	7.292	8.073	17.343	0.575	13.284	48.967
LLVF	7.350	10.507	21.479	0.591	12.401	49.288
HF-BF	7.319	9.787	21.447	0.588	12.403	50.243
HF-PCNN	7.314	7.746	16.305	0.584	14.104	50.888
LF-WA	6.878	10.130	21.585	0.490	12.611	60.553
Proposed	7.396	10.743	22.630	0.611	14.349	48.152

Tools

Get Citation

Copy Citation Text

Xunqiang Gong, Qirui Fang, Zhaoyang Hou, Zhihua Zhang, Yuanping Xia. A Method for Cloud Removal Using Optical and Synthetic Aperture Radar Image Fusion[J]. Acta Optica Sinica, 2024, 44(24): 2428003

Download Citation

EndNote(RIS)BibTex Plain Text

Set citation alerts for article

Save article for my favorites

Paper Information

Category: Remote Sensing and Sensors

Received: Jan. 23, 2024

Accepted: Apr. 30, 2024

Published Online: Dec. 17, 2024

The Author Email: Xia Yuanping (ypxia@ecut.edu.cn)

DOI:10.3788/AOS240550

Topics

laser devices and laser physics

Lasers and Laser Optics

Laser physics

laser manufacturing

Instrumentation, Measurement and Metrology