Researching | Semantic Segmentation of Dual-Source Remote Sensing Images Based on Gated Attention and Multiscale Residual Fusion

Laser & Optoelectronics Progress, Volume. 61, Issue 18, 1837015(2024)

Semantic Segmentation of Dual-Source Remote Sensing Images Based on Gated Attention and Multiscale Residual Fusion

Wen Guo¹, Hong Yang¹, and Chang Liu^2、*

Author Affiliations

¹School of science, Beijing Information Science and Technology University, Beijing 100029, China

²Institute of Applied Mathematics, Beijing Information Science and Technology University, Beijing 100101, China

show less

Abstract Get PDF(in Chinese)

Figures&Tables (12)

References (31)

Paper Information

References(31)

[1] Hu K, Zhang E W, Xia M et al. MCANet: a multi-branch network for cloud/snow segmentation in high-resolution remote sensing images[J]. Remote Sensing, 15, 1055(2023).

[2] Gao J H, Weng L G, Xia M et al. MLNet: multichannel feature fusion lozenge network for land segmentation[J]. Journal of Applied Remote Sensing, 16, 016513(2022).

[3] Hu K, Zhang D S, Xia M et al. LCDNet: light-weighted cloud detection network for high-resolution remote sensing images[J]. IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing, 15, 4809-4823(2022).

[4] Yang L, Wang H, Li S et al. Multi-source data building extraction method combined with DeepLabv3 architecture[J]. Geomatics & Spatial Information Technology, 43, 62-66(2020).

[5] Jiang J D, Zheng L N, Luo F et al. RedNet: residual encoder-decoder network for indoor RGB-D semantic segmentation[EB/OL]. http://arxiv.org/abs/1806.01054v2

[6] Yang J, Wang Y Y, Ai D N et al. Developments of multimodal image-guided surgical navigation[J]. Acta Optica Sinica, 43, 1500002(2023).

[7] Dai D C, Zheng L N, Zhang Y et al. Sharpness detection method for aerial camera images based on digital elevation model[J]. Acta Optica Sinica, 43, 0610001(2023).

[8] Yu Z W, Zhang N, Pan Y et al. Heterogeneous image matching based on improved SIFT algorithm[J]. Laser & Optoelectronics Progress, 59, 1211002(2022).

[9] Wang H T, Lei X D, Zhao Z Z. 3D deep learning classification method for airborne LiDAR point clouds fusing spectral information[J]. Laser & Optoelectronics Progress, 57, 122802(2020).

[10] Sun W W, Wang R S. Fully convolutional networks for semantic segmentation of very high resolution remotely sensed images combined with DSM[J]. IEEE Geoscience and Remote Sensing Letters, 15, 474-478(2018).

[11] Zhang Y, Zhu G Y, Shi T J et al. Small object detection in remote sensing images based on feature fusion and attention[J]. Acta Optica Sinica, 42, 2415001(2022).

[12] Hazirbas C, Ma L N, Domokos C, Lai S H, Lepetit V, Nishino K et al. FuseNet: incorporating depth into semantic segmentation via fusion-based CNN architecture[M]. Computer vision-ACCV 2016.Lecture notes in computer science, 10111, 213-228(2017).

[13] Cao Z Y, Fu K, Lu X D et al. End-to-end DSM fusion networks for semantic segmentation in high-resolution aerial images[J]. IEEE Geoscience and Remote Sensing Letters, 16, 1766-1770(2019).

[14] Audebert N, Le Saux B, Lefèvre S. Beyond RGB: Very high resolution urban remote sensing with multimodal deep networks[J]. ISPRS Journal of Photogrammetry and Remote Sensing, 140, 20-32(2018).

[15] Xing Y J, Wang J B, Chen X K et al. 2.5D convolution for RGB-D semantic segmentation[C], 1410-1414(2019).

[16] Zou R P, Zhu B, Wang C Y et al. Heterogeneous remote sensing image matching algorithm based on residual pseudo-Siamese convolution cross-correlation network[J]. Laser & Optoelectronics Progress, 59, 1228002(2022).

[17] Long J, Shelhamer E, Darrell T. Fully convolutional networks for semantic segmentation[C], 3431-3440(2017).

[18] Chen L C, Papandreou G, Kokkinos I et al. DeepLab: semantic image segmentation with deep convolutional nets, atrous convolution, and fully connected CRFs[J]. IEEE Transactions on Pattern Analysis and Machine Intelligence, 40, 834-848(2018).

[19] Zhao H S, Shi J P, Qi X J et al. Pyramid scene parsing network[C], 6230-6239(2017).

[20] Chen L C, Zhu Y K, Papandreou G, Ferrari V, Hebert M, Sminchisescu C et al. Encoder-decoder with atrous separable convolution for semantic image segmentation[M]. Computer vision-ECCV 2018. Lecture notes in computer science, 11211, 833-851(2018).

[21] Fu J, Liu J, Tian H J et al. Dual attention network for scene segmentation[C], 3141-3149(2019).

[22] Wu D Y H, Lin D N, Chen V et al. Associated learning: an alternative to end-to-end backpropagation that works on cnn, rnn, and transformer[EB/OL]. https://openreview.net/forum?id=4N-17dske79

[23] Dosovitskiy A, Beyer L, Kolesnikov A et al. An image is worth 16 x 16 words: transformers for image recognition at scale[EB/OL]. https://arxiv.org/abs/2010.11929

[24] Gao L, Liu H, Yang M H et al. STransFuse: fusing swin transformer and convolutional neural network for remote sensing image semantic segmentation[J]. IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing, 14, 10990-11003(2021).

[25] Chen J N, Lu Y Y, Yu Q H et al. TransUNet: transformers make strong encoders for medical image segmentation[EB/OL]. http://arxiv.org/abs/2102.04306v1

[26] Cao H, Wang Y Y, Chen J, Karlinsky L, Michaeli T, Nishino K et al. Swin-Unet: unet-like pure transformer for medical image segmentation[M]. Computer vision-ECCV 2022 workshops.Lecture notes in computer science, 13803, 205-218(2023).

[27] Liu Z, Lin Y T, Cao Y et al. Swin transformer: hierarchical vision transformer using shifted windows[C], 9992-10002(2021).

[28] Cheng R J, Yang Y, Li L W et al. Lightweight residual network based on depthwise separable convolution for hyperspectral image classification[J]. Acta Optica Sinica, 43, 1228010(2023).

[29] Hochreiter S, Schmidhuber J. Long short-term memory[J]. Neural Computation, 9, 1735-1780(1997).

[30] Chollet F. Xception: deep learning with depthwise separable convolutions[C], 1800-1807(2017).

[31] Xiao T T, Liu Y C, Zhou B L, Ferrari V, Hebert M, Sminchisescu C et al. Unified perceptual parsing for scene understanding[M]. Computer vision-ECCV 2018.Lecture notes in computer science, 11209, 432-448(2018).

Tools

Get Citation

Copy Citation Text

Wen Guo, Hong Yang, Chang Liu. Semantic Segmentation of Dual-Source Remote Sensing Images Based on Gated Attention and Multiscale Residual Fusion[J]. Laser & Optoelectronics Progress, 2024, 61(18): 1837015

Download Citation

EndNote(RIS)BibTex Plain Text

Set citation alerts for article

Save article for my favorites

Paper Information

Category: Digital Image Processing

Received: Jan. 15, 2024

Accepted: Feb. 26, 2024

Published Online: Sep. 14, 2024

The Author Email: Chang Liu (liuchang@bistu.edu.cn)

DOI:10.3788/LOP240534

CSTR:32186.14.LOP240534

Topics

laser devices and laser physics

Lasers and Laser Optics

laser manufacturing

Instrumentation, Measurement and Metrology