Acta Photonica Sinica, Volume. 53, Issue 10, 1028001(2024)

Remote Sensing Image Fusion Based on Joint Spectral and Spatial Dual-scale Detail Injection

Shuxiang WANG1, Fei JIN1、*, Yuzhun LIN1, Jie RUI1, Xibing ZUO1, Xiao LIU1, and Xiaobing YANG2
Author Affiliations
  • 1Institute of Geospatial Information, Information Engineering University, Zhengzhou 450001, China
  • 232020 Troops of People's Liberation Army of China, Wuhan 430000, China
  • show less
    References(28)

    [1] WALD L, RANCHIN T, MANGOLINI M. Fusion of satellite images of different spatial resolutions: assessing the quality of resulting images[J]. Photogrammetric Engineering and Remote Sensing, 63, 691-699(1997).

    [2] LI Shutao, LI Conghao, KANG Xudong. Development status and future prospects of multi-source remote sensing image fusio[J]. National Remote Sensing Bulletin, 25, 148-166(2021).

    [3] RAHMANI S, STRAIT M, MERKURJEW D et al. An adaptive IHS pan-sharpening method[J]. IEEE Geoscience and Remote Sensing Letters, 7, 746-750(2010).

    [4] AIAZZI B, BAROMTI S, SELVA M. Improving component substitution pansharpening through multivariate regression of MS + Pan data[J]. IEEE Transactions on Geoscience and Remote Sensing, 45, 3230-3239(2007).

    [5] MALLAT S G. A theory for multiresolution signal decomposition: the wavelet representation[J]. IEEE Transactions on Pattern Analysis and Machine Intelligence, 11, 674-693(1989).

    [6] CHOI M, KIM R Y, NAM M R et al. Fusion of multispectral and panchromatic satellite images using the curvelet transform[J]. IEEE Geoscience and Remote Sensing Letters, 2, 136-140(2005).

    [7] AIAZZI B, ALPARONE L, BARONTI S et al. MTF-tailored multiscale fusion of high-resolution MS and Pan imagery[J]. Photogrammetric Engineering & Remote Sensing, 72, 591-596(2006).

    [8] FU Xueyang, LIN Zihuang, HUANG Yue et al. A variational pan-sharpening with local gradient constraints[C], 10265-10274(2019).

    [9] DENG Liangjian, FENG Minyu, TAI Xuecheng. The fusion of panchromatic and multispectral remote sensing images via tensor-based sparse modeling and hyper-Laplacian prior[J]. Information Fusion, 52, 76-89(2017).

    [10] LU Hangyuan, YANG Yong, HUANG Shuying et al. A unified pansharpening model based on band-adaptive gradient and detail correction[J]. IEEE Transactions on Image Processing, 31, 918-933(2021).

    [11] LEE J, SEO S, KIM M. Sipsa-net: Shift-invariant pan sharpening with moving object alignment for satellite imagery[C], 10166-10174(2021).

    [12] MASI G, COZZOLINO D, VERDOLIVA L et al. Pansharpening by convolutional neural networks[J]. Remote Sensing, 8, 594(2016).

    [13] YANG Junfeng, FU Xueyang, HU Yuwen et al. PanNet: A deep network architecture for pan-sharpening[C], 5449-5457(2017).

    [14] ZHOU Huanyu, LIU Qingjie, WENG Dawei et al. Unsupervised cycle-consistent generative adversarial networks for Pan sharpening[J]. IEEE Transactions on Geoscience and Remote Sensing, 60, 1-14(2022).

    [15] YANG Yong, SU Zhao, HUANG Shuying et al. Survey of deep-learning approaches for pixel-level pansharpening[J]. National Remote Sensing Bulletin, 26, 2411-2432(2022).

    [16] HE Lin, RAO Yizhou, LI Jun et al. Pansharpening via detail injection based convolutional neural networks[J]. IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing, 12, 1188-1204(2019).

    [17] ZHANG Yongjun, LIU Chi, SUN Mingwei et al. Pan-sharpening using an efficient bidirectional pyramid network[J]. IEEE Transactions on Geoscience and Remote Sensing, 57, 5549-5563(2019).

    [18] ZHANG Hao, WANG Hebaixu, TIAN Xin et al. P2Sharpen: A progressive pansharpening network with deep spectral transformation[J]. Information Fusion, 91, 103-122(2023).

    [19] DENG Liangjian, RAN Ran, WU Xiao et al. CNN-based remote sensing pan-sharpening: a critical review[J]. Journal of Image and Graphics, 28, 57-79(2023).

    [20] HE Kaiming, SUN Jian, TANG Xiaoou. Guided image filtering[J]. IEEE Transactions on Pattern Analysis and Machine Intelligence, 35, 1397-1409(2012).

    [21] WANG Mi, HE Luxiao, CHENG Yufeng et al. Panchromatic and multispectral fusion method combined with adaptive gaussian filter and SFIM model[J]. Acta Geodaetica et Cartographica Sinica, 47, 82-90(2018).

    [22] WANG Peng, YAO Hongyu, LI Cai et al. Multiresolution analysis based on dual-scale regression for pansharpening[J]. IEEE Transactions on Geoscience and Remote Sensing, 60, 1-19(2021).

    [23] TANG Linfeng, ZHANG Hao, XU Han et al. Deep learning-based image fusion: a survey[J]. Journal of Image and Graphics, 28, 3-36(2023).

    [24] LEUNG Yee, LIU Junmin, ZHANG Jiangshe. An improved adaptive intensity-hue-saturation method for the fusion of remote sensing images[J]. IEEE Geoscience and Remote Sensing Letters, 11, 985-989(2013).

    [25] YANG Yong, LU Hangyuan, HUANC Shuying et al. Remote sensing image fusion method based on adaptive injection model[J]. Joumalof Beijing University of Aeronautics and Astronautics, 45, 2351-2363(2019).

    [26] CHOI Jaewan, PARK Honglyun, SEO Doochun. Pansharpening using guided filtering to improve the spatial clarity of VHR satellite imagery[J]. Remote Sensing, 11, 633(2019).

    [27] LUO Shuyue, ZHOU Shangbo, QIANG Baohua. A novel adaptive fast IHS transform fusion method driven by regional spectral characteristics for Gaofen-2 imagery[J]. International Journal of Remote Sensing, 41, 1321-1337(2020).

    [28] MENG Xiangchao, XIONG Yiming, SHAO Feng et al. A large-scale benchmark data set for evaluating pansharpening performance: overview and implementation[J]. IEEE Geoscience and Remote Sensing Magazine, 9, 18-52(2021).

    Tools

    Get Citation

    Copy Citation Text

    Shuxiang WANG, Fei JIN, Yuzhun LIN, Jie RUI, Xibing ZUO, Xiao LIU, Xiaobing YANG. Remote Sensing Image Fusion Based on Joint Spectral and Spatial Dual-scale Detail Injection[J]. Acta Photonica Sinica, 2024, 53(10): 1028001

    Download Citation

    EndNote(RIS)BibTexPlain Text
    Save article for my favorites
    Paper Information

    Category: Remote Sensing and Sensors

    Received: Feb. 29, 2024

    Accepted: Apr. 16, 2024

    Published Online: Dec. 5, 2024

    The Author Email: Fei JIN (jf371@sina.com)

    DOI:10.3788/gzxb20245310.1028001

    Topics