Laser & Optoelectronics Progress, Volume. 61, Issue 8, 0837007(2024)

Depth Image Super-Resolution Reconstruction Network Based on Dual Feature Fusion Guidance

Haowen Geng, Yu Wang*, and Yanling Xin
Author Affiliations
  • College of Information Science and Engineering, Changchun University of Science and Technology, Changchun 130012, Jilin , China
  • show less

    A depth image super-resolution reconstruction network (DF-Net) based on dual feature fusion guidance is proposed to address the issues of texture transfer and depth loss in color image guided deep image super-resolution reconstruction algorithms. To fully utilize the correlation between depth and intensity features, a dual channel fusion module (DCM) and a dual feature guided reconstruction module (DGM) are used to perform deep recovery and reconstruction in the network model. The multi-scale features of depth and intensity information are extracted using a input pyramid structure: DCM performs feature fusion and enhancement between channels based on a channel attention mechanism for depth and intensity features; DGM provides dual feature guidance for reconstruction by adaptively selecting and fusing depth and intensity features, increasing the guidance effect of depth features, and overcoming the issues of texture transfer and depth loss. The experimental results show that the peak signal-to-noise ratio (PSNR) and root mean square error (RMSE) of the proposed method are superior to those of methods such as RMRF, JBU, and Depth Net. Compared to the other methods, the PSNR value of the 4× super-resolution reconstruction results increased by an average of 6.79 dB, and the RMSE decreased by an average of 0.94, thus achieving good depth image super-resolution reconstruction results.

    Tools

    Get Citation

    Copy Citation Text

    Haowen Geng, Yu Wang, Yanling Xin. Depth Image Super-Resolution Reconstruction Network Based on Dual Feature Fusion Guidance[J]. Laser & Optoelectronics Progress, 2024, 61(8): 0837007

    Download Citation

    EndNote(RIS)BibTexPlain Text
    Save article for my favorites
    Paper Information

    Category: Digital Image Processing

    Received: Feb. 8, 2023

    Accepted: Apr. 3, 2023

    Published Online: Apr. 2, 2024

    The Author Email: Wang Yu (muxie2002@126.com)

    DOI:10.3788/LOP230593

    Topics