Chinese Journal of Lasers, Volume. 50, Issue 15, 1507107(2023)

Super‐Resolution Reconstruction of OCT Image Based on Pyramid Long‐Range Transformer

Yanqi Lu, Minghui Chen*, Kaibo Qin, Yuquan Wu, Zhijie Yin, and Zhengqi Yang
Author Affiliations
  • Shanghai Engineering Research Center of Interventional Medical Device, the Ministry of Education of Medical Optical Engineering Center, School of Health Sciences and Engineering, University of Shanghai for Science and Technology, Shanghai 200093, China
  • show less
    Figures & Tables(13)
    Whole frame of TESR
    Edge enhancement module. (a) Four kinds of trainable Sobel operators; (b) process of our module
    Comparison of traditional Transformer module (left) and PLT module (right)
    Shift-convolution
    Diagrams of P-MHSA. (a) Self-attention mechanism; (b) multi-head attention (MHA); (c) P-MHSA
    Image reconstruction. (a) Overall module; (b) schematic of sub-pixel convolution layer
    Image down-sampling (DSF: down-sampling factor)
    Process and visualization of CutBlur
    Loss function curve
    Super-resolution reconstruction images of a normal retinal OCT image by different models. (a) HR image; (b) TESR reconstructed image; (c) detail of HR image; (d)–(h) local reconstruction effect of SRGAN, RCAN, IPT, SwinIR and TESR
    Super-resolution reconstruction results of a pathological retina OCT images by different models. (a) HR image; (b) TESRreconstructed image; (c) detail of HR image; (d)-(h) local reconstruction effect of SRGAN, RCAN, IPT, SwinIR and TESR
    • Table 1. Average PSNR and SSIM values of various super- resolution models reconstructed images

      View table

      Table 1. Average PSNR and SSIM values of various super- resolution models reconstructed images

      ScaleModelDataset 1Dataset 2
      PSNR /dBSSIMPSNR /dBSSIM
      SRGAN33.050.895032.480.9090
      RCAN32.410.892032.420.8900
      IPT33.760.900534.350.8998
      SwinIR34.830.913034.280.9096
      TESR(ours)35.530.912435.120.9140
      SRGAN30.960.799830.370.7814
      RCAN30.920.791431.350.7928
      IPT31.830.811231.760.8068
      SwinIR32.290.827932.130.8114
      TESR(ours)32.910.845232.770.8309
    • Table 2. Average LPIPS value of reconstructed images by various super-resolution models after 4× reconstruction

      View table

      Table 2. Average LPIPS value of reconstructed images by various super-resolution models after 4× reconstruction

      ScaleModelLPIPS value
      Dataset 1Dataset 2
      SRGAN0.2140.298
      RCAN0.2650.306
      IPT0.2030.215
      SwinIR0.1700.144
      TESR(ours)0.1560.147
    Tools

    Get Citation

    Copy Citation Text

    Yanqi Lu, Minghui Chen, Kaibo Qin, Yuquan Wu, Zhijie Yin, Zhengqi Yang. Super‐Resolution Reconstruction of OCT Image Based on Pyramid Long‐Range Transformer[J]. Chinese Journal of Lasers, 2023, 50(15): 1507107

    Download Citation

    EndNote(RIS)BibTexPlain Text
    Save article for my favorites
    Paper Information

    Category: Biomedical Optical Imaging

    Received: Mar. 16, 2023

    Accepted: Apr. 23, 2023

    Published Online: Aug. 8, 2023

    The Author Email: Chen Minghui (cmhui.43@163.com)

    DOI:10.3788/CJL230624

    Topics