Journal of Applied Optics, Volume. 45, Issue 5, 956(2024)

Light field images super-resolution based on sub-pixel and gradient guide

Wei WEI, Fen CHEN*, Huabo ZHANG, Yingguo LUO, Peng ZHANG, and Zongju PENG
Author Affiliations
  • School of Electronics and Electronic Information Engineering, Chongqing University of Technology, Chongqing 400054, China
  • show less
    Figures & Tables(12)
    Overall structure diagram of proposed network
    Sub-pixel information from surrounding view images
    Sub-pixel information in horizontal EPI
    Multiple sub-pixel information extraction blocks
    Spatial-angular enhanced self-attention layer
    Gradient fusion cross-attention layer
    Comparison of visual effects of different methods (scene Building_Decoded)
    Comparison of visual effects of different methods (scene Origami)
    • Table 1. PSNR(dB)/SSIM quantitative comparison of different methods 2× super-resolution

      View table
      View in Article

      Table 1. PSNR(dB)/SSIM quantitative comparison of different methods 2× super-resolution

      MethodScaleEPFLHCI_newHCI_oldINRIA_LytroStanford_Gantry
      Bicubic×229.88/0.902431.65/0.937337.46/0.969531.77/0.908630.75/0.9441
      VDSR×232.50/0.959834.37/0.956140.61/0.986734.44/0.974135.54/0.9789
      EDSR×233.09/0.962934.83/0.959241.01/0.987434.98/0.976436.30/0.9818
      ResLF×233.62/0.970636.69/0.973943.42/0.993235.39/0.980438.35/0.9904
      LFSSR×233.67/0.974436.80/0.974943.81/0.993835.28/0.983237.94/0.9898
      LFSSR-ATO×234.27/0.975737.24/0.976744.21/0.994236.17/0.984239.64/0.992 9
      LF-Inter×234.11/0.976037.17/0.976344.57/0.994 635.83/0.984338.43/0.9909
      MEG-Net×234.31/0.977337.42/0.977744.10/0.994236.10/0.984938.77/0.9914
      DPT×234.49/0.975837.35/0.977 144.30/0.994336.41/0.984339.43/0.9926
      Proposed×234.53/0.976 437.64/0.978544.65/0.994636.43/0.984 839.89/0.9933
    • Table 2. PSNR(dB)/SSIM quantitative comparison of different methods 4× super-resolution

      View table
      View in Article

      Table 2. PSNR(dB)/SSIM quantitative comparison of different methods 4× super-resolution

      MethodScaleEPFLHCI_newHCI_oldINRIA_LytroStanford_Gantry
      Bicubic×425.46/0.771127.58/0.863632.42/0.914327.30/0.805825.91/0.8322
      VDSR×427.25/0.877729.31/0.882334.81/0.951529.76/0.920428.51/0.9001
      EDSR×427.83/0.885429.59/0.886935.18/0.953629.65/0.925628.70/0.9072
      ResLF×428.26/0.903530.72/0.910736.71/0.968230.34/0.941230.19/0.9372
      LFSSR×428.60/0.911230.93/0.914536.91/0.969630.59/0.946830.57/0.9426
      LFSSR-ATO×428.51/0.911530.88/0.913537.00/0.969930.71/0.948430.61/0.9430
      LF-Inter×428.81/0.916230.96/0.916137.15/0.971630.78/0.949130.36/0.9409
      MEG-Net×428.75/0.916031.10/0.917737.29/0.971630.67/0.949030.77/0.9453
      DPT×428.94/0.917031.20/0.918 837.41/0.972 130.96/0.950 331.15/0.948 8
      Proposed×428.88/0.918031.34/0.921237.55/0.972931.01/0.951331.25/0.9500
    • Table 3. Comparison of 2× super-resolution model parameters, Flops and PSNR/SSIM

      View table
      View in Article

      Table 3. Comparison of 2× super-resolution model parameters, Flops and PSNR/SSIM

      MethodParams/MFlops/GPSNR (dB)/SSIM
      EDSR38.62988.4736.04/0.9735
      ResLF8.6537.0637.49/0.9817
      LF-Inter5.0442.3338.02/0.9844
      MEG-Net1.6948.3938.14/0.9851
      LFSSR-ATO1.22453.0338.31/0.9847
      DPT3.6657.3238.40/0.9848
      Proposed4.5179.0438.63/0.9855
    • Table 4. Comparison of ablation experiment

      View table
      View in Article

      Table 4. Comparison of ablation experiment

      Gradient branchMain branchParams/MFlops/GPSNR (dB)/SSIM
      ResASPP+RBMSPIEResASPP+RBMSPIE
      2.5747.4833.54/0.9740
      2.9958.3533.95/0.9758
      3.6657.3233.80/0.9748
      4.0968.1834.02/0.9755
      4.5179.0434.17/0.9760
    Tools

    Get Citation

    Copy Citation Text

    Wei WEI, Fen CHEN, Huabo ZHANG, Yingguo LUO, Peng ZHANG, Zongju PENG. Light field images super-resolution based on sub-pixel and gradient guide[J]. Journal of Applied Optics, 2024, 45(5): 956

    Download Citation

    EndNote(RIS)BibTexPlain Text
    Save article for my favorites
    Paper Information

    Category:

    Received: Jun. 25, 2023

    Accepted: --

    Published Online: Dec. 20, 2024

    The Author Email: Fen CHEN (陈芬)

    DOI:10.5768/JAO202445.0502003

    Topics