Optics and Precision Engineering, Volume. 32, Issue 3, 456(2024)

Light field angular reconstruction with joint Fourier convolution and channel attention

Tao ZHOU1, Mei YU1、*, Yeyao CHEN1, Zhidi JIANG2, and Gangyi JIANG1
Author Affiliations
  • 1Faculty of Information Science and Engineering, Ningbo University, Ningbo352, China
  • 2College of Information Engineering, College of Science and Technology Ningbo University, Ningbo3151, China
  • show less

    Light field cameras, capable of capturing both the intensity and direction of light, are utilized in applications like foreground occlusion removal and depth estimation. However, the limited size of imaging sensors restricts the simultaneous achievement of high spatial and angular resolution in light field images. This paper introduces a method combining Fourier convolution and channel attention for light field angular reconstruction, which indirectly creates dense light field images from sparse ones using reference views from the image's four corners. This method leverages the light field image's inherent 4D structure, employing channel⁃level dense fast Fourier residual convolution blocks to model the spatial and angular correlations in both spatial and frequency domains. Channel attention blocks, utilizing global response normalization, then adaptively fuse these channels. Furthermore, an enhanced viewpoint⁃weighted indirect synthesis approach is proposed, assigning a confidence map to each reference view to improve the synthesis of new, realistic views by establishing relationships between reference views. Experimental results demonstrate that our method outperforms the advanced light field angular reconstruction technique IRVAE, showing an average PSNR improvement of 0.08, 0.13, and 0.13 dB on the natural light field dataset 30Scenes, Occlusion, and Reflective, respectively, ensuring clear reconstruction results with angular consistency in the light field.

    Keywords
    Tools

    Get Citation

    Copy Citation Text

    Tao ZHOU, Mei YU, Yeyao CHEN, Zhidi JIANG, Gangyi JIANG. Light field angular reconstruction with joint Fourier convolution and channel attention[J]. Optics and Precision Engineering, 2024, 32(3): 456

    Download Citation

    EndNote(RIS)BibTexPlain Text
    Save article for my favorites
    Paper Information

    Category:

    Received: Aug. 7, 2023

    Accepted: --

    Published Online: Apr. 2, 2024

    The Author Email: Mei YU (yumei@nbu.edu.cn)

    DOI:10.37188/OPE.20243203.0456

    Topics