Laser & Optoelectronics Progress, Volume. 61, Issue 16, 1611006(2024)

Dynamic Light Field Reconstruction Based on Gradient Descent Deep Equilibrium Model (Invited)

Ruixue Wang1, Xue Wang1, Guoqing Zhou1, Zhaolin Xiao2, and Qing Wang1、*
Author Affiliations
  • 1School of Computer Science, Northwestern Polytechnical University, Xi'an 710072, Shaanxi, China
  • 2School of Computer Science and Engineering, Xi'an University of Technology, Xi'an 710048, Shaanxi, China
  • show less

    In response to snapshot compressive imaging (SCI) in dynamic light field temporal domain, a method called dynamic light field deep equilibrium (DLFDEQ) was proposed to reconstruct high-quality dynamic light field image frames (5D data) from known encoding patterns and acquired snapshot compressed measurements (4D data). First, based on compressive sensing, the same compression encoding for each viewpoint of dynamic light field image frames in the temporal domain was adopted. Second, the reconstruction process of compressive measurements was modeled as an inverse problem with an implicit regularization term. Finally, the inverse problem was solved through a deep equilibrium model based on gradient descent (DEQ-GD). The DEQ-GD model allows for the stable reconstruction of the required dynamic light field image frames from snapshot compressive measurements. Experimental results demonstrate that proposed method can recover a 5×5 viewpoints dynamic light field composed of 4 frames of images from a single snapshot light field measurement of a 5×5 viewpoints. Compared with the current state-of-the-art methods, proposed method demonstrates stronger robustness and preserves more accurate details in the reconstructed dynamic light field image frames. By repeatedly capturing and recovering these compressive measurement values, the temporal frame rate of reconstructed image is 4 times of the original camera frame rate.

    Keywords
    Tools

    Get Citation

    Copy Citation Text

    Ruixue Wang, Xue Wang, Guoqing Zhou, Zhaolin Xiao, Qing Wang. Dynamic Light Field Reconstruction Based on Gradient Descent Deep Equilibrium Model (Invited)[J]. Laser & Optoelectronics Progress, 2024, 61(16): 1611006

    Download Citation

    EndNote(RIS)BibTexPlain Text
    Save article for my favorites
    Paper Information

    Category: Imaging Systems

    Received: May. 31, 2024

    Accepted: Jul. 15, 2024

    Published Online: Aug. 12, 2024

    The Author Email: Qing Wang (qwang@nwpu.edu.cn)

    DOI:10.3788/LOP241400

    CSTR:32186.14.LOP241400

    Topics