Laser & Optoelectronics Progress, Volume. 61, Issue 16, 1611009(2024)

Meta Light Field Event Imaging System (Invited)

Yu Meng... Manchao Bao, Tao Yue** and Xuemei Hu* |Show fewer author(s)
Author Affiliations
  • School of Electronic Science and Engineering, Nanjing University, Nanjing 210033, Jiangsu, China
  • show less

    Capturing the light field data of dynamical scenes has been widely adopted in virtual reality, microscopic observations, industrial inspections, and other important observation applications. The significant amount of data from current light-field imaging systems complicates their acquisition, transmission, and processing. In this study, inspired by the compound-eye optical structure of insects and the visual-neural work mechanism of fast fusion perception, we propose a novel dynamic light-field imaging paradigm for a meta-light-field event imaging system to capture meta-light-field events with high-dimensional light-field time-varying attributes, which can significantly enhance the light-field perception and characterization of a scene. By fully leveraging the spatiotemporal correlation between events under the light-field structure, we further propose a spatiotemporal-correlated event packaging algorithm, which affords efficient and robust extraction of meta-light-field events. To demonstrate the effectiveness of our proposed meta-light-field event imaging system, we construct a prototype system and test various experimental applications in different computer vision tasks, such as scene reconstruction, denoising, and trajectory reconstruction. Both simulation and experiments can fully demonstrate the high efficiency and robustness of our proposed meta-light-field event camera in capturing dynamic light-field information.

    Keywords
    Tools

    Get Citation

    Copy Citation Text

    Yu Meng, Manchao Bao, Tao Yue, Xuemei Hu. Meta Light Field Event Imaging System (Invited)[J]. Laser & Optoelectronics Progress, 2024, 61(16): 1611009

    Download Citation

    EndNote(RIS)BibTexPlain Text
    Save article for my favorites
    Paper Information

    Category: Imaging Systems

    Received: May. 28, 2024

    Accepted: Jul. 10, 2024

    Published Online: Aug. 12, 2024

    The Author Email: Tao Yue (yuetao@nju.edu.cn), Xuemei Hu (xuemeihu@nju.edu.cn)

    DOI:10.3788/LOP241380

    CSTR:32186.14.LOP241380

    Topics