Laser & Optoelectronics Progress, Volume. 61, Issue 16, 1611007(2024)

Progress and Prospect of Metasurface Light Field Imaging (Invited)

Xin Jin1、*, Zhenwei Long1, and Yunhui Zeng1,2
Author Affiliations
  • 1Shenzhen International Graduate School, Tsinghua University, Shenzhen 518055, Guangdong, China
  • 2Pengcheng Laboratory, Shenzhen 518055, Guangdong, China
  • show less
    Figures & Tables(29)
    Schematic diagram of light field imaging with achromatic metalens array and rendered images[32]
    Schematic diagram of VMMA[36]. Working principle of VMMA when linearly polarized light on the (a) x-axis (TE) and (b) y-axis (TM) is incident; (c) configuration of a single metasurface constituting the VMMA, including unit cells of different types of nanopillar; simulated phase distribution of 2×2 VMMA with (d) TE and (e) TM polarized incident light; simulated far-field intensity distribution of (f) TE and (g) TM incident light
    Three metasurfaces share apertures to realize metasurface light fields for single particle tracking[38]
    PMDP metalens array[37]. (a) Phase distribution of PMDP metalens array in the x-y plane, while the blue and red squares denote the phase distribution method for LCP and RCP respectively; (b) two raw images captured by LCP and RCP illumination respectively; (c) stitched result from Fig. (b) through a certain image processing
    Independent dual-phase design for co- and cross-circularly polarized light[29]
    Metalens array planar wide-angle camera[30]. (a) Each part of FoV is imaged separately by each metalens; (b) schematic illustration of focusing oblique incident light by a metalens
    Light field imaging system enabled by the spin-multiplexed metalens array[31]. (a) Conceptual sketch of the proposed light field imaging camera; (b) bioinspired photonic spin-multiplexed metalens array with its nanopillar unit cell; (c) schematic diagram of the working principle of the system
    Bionic metalens depth sensing system utilizing the lateral dual focus[39]
    Dual-aperture metasurface utilizing depth-invariant and depth-sensitive PSF simultaneously for depth imaging[34]
    Disparity (depth) computation with the neural network[54]. (a) Architecture overview of proposed neural network H-Net with H-Module; (b) detailed pipelines of the cross-pixel interaction; (c) detailed pipelines of cross-view interactions
    Schematic of the achromatic metalens array depth-sensing system[35]
    Relationship between simulated deflection efficiency and deflection angle of a large-angle, multifunctional metasurface grating designed using topology optimization in (a) theory and (b) experiment[71]
    Metasurface designed using topology optimization with a target refraction angle of 20° and a target phase of π/2[72]
    Genetic algorithm based design of high focusing efficiency metalens[73]. (a) Electric energy density of the ideal lens; (b) genetic algorithm optimization flowchart; (c) layout of the non-periodic metasurface lens designed
    3D plasma metasurface design based on ant colony algorithm[74]
    (a) Actual phase distribution, (b) target phase distribution, and (c) corresponding top-view layout of the metasurface designed using the particle swarm optimization algorithm[75]
    DNN-based optimization of metalens parameters[81]
    Metasurface design based on forward and inverse neural networks[82]
    Multilayer metasurface design based on GAN[86]
    Architecture of the metasurface design network based on WGAN[88]. (a) Schematic of the network structure; (b) flowchart of the structural process; (c) example of the design process; (d) schematic illustration of the final metasurface structure designed
    End-to-end imaging pipeline composed of the metasurface image formation model and the feature-based deconvolution algorithm[91]
    Learned metalens array for capturing wide FoV light field[92]
    Architecture of proposed end-to-end designed MLF
    Calculation of depth of field range of ideal lens imaging. (a) Schematic diagram of object point imaging closer than the focal point; (b) schematic diagram of object point imaging further than the focal point
    Architecture of multi-scale image fusing network
    Qualitative assessment of experimental imaging results
    Zoom-in comparation between ground truth images and E2EMLF results
    • Table 1. Representative literatures of MLF

      View table

      Table 1. Representative literatures of MLF

      Ref.Main optimization objectivesOptimization results and performance displayTechnology and System InnovationEquivalent number of metasurfaces
      resolutionField of viewDepth of fieldDepth perception
      32First demonstration of MLF refocusing,depth estimation,etcFirst MLF60×60
      364× increase in spatial resolutionPolarization multiplexing

      37×37

      74×74

      383× increase in spatial resolutionShared aperture1×3
      3736× increase in FoVPolarization multiplexing+integrated system6×6
      294× increase in FoV,compared to Ref.[37Polarization multiplexing+integrated system16×16
      30>120° FoVField of view angle decomposition+integrated system1×17
      92~100° FoVEnd to end optimization+field of view angle decomposition5×5
      30Extra deep field from 3 cm to 1.7 kmPolarization multiplexing39×39
      39Depth perception within a depth range of 10 cmShared aperture1×2
      34Depth perception within a depth range of 30 cmBinocular system1×2
      35Depth perception within a depth range of over 30 cmIntegrated system of light field imaging and structured light imaging60×60
    • Table 2. Quantitative metrics of experimental imaging results

      View table

      Table 2. Quantitative metrics of experimental imaging results

      FunctionMSEPSNR /dBSSIMLPIPS
      Hyperboloid_11.49×10-218.890.540.59
      Hyperboloid_21.74×10-218.010.190.64
      Hyperboloid_39.83×10-320.540.390.65
      Cubic_86π641.01×10-220.600.430.60
      Cubic_55π649.77×10-320.710.400.61
      Log_asphere_1939.92×10-320.260.270.63
      Log_asphere_2931.82×10-217.860.440.64
      E2EMLF7.22×10-322.360.650.52
    Tools

    Get Citation

    Copy Citation Text

    Xin Jin, Zhenwei Long, Yunhui Zeng. Progress and Prospect of Metasurface Light Field Imaging (Invited)[J]. Laser & Optoelectronics Progress, 2024, 61(16): 1611007

    Download Citation

    EndNote(RIS)BibTexPlain Text
    Save article for my favorites
    Paper Information

    Category: Imaging Systems

    Received: May. 31, 2024

    Accepted: Jun. 27, 2024

    Published Online: Aug. 12, 2024

    The Author Email: Xin Jin (jin.xin@sz.tsinghua.edu.cn)

    DOI:10.3788/LOP241399

    CSTR:32186.14.LOP241399

    Topics