Photonics Research, Volume. 12, Issue 8, 1709(2024)

Towards an ultrafast 3D imaging scanning LiDAR system: a review

Zhi Li1、†, Yaqi Han1、†, Lican Wu1, Zihan Zang1, Maolin Dai2,3, Sze Yun Set2,3, Shinji Yamashita2,3, Qian Li4, and H. Y. Fu1、*
Author Affiliations
  • 1Tsinghua Shenzhen International Graduate School, Tsinghua University, Shenzhen 518055, China
  • 2Department of Electrical Engineering and Information Systems, The University of Tokyo, Tokyo 113-8656, Japan
  • 3Research Center for Advanced Science and Technology, The University of Tokyo, Tokyo 153-8904, Japan
  • 4School of Electronic and Computer Engineering, Peking University, Shenzhen 518055, China
  • show less
    Figures & Tables(18)
    Overview of 3D imaging LiDAR. Rotating mirror reprinted with permission from Ref. [13], copyright 2010, Springer Nature. Galvanometer mirror reprinted with permission from Ref. [26], under a Creative Commons Attribution 4.0 International License. MEMs mirror reprinted with permission from Ref. [27], copyright 2021, Optica Publishing Group. Optical phased array reprinted with permission from Ref. [28], copyright 2020, Optica Publishing Group. Metasurface reprinted with permission from Ref. [25], copyright 2020, Springer Nature. Focal plane switch array reprinted with permission from Ref. [29], copyright 2022, Springer Nature. Spectral scanning LiDAR reprinted with permission from Ref. [30], copyright 2020, Springer Nature. Flash LiDAR reprinted with permission from Ref. [31], copyright 2019, IEEE. Parallel FMCW LiDAR using soliton microcomb reprinted with permission from Ref. [32], copyright 2020, Springer Nature. OCDMA parallel 3D imaging reprinted with permission from Ref. [33], copyright 2020, Optica Publishing Group. Compressed sensing reprinted with permission from Ref. [34], copyright 2019, Optica Publishing Group.
    (a) Basic architecture of a serial detection 3D imaging LiDAR system. The type of light source used in the LiDAR system depends on the ranging technology employed. For pulsed LiDAR, laser diodes or mode-locked fiber lasers can serve as the light source. For AMCW or FMCW LiDAR, laser diodes or other semiconductor lasers capable of transmitting continuous waves can be used. Here modulation devices are employed to generate different signals, although they are not all depicted here. (b) Basic architecture of parallel detection LiDAR, flash LiDAR, for instance. (c) Working principles of different ranging technologies for the serial detection method.
    Mechanical beam scanners. (a) Typical polygonal prism configurations: convergent beam scanning, regular polygonal scanner, pyramidal mirror scanner, and single-faceted cantilevered scanner. (b) Left: basic structure of galvanometric scanner. Right: structure of a magnet torque motor. (c) Left: working principle of beam steering by using a pair of prisms. Right: schematic diagram of applying Risley prism in vehicle LiDAR. (a), (b) Reprinted from Ref. [40], under a Creative Commons Attribution 4.0 International License. (c) Reprinted with permission from Ref. [41], copyright 2018, IEEE.
    MEMS beam scanners. (a) 2D MEMS scanner based on ES actuation. (b) EM MEMS scanner structure with coils and magnets. (c) Basic working principle and schematic of PE MEMS scanner. (d) ET MEMS scanner. (e) Fast MEMS scanner with quasistatic resonant actuation. (a) Reprinted with permission from Ref. [71], copyright 2001, Elsevier. (b), (c), (e) Reprinted from Ref. [66], copyright 2014, IEEE. (d) Reprinted from Ref. [21], under a Creative Commons Attribution 4.0 International License.
    Optical phased array. (a) Working principle of optical phased array (OPA). (b) Schematic diagram of TO and EO phase shifters. Heater metal layer is made of aluminum or other metals. (c) Picture of 512-element optical phased array with an inline architecture and the 3D imaging results. (d) Architecture of FMCW LiDAR system for long range detection and its one-dimensional scanning ranging results. (e) OPA device and the packaged system with epoxied fiber of the first OPA-based coherent LiDAR system from the group at MIT. (b) Reprinted with permission from Ref. [84], copyright 2021, IEEE. (c) Reprinted with permission from Ref. [85], copyright 2019, IEEE. (d) Reprinted with permission from Ref. [86], copyright 2018, IEEE. (e) Reprinted with permission from Ref. [87], copyright 2017, Optica Publishing Group.
    Focal plane switch array. (a) Working principle of FPSA for beam steering. (b) Microscopic images of a large-scale FPSA beam scanner. (c) Schematic diagram of an integrated FPSA chip and (d) velocity measurements by the FPSA LiDAR. (b) Reprinted with permission from Ref. [29], copyright 2022, Springer Nature. (c), (d) Reprinted with permission from Ref. [97], copyright 2021, Springer Nature.
    Slow-light grating beam scanner. (a) Basic structure and working principle of slow-light grating beam scanner in Ref. [104]. (b) Schematic diagram of the on-chip LiDAR. (c) Point cloud images of two different scenes. (a) Reprinted with permission from Ref. [104], copyright 2017, Optica Publishing Group. (b), (c) Reprinted with permission from Ref. [105], copyright 2022, IEEE.
    Metasurface-based beam scanner. (a) Beam-steering performance operated by the TCO material approach. (b) Schematic diagram of MQW metasurface. (c) Liquid-crystal-based SLMs for beam steering. (d) Illustration of active metasurface array for beam steering. (e) Schematic diagram of the 3D LiDAR experimental setup and the 3D depth image produced using the metaphotonic SLM. (a) Reprinted with permission from Ref. [111], copyright 2016, American Chemical Society. (b) Reprinted with permission from Ref. [112], copyright 2015, Wiley-VCH. (c) Reprinted with permission from Ref. [113], copyright 2019, AAAS. (d), (e) Reprinted with permission from Ref. [25], copyright 2020, Springer Nature.
    DMD-based beam scanner. (a) System setup, true scene, and depth resolved images of the proposed LiDAR system. Recoding of 3D imaging results at a 5 Hz frame rate. (b) Top: illustration of the optical system and beam-steering scheme. Bottom: representation of a captured movie of the LiDAR system capturing swinging pendulums placed in each of the five scanning diffraction orders. (a) Reprinted with permission from Ref. [117], copyright 2021, AAAS. (b) Reprinted with permission from Ref. [118], copyright 2017, Optica Publishing Group.
    (a) Top: typical configuration of an acousto-optical deflector. Bottom: two-dimensional scanner formed by arranging two OADs orthogonally in series. (b) Top: schematic of frequency-angular resolving LiDAR using acousto-optic beam scanner. Bottom left: photograph of an LNOI chip with 10 acousto-optic beam scanners. Bottom right: LiDAR imaging results and the beating signal. (a) Reprinted with permission from Ref. [119], copyright 2014, Elsevier. (b) Reprinted with permission from Ref. [120], copyright 2023, Springer Nature.
    (a) Illustration of the principle and anti-interference ability of spectral scanning LiDAR. (b) Basic architecture of spectral scanning pulsed LiDAR system. A spectro-temporal modulated laser source was used. (c) Virtual imaged phased array (VIPA)-based 2D disperser for 2D spectral scanning LiDAR. (d) Top: experimental setup of diffractive element for 2D spectral scanning. Bottom: microscopy image of two DOEs. (e) 1D (top) and 2D (bottom) spectral scanning performance. (f) Fast 3D imaging FMCW LiDAR system. Top: schematic diagram of swept-source FMCW LiDAR system. Short-time Fourier transform (STFT) is used for data processing. Bottom: video-rate 3D imaging results of human hands. (b) Reprinted with permission from Ref. [30], copyright 2020, Springer Nature. (c) Reprinted with permission from Ref. [125], copyright 2021, Optica Publishing Group. (d), (e) Reprinted with permission from Ref. [126], copyright 2021, Optica Publishing Group. (f) Reprinted with permission from Ref. [127], copyright 2022, Springer Nature.
    (a) SPAD sensor for flash LiDAR and the imaging results. (b) Three types of multiple-channel scanning LiDAR systems from commercial products, Velodyne LiDAR (Ultra Puck), Ouster (OS2), and Robosense (RS-Ruby). (c) Structure of proposed Risley-prism-based multi-beam scanning LiDAR. Experimental setup and working principle of multiple-channel scanning. (d) Working principle of parallel FMCW LiDAR using soliton microcomb. (a) Reprinted with permission from Ref. [31], copyright 2019, IEEE. (b) Provided by Refs. [135137" target="_self" style="display: inline;">–137]. (c) Reprinted with permission from Ref. [138], copyright 2022, SPIE. (d) Reprinted with permission from Ref. [32], copyright 2020, Springer Nature.
    (a) System architecture of compressive FMCW-LiDAR depth mapping. (b) Top: system structure of all-optical spectro-temporal encoding LiDAR system. Middle: illumination and echo signal of a serial LiDAR. Bottom: correlated spectro-temporal encoding enables parallelism and speeds up the LiDAR M-times beyond the time-of-flight limit. (a) Reprinted with permission from Ref. [34], copyright 2018, Optica Publishing Group. (b) Reprinted with permission from Ref. [152], copyright 2022, American Institute of Physics.
    • Table 1. Simple Summary of MEMS Scanners with High Resonant Frequency

      View table
      View in Article

      Table 1. Simple Summary of MEMS Scanners with High Resonant Frequency

      ActuationResonant Frequency (kHz)Ref.
      ES30.8[69]
      ES30.8[70]
      EM21.3[73]
      EM21[74]
      PE40[75]
      PE40[78]
    • Table 2. Comparison of LiDAR Performance for Selected Mechanical Beam Scanners

      View table
      View in Article

      Table 2. Comparison of LiDAR Performance for Selected Mechanical Beam Scanners

      Ref. and TypeMechanical ScannersFoV (°)Spatial Resolution (°)Mirror Diameter (mm)Line Scan Rate (Hz)Point Acquisition Rate (kHz)
      [43] CommercialPolygonal mirror76.230,000100
      [46] CommercialGalvanometric mirrors403–5010010
      [60] CommercialRisley prism70.4×77.20.2361.2480
      [82] ResearchMEMS mirrors60×403.61000
    • Table 3. Comparison of LiDAR Performance for Selected Solid-State Beam Scanners

      View table
      View in Article

      Table 3. Comparison of LiDAR Performance for Selected Solid-State Beam Scanners

      Ref. and Type1D or 2DSolid-State ScannerSteering Angle (°)Phase Tuning MechanismAngular Resolution (°)Element NumberPoint Acquisition Rate (kpixels/second)
      [90] Research2DOptical phased array23×3.6Thermal-optic1.323×610
      [91] Research1DMEMS phased array87MEMS actuated1.3×103670350
      [93] Research1DOptical phased array45.4Electronic-optic16 (1×16)20×103
      [94] Research1DOptical phased array6Multiple quantum well18×106
      [29] Research2DFocal plane switch array70×70MEMS actuated0.6128×128103
      [103] Research2DFocal plane switch array1×1MEMS actuated0.1100 (10×10)100
      [97] Research2DFocal plane switch array1.5×0.9Thermal-optic-512 (32×16)5×103
      [105] Research2DSlow-light grating5.1×2.8Thermal-optic4928 (154×32)103
      [25] Research2DMetasurface6×4Electronic-optic651 (31×21)5.4×103
      [117] Research2DDMD-based beam scanner12.60.9723
      [120] Research1DAcousto-optic beam scanner18Acousto-optic0.12670
    • Table 4. State-of-the-Art iToF Flash LiDAR Sensor and ToF Cameras Available on the Market

      View table
      View in Article

      Table 4. State-of-the-Art iToF Flash LiDAR Sensor and ToF Cameras Available on the Market

      Ref. and TypeDetection MethodPixel ArrayFoV (º)Maximum Detection Range (m)Frame Rate (fps)Point Acquisition Rate (kpixels/second)
      [31] ResearchdToF64×641.2×1.25030122
      [134] ResearchdToF252×14440×2050301088
      [139] ResearchdToF64×648.7×7.432,000830033,997
      [141] ResearchiToF1024×1024120×1204.23031,457
      [142] ResearchiToF640×48025×193012036,864
      [143] ResearchiToF1280×9607846073,728
      [144] CommercialiToF512×42470×604.26013,025
      [145] CommercialiToF220×128120×701510282
      [146] CommercialiToF640×48059×456309216
    • Table 5. Summary of Several LiDAR Imaging Methods

      View table
      View in Article

      Table 5. Summary of Several LiDAR Imaging Methods

      Sensing MechanismDetection RangeAxial ResolutionAngular ResolutionFoVPoint Acquisition RateCostIntegration Level
      Mechanical beam scannersPolygonal mirrorMediumLargeMediumLowLow
      Galvanometric mirrorsMediumSmallLowLowLow
      Risley prismLowLargeLowMediumLow
      MEMS mirrorsHighLargeHighHighMedium
      Solid-state beam scannersOptical phased arrayLowLowSmallHighHighHigh
      Focal plane switch arrayMediumHighLargeMediumHighHigh
      Slow-light gratingMediumSmallHighHighHigh
      MetasurfaceHighSmallHighHighHigh
      Spectral scanHighHighSmallHighLowMedium
      Parallel detectionFlash LiDARShortMediumMediumMediumHighMedium
      Hybrid LiDARLongMediumLowLargeMediumLowMedium
      Micro-combHighHighSmallHighHighHigh
      Optical codingLongHighSmallHighHighMedium
    Tools

    Get Citation

    Copy Citation Text

    Zhi Li, Yaqi Han, Lican Wu, Zihan Zang, Maolin Dai, Sze Yun Set, Shinji Yamashita, Qian Li, H. Y. Fu, "Towards an ultrafast 3D imaging scanning LiDAR system: a review," Photonics Res. 12, 1709 (2024)

    Download Citation

    EndNote(RIS)BibTexPlain Text
    Save article for my favorites
    Paper Information

    Category: Imaging Systems, Microscopy, and Displays

    Received: Nov. 15, 2023

    Accepted: Mar. 27, 2024

    Published Online: Jul. 30, 2024

    The Author Email: H. Y. Fu (hyfu@sz.tsinghua.edu.cn)

    DOI:10.1364/PRJ.509710

    Topics