Laser & Optoelectronics Progress, Volume. 60, Issue 11, 1106011(2023)

Multimode Fiber Imaging Based on Temporal-Spatial Information Extraction

Runze Zhu1、† and Fei Xu†、*
Author Affiliations
  • College of Engineering and Applied Sciences, Nanjing University, Nanjing 210093, Jiangsu, China
  • show less
    Figures & Tables(21)
    Research framework of multimode fiber imaging
    Research framework of MMF imaging based on TM measurement
    MMF imaging based on spatial-domain TM measurement. (a) Principle of spatial-domain TM; (b) experimental diagram of spatial-domain TM measurement; (c) experimental diagram of MMF imaging based on spatial-domain TM measurement
    MMF imaging based on frequency-domain TM measurement. (a) Principle of frequency -domain TM; (b) experimental diagram of spatial-domain TM measurement; (c) experimental diagram of MMF imaging based on frequency -domain TM measurement
    Imaging system of deep brain of living mouse based on multimode fiber[31]
    Endoscopic LIDAR[37]. (a) Schematic of experimental setup; (b) snapshot of true scene; (c) typical depth resolved images
    Research framework of MMF imaging based on phase conjugation and phase optimization
    MMF imaging based on phase conjugation and phase optimization. (a) Experimental scheme of MMF imaging based on phase conjugation; (b) experimental scheme of MMF imaging based on phase optimization
    Research framework of MMF compressive imaging based on structure illumination
    MMF compressive imaging based on speckle illumination. (a) Principle; (b) experimental scheme
    MMF-based super-resolution and super-speed endo-microscopy[51]. (a) Characterization of imaging resolution and speed using 0.22NA MMF; (b) characterization of imaging resolution and speed using 0.1NA MMF
    Evolution of ultrashort pulses in MMF
    High-speed all-fiber imaging based on temporal information extraction[59]. (a) Schematic of the experimental setup; (b) flow of the reconstruction process; (c)–(e) detailed imaging devices
    Research framework of machine learning-assisted MMF imaging
    Process of machine learning-assisted multimode fiber imaging
    High-speed all-fiber micro-imaging with large depth of field[71]
    Research framework of MMF imaging under dynamic perturbance
    Anti-interference imaging based on proximal wavefront measurement. (a) Based on the virtual beacon source[73]; (b) based on the partial reflector[74]; (c) based on the metasurface reflector stacks[75]; (b) based on the guide star[76]
    Image transmission through a dynamically perturbed multimode fiber by deep learning[82]
    • Table 1. Comparison of MMF imaging methods based on spatial-domain information extraction

      View table

      Table 1. Comparison of MMF imaging methods based on spatial-domain information extraction

      MethodImaging systemCalibration processImaging processFocused light spot generation
      TM measurement

      Reference

      light path/no reference

      TM calibrationFocused spot raster- scanning/inverse matrix calculationLoading holograms calculated from TM calculation
      Phase conjugation

      Reference

      light path

      Calculating phase conjugationFocused spot raster- scanningLoading holograms calculated from phase conjugation
      Phase optimizationNo referenceSelect target light field and phase optimizationFocused spot raster- scanningLoading holograms calculated by phase iterative optimization
      Structure illuminationNo referenceGeneration and recording of illumination patternsCompressive imaging
    • Table 2. Parameter comparison of representative works of MMF imaging based on temporal-spatial information extraction

      View table

      Table 2. Parameter comparison of representative works of MMF imaging based on temporal-spatial information extraction

      WorkFiber/probe parameterResolution /μmFOV /(μm×μm)Imaging speedWorking distance /μmMethod
      Choi et al.230.48NA,200 μm diameter1.81 frame/s for 12300 pixel~40TM
      Papadopouloset al.40450 μm-diameter probe<1100×110~200Phase conjugation
      Turtaevet al.3160 µm external diameter1.18 ± 0.0450×503.5 frame/s for 7000 pixelTM
      Caravaca-Aguirre et al.25Four different commercial MMFs280×80a few seconds for one image~100TM
      Vasquez-Lopez et al.3050 µm diameter,0.22NA1.3550×502.4 s per 120 pixel× 120 pixel image0-100TM
      Leite et al.350.2 mm× 0.4 mm dimension endoscopeAngular resolution:(3.59 ± 0.07)mradRelated to working distance4.4 s for each 105 pixel image20000-400000TM
      Wen et al.3650 µm diameter,0.22NA1.43.7 s for one volume image0-102TM
      Stellingaet al.37Illumination fiber:0.22NA 25 μm radius,collection fiber:500 μm diameterAngular resolution:16 mradRelated to working distance5 frame/s for ~23000 points0-2.5 mTM
      Lee et al.38

      105 µm

      core diameter0.22NA

      Lateral,axis resolution:10 μm,~267 μm(working distance:600 μm)

      FOV diameter:

      ~167 μm(working distance:600 μm)

      120 Hz(limited by the camera)0-1200TM
      Cheng et al.4615-meter long MMF(0.22NA,105 µm core)∼18 s for one projection through 2000 iterationsPhase optimization
      Mahalatiet al.1650 μm diameter0.19NATwofold reduction in the width of the PSF40 × 4036 min for 3000 patterns,12 s for the reconstruction of 75 pixel×75 pixel image~25Structure illumination
      Amitonovaet al.5050 μm diameter,0.22NA(1.4 ± 0.2)μm

      0.014 s for 150 patterns

      20 s for the calculation of 50 pixel× 50 pixel image

      <20Structure illumination
      Caravaca-Aguirre et al.60250 μm × 125 μm probe3,1.6 μmUp to a minute for photoacoustic imaging50Structure illumination
      Amitonovaet al.5150/105 µm diameter,0.22/0.1NA2 times better than the diffraction limit~2000,4000

      20 times faster than the

      Nyquist-Shannon limit

      Structure illumination
      Fukui et al.53Core diameter of 105 µm and NA of 0.22Number of resolvable features:1007~100 × 1003 s for one pattern0-100Structure illumination
      Abrashitovaet al.5250 µm diameter,0.22NA2-fold higher resolution than the diffraction limit5 frame/sStructure illumination
      Zhu et al.5450 µm diameter,0.22NANumber of resolvable features:14003000 × 3000242 s for 801 speckle patterns~6000Structure illumination
      Dong et al.55Illumination fiber:0.22NA 25 μm core radius,collection fiber:500 μm core diameterAxial resolution:16 μm100 × 100 × 2001.7 s for the acquisition of the entire volume,6.3 min for the 3D reconstruction0-200Structure illumination
      Liu et al.59Triple-cladding fiber probe + ball lens(580 µm diameter)<15 μm>200 × 200

      detection

      frame rate of 15.4×106 frame/s

      Time- domain analysis
    Tools

    Get Citation

    Copy Citation Text

    Runze Zhu, Fei Xu. Multimode Fiber Imaging Based on Temporal-Spatial Information Extraction[J]. Laser & Optoelectronics Progress, 2023, 60(11): 1106011

    Download Citation

    EndNote(RIS)BibTexPlain Text
    Save article for my favorites
    Paper Information

    Category: Fiber Optics and Optical Communications

    Received: Feb. 27, 2023

    Accepted: Apr. 10, 2023

    Published Online: Jun. 7, 2023

    The Author Email: Fei Xu (feixu@nju.edu.cn)

    DOI:10.3788/LOP230726

    Topics