Acta Optica Sinica, Volume. 43, Issue 21, 2115002(2023)

Deep Learning-Based Three-dimensional Spatial Distribution Reconstruction for Light Field Micro-Particle Image Velocimetry with Convolutional Neural Network

Shiyu Shen, Jian Li, Mengtao Gu, Biao Zhang, and Chuanlong Xu*
Author Affiliations
  • National Engineering Research Center of Power Generation Control and Safety, School of Energy and Environment, Southeast University, Nanjing 210096, Jiangsu , China
  • show less
    Figures & Tables(22)
    Light field microscopic imaging process
    Generation process of dataset
    Particle luminescence diameter under 10× objective lens
    Samples with different particle concentrations in dataset. (a)(b) 0.4; (c)(d) 0.8; (e)(f) 1.2
    Convolutional neural network structure for reconstruction of three-dimensional distribution of light field micro-particle
    Change of loss function with training process
    Schematic diagram of full width at half maxima
    Spatial distribution of particles and single particle intensity distribution (dashed line) at 0.4 concentration. (a) Theoretical distribution of particles;(b) particle distribution reconstructed by LFD method; (c) particle distribution reconstructed by the prediction model; (d) particle intensity distribution along the xdirection; (e) particle intensity distribution along the zdirection
    Spatial distribution of particles and single particle intensity distribution (dashed line) at 0.8 concentration. (a) Theoretical distribution of particles; (b) particle distribution reconstructed by LFD method; (c) particle distribution reconstructed by the prediction model;(d) particle intensity distribution along the xdirection; (e) particle intensity distribution along the zdirection
    Spatial distribution of particles and single particle intensity distribution (dashed line) at 1.2 concentration. (a) Theoretical distribution of particles; (b) particle distribution reconstructed by LFD method; (c) particle distribution reconstructed by the prediction model; (d) particle intensity distribution along the xdirection; (e) particle intensity distribution along the zdirection
    Reconstruction quality at different concentrations
    Particle extraction rate at different concentrations
    Particle distributions reconstructed by the prediction model and LFD for light field images with different RSN
    Reconstruction quality of prediction model and LFD for light field images with different RSN
    Reconstruction quality of the prediction model for light field images with different particle number with RSN =10
    Experimental setup for microscale flow measurement
    Experimental light field image and reconstructed particle distribution. (a) Light field image; (b) particle distribution reconstructed by LFD; (c) particle distribution reconstructed by the prediction model; (d) comparison of particle intensity distribution along x direction; (e) comparison of particle intensity distribution along z direction
    Three-dimensional velocity field obtained by the prediction model
    Comparisons of the measured and theoretical velocity at z=50 μm
    • Table 1. Optical parameters of light field microscope

      View table

      Table 1. Optical parameters of light field microscope

      ElementParameterValue
      Objective lensMagnification10
      Numerical aperture0.3
      Microlens arrayMicrolens pitch /μm137.5
      Focal length /μm2292
      CameraPixel pitch /μm5.5
    • Table 2. FWHM of reconstructed particles

      View table

      Table 2. FWHM of reconstructed particles

      Concentration of particlesPrediction model FWHMx)/μmPrediction model FWHMz)/μmLFD FWHMx)/μmLFD FWHMz)/μm
      0.42.31402.23932.381611.1653
      0.62.24212.48762.287210.4448
      0.82.05972.39272.311411.6304
      1.02.10502.21592.715811.1973
      1.22.29252.37572.564812.0510
    • Table 3. Time consumption of image reconstruction

      View table

      Table 3. Time consumption of image reconstruction

      MethodTime consumption /s
      LFD31133
      Prediction model(CPU)5
      Prediction model(GPU)0.243
    Tools

    Get Citation

    Copy Citation Text

    Shiyu Shen, Jian Li, Mengtao Gu, Biao Zhang, Chuanlong Xu. Deep Learning-Based Three-dimensional Spatial Distribution Reconstruction for Light Field Micro-Particle Image Velocimetry with Convolutional Neural Network[J]. Acta Optica Sinica, 2023, 43(21): 2115002

    Download Citation

    EndNote(RIS)BibTexPlain Text
    Save article for my favorites
    Paper Information

    Category: Machine Vision

    Received: May. 10, 2023

    Accepted: Jun. 13, 2023

    Published Online: Nov. 8, 2023

    The Author Email: Chuanlong Xu (chuanlongxu@seu.edu.cn)

    DOI:10.3788/AOS230958

    Topics