Infrared and Laser Engineering, Volume. 51, Issue 8, 20220563(2022)

Scattering imaging with deep learning: Physical and data joint modeling optimization (invited)

Enlai Guo, Yingjie Shi, Shuo Zhu, Qianqian Cheng, Yi Wei, Jinye Miao, and Jing Han*
Author Affiliations
  • Jiangsu Key Laboratory of Spectral Imaging and Intelligent Sense Laboratory, Nanjing University of Science and Technology, Nanjing 210094, China
  • show less
    Figures & Tables(9)
    Principle of anti-scattering imaging based on deep learning. (a) Reconstruction of transmission matrix angle; (b) Speckle correlation imaging angle; (c) Optimization problem angle
    Different kinds of neural networks: (a) CNN[3]; (b) RNN[19]; (c) GAN[9]
    Optimization of models based on CNN and GAN: (a) The decoder outputs dual channels for classification[3]; (b) The decoder uses a branch structure to extract dual-target information[20]; (c) The bottom branch of the encoder extracts features of different sizes[23]; (d) The decoder increases attention mechanism to optimize upsampling feature weights[25]
    [in Chinese]
    Adaptability of network: (a) Adaptively adjust the parameters of output layer21; (b) Adaptively adjust the weights of model26
    Application of deep anti-scattering imaging method based on deep learning
    Neural network framework in different anti-scattering imaging methods. (a) Single-frame color target imaging method[7]; (b) Imaging method through scattering media of large optical thickness[12]; (c) Imaging method for complex objects with large field of view using a single frame speckle[29]; (d) Imaging through scattering medium based on wavefront modulation realized by neural network[5]
    An overview of the physics-aware learning framework combined with physical model and data model. (a) Physical fusion method; (b) Physical regularization method; (c) Residual physics method; (d) Embedded physics method
    Examples of the physics-aware learning framework combined with physical model and data model. (a) Imaging through unknown diffusers via fusing the ME prior [6]; (b) Imaging unknown target through scattering media via autocorrelation constraint [24]; (c) Untrained deep learning-based 3 D sensing method via residual physics optimization [51]; (d) Optimized coded-illumination for quantitative phase imaging via Physics-based learning method [52]
    Tools

    Get Citation

    Copy Citation Text

    Enlai Guo, Yingjie Shi, Shuo Zhu, Qianqian Cheng, Yi Wei, Jinye Miao, Jing Han. Scattering imaging with deep learning: Physical and data joint modeling optimization (invited)[J]. Infrared and Laser Engineering, 2022, 51(8): 20220563

    Download Citation

    EndNote(RIS)BibTexPlain Text
    Save article for my favorites
    Paper Information

    Category: Special issue——Scattering imaging and non-line-of-sight imaging

    Received: Aug. 10, 2022

    Accepted: --

    Published Online: Jan. 9, 2023

    The Author Email: Han Jing (eohj@njust.edu.cn)

    DOI:10.3788/IRLA20220563

    Topics