Photonics Research, Volume. 12, Issue 9, 2047(2024)

Image reconstruction through a nonlinear scattering medium via deep learning

Shuo Yan1、†, Yiwei Sun1、†, Fengchao Ni1、†, Zhanwei Liu1, Haigang Liu1,4、*, and Xianfeng Chen1,2,3,5、*
Author Affiliations
  • 1State Key Laboratory of Advanced Optical Communication Systems and Networks, School of Physics and Astronomy, Shanghai Jiao Tong University, Shanghai 200240, China
  • 2Shanghai Research Center for Quantum Sciences, Shanghai 201315, China
  • 3Collaborative Innovation Center of Light Manipulations and Applications, Shandong Normal University, Jinan 250358, China
  • 4e-mail: liuhaigang@sjtu.edu.cn
  • 5e-mail: xfchen@sjtu.edu.cn
  • show less
    Figures & Tables(9)
    Process of reconstructing the original image by SH speckle. Different phase distribution of the image uploaded on FF beam will interact with the nonlinear scattering medium and generate a different SH speckle pattern. The original image and SH speckle patterns are fed into NSDN for joint training. The acquired SH speckle is fed into the learned NSDN to reconstruct the original image.
    NSDN architecture. Each box corresponds to a multichannel feature map. The number of channels is indicated at the top of each box, and the x–y size is provided at the left edge. The color of the boxes corresponds to different operation types, as listed in the lower-right corner of the figure. Arrows indicate the direction of data operations.
    Reconstruction of MNIST data set. (a) Prediction results of test MNIST data set and (b) the corresponding α and β evolution curves in the training process. (c) Prediction evolution results of MNIST data set, with corresponding values of α and β.
    Reconstruction of CIFAR data set. (a) Prediction results of test CIFAR data set and (b) the corresponding α and β evolution curves in the training process. (c) Prediction evolution results of CIFAR data set, with corresponding values of α and β.
    Verification of robustness of NSDN for different diffusers. (a) Scanning electron microscope image of LiNbO3 diffusers. (b) Reconstruction results for each data set using different diffusers, with each column corresponding to a specific diffuser.
    Reconstruction results of unseen class of MNIST and CIFAR data sets.
    Quantitative evaluation of the NSDN performance. 1st and 2nd represent different diffusers, respectively; M and C mean MNIST and CIFAR data set, respectively; US means using unseen classes as test data set. (a) Different diffusers. (b) Unseen classes.
    Preparation of lithium niobate powder film using electrophoresis.
    Schematic of the experimental setup. L1–L4, lenses, with focal lengths of 50, 200, 100, and 100 mm; BS, beam splitter; SLM, spatial light modulator; M1, mirror; Obj., objective; F, filter; CCD, charge coupled device camera. Inset: image loaded on the SLM.
    Tools

    Get Citation

    Copy Citation Text

    Shuo Yan, Yiwei Sun, Fengchao Ni, Zhanwei Liu, Haigang Liu, Xianfeng Chen, "Image reconstruction through a nonlinear scattering medium via deep learning," Photonics Res. 12, 2047 (2024)

    Download Citation

    EndNote(RIS)BibTexPlain Text
    Save article for my favorites
    Paper Information

    Category: Nonlinear Optics

    Received: Mar. 13, 2024

    Accepted: Jul. 7, 2024

    Published Online: Sep. 2, 2024

    The Author Email: Haigang Liu (liuhaigang@sjtu.edu.cn), Xianfeng Chen (xfchen@sjtu.edu.cn)

    DOI:10.1364/PRJ.523728

    Topics