Photonics Research, Volume. 9, Issue 2, B30(2021)

High-fidelity image reconstruction for compressed ultrafast photography via an augmented-Lagrangian and deep-learning hybrid algorithm

Chengshuai Yang1, Yunhua Yao1,6、*, Chengzhi Jin1, Dalong Qi1, Fengyan Cao1, Yilin He1, Jiali Yao1, Pengpeng Ding1, Liang Gao2, Tianqing Jia1, Jinyang Liang3, Zhenrong Sun1, and Shian Zhang1,4,5,7、*
Author Affiliations
  • 1State Key Laboratory of Precision Spectroscopy, School of Physics and Electronic Science, East China Normal University, Shanghai 200062, China
  • 2Department of Electrical and Computer Engineering, University of Illinois at Urbana-Champaign, Urbana, Illinois 61801, USA
  • 3Institut National de la Recherche Scientifique, Centre Énergie Matériaux Télécommunications, Laboratory of Applied Computational Imaging, Varennes, Québec J3X1S2, Canada
  • 4Collaborative Innovation Center of Extreme Optics, Shanxi University, Taiyuan 030006, China
  • 5Collaborative Innovation Center of Light Manipulations and Applications, Shandong Normal University, Jinan 250358, China
  • 6e-mail: yhyao@lps.ecnu.edu.cn
  • 7e-mail: sazhang@phy.ecnu.edu.cn
  • show less
    Figures & Tables(7)
    Data flow chart of the AL+DL algorithm. (a) Solver Sp(·) in a sparse domain; (b) general framework by connecting each iteration in a sequence order. Here, each Si(·) is calculated in parallel to producing Wi, and GD algorithm is employed to calculate I.
    (a) U-net architecture in the AL+DL algorithm; (b) self-attention model.
    Reconstructed results of (a) boatman, (b) ocean animal, and (c) finger by the AL+DL (second row), AL (third row), and TwIST (fourth row) algorithms, together with the ground truth (first row) for comparison. The last column is the enlarged image in the corresponding red squares.
    System configuration of CUP. DMD, digital micromirror device; CMOS, complementary metal–oxide-semiconductor.
    Measuring temporal evolution of a spatially modulated picosecond laser spot. (a) Experimental design. (b)–(d) Reconstructed results by the AL+DL, AL, and TwIST algorithms, respectively. (e) Measured static image by external CCD. (f)–(h) Extracted images from (b)–(d), respectively, at the time of 14 ps; curves on the right are the integration results of the corresponding images along the horizontal direction.
    Measuring wavefront movement by obliquely illuminating a collimated femtosecond laser pulse on a transverse fan pattern. (a) Experimental design. (b)–(d) Reconstructed results by the AL+DL, AL, and TwIST algorithms, respectively. (e) Measured static image by external CCD. (f)–(h) Integrated images from (b)–(d), respectively. (i)–(l) Results of Fourier transform from (e)–(h), respectively.
    • Table 1. Average PSNR (in dB) and SSIM by Different Image Reconstruction Algorithms in Different Dynamic Scenes

      View table
      View in Article

      Table 1. Average PSNR (in dB) and SSIM by Different Image Reconstruction Algorithms in Different Dynamic Scenes

      SceneAL+DLALTwIST
      PSNRSSIMPSNRSSIMPSNRSSIM
      Boatman28.500.83624.150.70022.470.589
      Ocean animal30.470.91625.000.80224.720.781
      Finger42.000.98332.220.93228.560.894
    Tools

    Get Citation

    Copy Citation Text

    Chengshuai Yang, Yunhua Yao, Chengzhi Jin, Dalong Qi, Fengyan Cao, Yilin He, Jiali Yao, Pengpeng Ding, Liang Gao, Tianqing Jia, Jinyang Liang, Zhenrong Sun, Shian Zhang, "High-fidelity image reconstruction for compressed ultrafast photography via an augmented-Lagrangian and deep-learning hybrid algorithm," Photonics Res. 9, B30 (2021)

    Download Citation

    EndNote(RIS)BibTexPlain Text
    Save article for my favorites
    Paper Information

    Special Issue: DEEP LEARNING IN PHOTONICS

    Received: Sep. 15, 2020

    Accepted: Dec. 2, 2020

    Published Online: Jan. 22, 2021

    The Author Email: Yunhua Yao (yhyao@lps.ecnu.edu.cn), Shian Zhang (sazhang@phy.ecnu.edu.cn)

    DOI:10.1364/PRJ.410018

    Topics