Photonics Research, Volume. 13, Issue 7, 1936(2025)

Unsupervised reconstruction with low-rank tensor embedding based on spatial-intensity-temporal constraints for compressed ultrafast photography

Haoyu Zhou1,2, Zhiming Yao2, Wenpei Yang2, Dongwei Hei2, Yang Li2, Baojun Duan2, Yinong Liu1, Liang Sheng2,3、*, and Yan Song2,4、*
Author Affiliations
  • 1Department of Engineering Physics, Tsinghua University, Beijing 100084, China
  • 2National Key Laboratory of Intense Pulsed Radiation Simulation and Effect, Northwest Institute of Nuclear Technology, Xi’an 710024, China
  • 3e-mail: shengliang@nint.ac.cn
  • 4e-mail: songyan@nint.ac.cn
  • show less
    Figures & Tables(16)
    (a) The equipment diagram of the proposed SITC-CUP system. (b) From top to bottom: the imaging models of the wide-slit streak camera, the narrow-slit streak camera, and the CCD camera.
    Schematic diagram of the Deep Tensor unsupervised low-rank factorization network. Xi, Yi: the input elements of fU, fV; Xi′, Yi′: the output elements of fU, fV; Wi, Wi′: the parameters of every two layers for fU, fV.
    Flowchart of the proposed algorithm. Loss: loss function; E: image collected by the wide-slit streak camera; Eccd: image collected by the external CCD camera; En: image collected by the narrow-slit streak camera; X0: result of the first iterative step; SC: streak camera; patch: patch and delay embedding process of 3D image in manifold learning [31]; W1, W2, W3, W4: the parameters of every two fully connected layers.
    (a) The dynamic compressed image of the wide-slit streak camera in LED10-3 simulation process. (b) The integral image of CCD camera in LED10-3 simulation process, where the blue box area is the slit FoV area. (c) The dynamic image of the narrow-slit streak camera in LED10-3 simulation process.
    Reconstruction results of the natural image datasets by different algorithms, together with the ground truths for comparison. The sub-image at the bottom right corner is the enlarged area in the corresponding red box.
    Reconstruction results of the LED simulation datasets by different algorithms, together with the ground truths for comparison. The sub-image at the bottom right corner is the enlarged area in the corresponding yellow box.
    (a) The relationship between the trigger voltage of DG645 digital delay-pulse generator and time for each row of LEDs. (b) The relationship between normalized intensity and time for each row of LEDs measured by the photodiode.
    (a) The static image of the narrow-slit streak camera in the experiment. (b) The dynamic compressed image of the wide-slit streak camera in the experiment. (c) The integral image of CCD camera in the experiment. (d) The dynamic image of the narrow-slit streak camera in the experiment.
    The calibrated images of (a) wide-slit streak camera and (b) narrow-slit streak camera at specific moments (20 ns interval).
    Reconstruction results of the experiment by different methods.
    (a) The selected area (the white box aera) of the narrow-slit streak camera image. (b) The relationship between the normalized intensity and scanning time of the selected aera in the narrow-slit streak camera image.
    The relationship between normalized intensity and time of the five rows of LEDs for our proposed algorithm. The dashed line indicates the lighting time calculated by choosing 15% peak as the boundary.
    The relationship between normalized intensity and time of the first row of LEDs (a) and the fourth row of LEDs (b) for reconstruction results by different methods.
    • Table 1. Average PSNR (in dB) and SSIM on the Natural Image Datasets by Different Methodsa

      View table
      View in Article

      Table 1. Average PSNR (in dB) and SSIM on the Natural Image Datasets by Different Methodsa

      DatasetDrop (16)Aerial (16)Runner (24)Crash (24)Average
      Evaluation IndexPSNRSSIMPSNRSSIMPSNRSSIMPSNRSSIMPSNRSSIM
      GAP-TV28.090.90421.520.66720.960.71721.800.69323.090.745
      FFDNet33.180.94220.980.67522.110.74920.620.69724.220.766
      FastDVDnet33.830.96523.850.73926.500.82223.410.76726.900.823
      DeSCI28.520.92321.730.68621.290.70921.980.71223.380.757
      TUIC-CUP35.080.97025.560.82427.520.83924.530.83928.170.868
      SITC-CUP (w/o LR)37.010.97725.730.82628.100.85325.040.85728.970.878
      SITC-CUP37.470.98026.080.83228.740.87126.120.87629.600.890
    • Table 2. Average PSNR (in dB), SSIM, and Correlation Coefficient on the LED Simulation Datasets by Different Methodsa

      View table
      View in Article

      Table 2. Average PSNR (in dB), SSIM, and Correlation Coefficient on the LED Simulation Datasets by Different Methodsa

      DatasetLED8-4LED8-5LED10-3Average
      Evaluation IndexPSNRSSIMcorr1corr2PSNRSSIMcorr1corr2PSNRSSIMcorr1corr2PSNRSSIMcorr1corr2
      GAP-TV28.110.7410.2780.76428.870.7590.3050.71526.760.7060.5870.69927.910.7350.3900.726
      FFDNet33.660.8490.8430.89035.520.8690.8870.88331.840.8330.9390.89033.670.8500.8900.888
      FastDVDnet36.130.7200.8830.89635.520.7240.8880.89535.310.6720.9080.89635.650.7050.8930.896
      DeSCI27.920.7560.2390.32428.710.7710.2840.26126.510.7260.5290.26227.710.7510.3510.282
      TUIC-CUP40.340.9410.9190.92841.190.9600.9640.97641.030.9400.9880.98640.850.9470.9570.963
      SITC-CUP (w/o LR)43.440.9520.9470.97842.770.9380.9660.98242.150.9450.9960.98542.790.9450.9700.982
      SITC-CUP46.810.9700.9510.97948.410.9760.9970.99746.630.9690.9990.99747.280.9720.9820.991
    • Table 3. On/Off Time and Duration (in ns) for Each Row of LEDs

      View table
      View in Article

      Table 3. On/Off Time and Duration (in ns) for Each Row of LEDs

      Row Number1st2nd3rd4th5th
      On time4.5814.3030.5443.2953.34
      Off time24.4236.2151.9565.2374.17
      Duration19.8421.9121.4121.9420.83
    Tools

    Get Citation

    Copy Citation Text

    Haoyu Zhou, Zhiming Yao, Wenpei Yang, Dongwei Hei, Yang Li, Baojun Duan, Yinong Liu, Liang Sheng, Yan Song, "Unsupervised reconstruction with low-rank tensor embedding based on spatial-intensity-temporal constraints for compressed ultrafast photography," Photonics Res. 13, 1936 (2025)

    Download Citation

    EndNote(RIS)BibTexPlain Text
    Save article for my favorites
    Paper Information

    Category: Imaging Systems, Microscopy, and Displays

    Received: Jan. 17, 2025

    Accepted: Apr. 27, 2025

    Published Online: Jul. 1, 2025

    The Author Email: Liang Sheng (shengliang@nint.ac.cn), Yan Song (songyan@nint.ac.cn)

    DOI:10.1364/PRJ.555010

    CSTR:32188.14.PRJ.555010

    Topics