Chinese Optics Letters, Volume. 21, Issue 6, 061103(2023)

Passive non-line-of-sight imaging for moving targets with an event camera

Conghe Wang1, Yutong He2, Xia Wang1、*, Honghao Huang2, Changda Yan1, Xin Zhang1, and Hongwei Chen2、**
Author Affiliations
  • 1Key Laboratory of Photoelectronic Imaging Technology and System of Ministry of Education of China, School of Optics and Photonics, Beijing Institute of Technology, Beijing 100081, China
  • 2Beijing National Research Center for Information Science and Technology (BNRist), Department of Electronic Engineering, Tsinghua University, Beijing 100084, China
  • show less
    Figures & Tables(10)
    Schematic of events excitation with changes in brightness at pixel level. The red arrow stands for a fired positive event, while the green arrow stands for the negative one.
    Representations of event-based data.
    Discrimination function of fired event.
    Flow chart of event-embedded passive NLOS imaging.
    Experimental setup. (a) Basic principle of our NLOS scene; (b) experimental settings; the self-luminous target is a video with moving digits.
    (a) Part of the reconstruction results for the PRINT test set in both EM-NLOS and FM-NLOS; (b) part of the reconstruction results for the MNIST test set in both EM-NLOS and FM-NLOS.
    Reconstructions of NLOS moving target at different positions through the E method and the F method. Six different positions of digit 7 (MNIST test set) and digit 3 (PRINT test set) are displayed as examples. The Cd value (pixel) is labeled at the corner of each frame.
    Cd value of NLOS reconstructions at different positions. (a), (b) are the Cd values of reconstructions shown in Fig. 7 (digit 7 and digit 3, respectively).
    Evaluation metrics LPIPS and PSNR for reconstructions of digit 7 (MNIST test) and digit 3 (PRINT test) at 10 different positions, respectively. The full line denotes the E method, while the dotted line denotes frame-based ones.
    • Table 1. Evaluation Metrics of Results with E Method and F Methoda

      View table
      View in Article

      Table 1. Evaluation Metrics of Results with E Method and F Methoda

      DigitPSNR/dB (↑)LPIPS (↓)
      MNIST testPRINT testMNIST testPRINT test
      E (ours)FE (ours)FE (ours)FE (ours)F
      017.9817.0218.2516.670.0630.0880.0680.084
      129.2426.5721.9718.660.0140.0360.0710.083
      219.0919.0417.2915.960.0650.0920.0850.087
      319.0116.4819.8316.420.0630.1290.0750.099
      419.3318.1317.5815.360.0670.0760.1010.114
      520.8419.5617.4215.960.0560.0750.0820.090
      620.4819.6416.4114.630.0490.0700.1010.106
      720.5017.2217.7817.260.0420.1060.0810.086
      819.6618.4717.2315.040.0470.0860.0880.095
      919.5316.8617.3517.170.0570.0850.0840.086
      Avg.20.5718.9018.1116.320.0520.0840.0830.093
    Tools

    Get Citation

    Copy Citation Text

    Conghe Wang, Yutong He, Xia Wang, Honghao Huang, Changda Yan, Xin Zhang, Hongwei Chen. Passive non-line-of-sight imaging for moving targets with an event camera[J]. Chinese Optics Letters, 2023, 21(6): 061103

    Download Citation

    EndNote(RIS)BibTexPlain Text
    Save article for my favorites
    Paper Information

    Category: Imaging Systems and Image Processing

    Received: Jan. 14, 2023

    Accepted: Apr. 4, 2023

    Posted: Apr. 6, 2023

    Published Online: May. 29, 2023

    The Author Email: Xia Wang (angelniuniu@bit.edu.cn), Hongwei Chen (chenhw@tsinghua.edu.cn)

    DOI:10.3788/COL202321.061103

    Topics