Acta Photonica Sinica, Volume. 53, Issue 11, 1111001(2024)

Color Non-line-of-sight Imaging Based on Time-correlated Single Photon Counting

Weiwei LI1...2, Tongyi ZHANG1,2,*, Yan KANG1,**, Ruikai XUE1,2, Xiaofang WANG1,2, Jintao LIANG1,2 and Lifei LI1 |Show fewer author(s)
Author Affiliations
  • 1State Key Laboratory of Transient Optics and Photonics ,Xi'an Institute of Optics and Precision Mechanics of CAS,Xi'an 710119,China
  • 2University of Chinese Academy of Sciences,Beijing 100049,China
  • show less
    References(40)

    [1] I FREUND. Looking through walls and around comers. Physica A: Statistical Mechanics and its Applications, 168, 49-65(1990).

    [2] L WANG, P HO, C LIU et al. Ballistic 2-d imaging through scattering walls using an ultrafast optical Kerr gate. Science, 769-771(1991).

    [3] D HUANG, E A SWANSON, C P LIN et al. Optical coherence tomography. Science, 254, 1178-1181(1991).

    [4] R S BENNINK, S J BENTLEY, R W BOYD. “Two-Photon” coincidence imaging with a classical source. Physical Review Letters, 89, 113601(2002).

    [5] A F FERCHER, W DREXLER, C K HITZENBERGER et al. Optical coherence tomography-principles and applications. Reports on Progress in Physics, 66, 239(2003).

    [6] P SEN, B CHEN, G GARG et al. Dual photography. Association for Computing Machinery, 745-755(2005).

    [7] J BERTOLOTTI, E G VANPUTTEN, C BLUM et al. Non-invasive imaging through opaque scattering layers. Nature, 491, 232-234(2012).

    [8] O KATZ, P HEIDMANN, M FINK et al. Non-invasive single-shot imaging through scattering layers and around comers via speckle correlations. Nature Photonics, 8, 784-790(2014).

    [9] Shukong WU, Yuning ZHANG. Research progress of passive non⁃line⁃of⁃sight imaging methods. Optoelectronic Technology, 41, 7(2021).

    [10] M LAURENZIS, A VELTEN, J KLEIN. Dual-mode optical sensing: three-dimensional imaging and seeing around a corner. Optical Engineering, 56, 031202(2016).

    [11] D B LINDELL, G WETZSTEIN, V KOLTUN. Acoustic non-line-of-sight imaging, 67, 80-6789(2019).

    [12] N SCHEINER, F KRAUS, F WEI et al. Seeing around street corners: Non-line-of-sight detection and tracking in-the-wild using doppler radar, 2068-2077(2020).

    [13] S BAUER, R STREITER, G WANIELIK. Non-line-of-sight mitigation for reliable urban gnss vehicle localization using a particle filter, 1664-1671(2015).

    [14] S CHAN, R E WARBURTON, EPY G GARI et al. Non-line-of-sight tracking of people at long range. Optics Express, 25, 10109-10117(2017).

    [15] G GARIEPY, F TONOLI NI, R HENDERSON et al. Detection and tracking of moving objects hidden from view. Nature Photonics, 10, 23-26(2016).

    [16] R RAMESH, J DAVIS. 5d time-light transport matrix: what can we reason about scene properties?(2008).

    [17] A KIRMANI, T HUTCHISON, J DAVIS et al. Looking around the corner using transient imaging, 159-166(2009).

    [18] A VELTEN, TWI LLWACHER, O GUPTA et al. Recovering three-dimensional shape around a comer using ultrafast time-of-flight imaging. Nature Communications, 3, 1-8(2012).

    [19] O GUPTA, T WILLWACHER, A VELTEN et al. Reconstruction of hidden 3D shapes using diffuse reflections. Optics Express, 20, 19096-19108(2012).

    [20] M LAURENZIS, A VELTEN. Non-line-of-sight active imaging of scattered photons, 8897, 889706(2013).

    [21] M LAURENZIS, A VELTEN. Non-line-of-sight laser gated viewing of scattered photons. Optical Engineering, 53, 1-6(2014).

    [22] F HEIDE, L XIAO, W HEIDRICH et al. Diffuse mirrors: 3D reconstruction from diffuse indirect illumination using inexpensive time-of-flight sensors, 3222-3229(2014).

    [23] M B HULLIN. Computational imaging of light in flight, 9273, 927314(2014).

    [24] F HEIDE, M B HULLIN, J GREGSON et al. Low-budget transient imaging using photonic mixer devices. ACM Transactions on Graphics, 32, 1-10(2013).

    [25] Yan KANG, Ruikai XUE, Xiaofang WANG et al. High-resolution depth imaging with a small-scale SPAD array based on the temporal-spatial filter and intensity image guidance. Optics Express, 30, 33994-34011(2022).

    [26] F ZAPPA, S TISA, A TOSI et al. Principles and features of single-photon avalanche diode arrays. Sensors and Actuators A: Physical, 140, 103-112(2007).

    [27] Xu YANG, Ziyi TONG, Pengfei JIANG et al. Deep-learning based photon-efficient 3D and reflectivity imaging with a 64×64 single-photon avalanche detector array. Optics Express, 30, 32948-32964(2022).

    [28] M GHIONI, A GULINATTI, I RECH et al. Progress in silicon single-photon avalanche diodes. IEEE Journal of Selected Topics in Quantum Electronics, 13, 852-862(2007).

    [29] M BUTTAFAVA, J ZEMAN, A TOSI et al. Non-line-of-sight imaging using a time-gated single photon avalanche diode. Optics Express, 23, 20997-1011(2015).

    [30] Cheng WU, Jianjiang LIU, Xin HUANG et al. Non-line-of-sight imaging over 1.43 km. Proceedings of the National Academy of Sciences, 118, e2024468118(2020).

    [31] M O'TOOLE, D B LINDLEL, G WETZSTEIN. Confocal non-line-of- sight imaging based on the light-cone transform. Nature, 555, 338-341(2018).

    [32] Xiaochun LIU, I GUILLEN, M L MANNA et al. Non-line-of-sight imaging using phasor-field virtual wave optics. Nature, 572, 620-623(2019).

    [33] Zhengpeng LIAO, Deyang JIANG, Xiaochun LIU et al. FPGA accelerator for real-time non-line-of-sight imaging. IEEE Transactions on Circuits and Systems, 69, 721-734(2022).

    [34] Xiaochun LIU, S BAUER, A VELTEN. Phasor field diffraction based reconstruction for fast non-line-of-sight imaging systems. Nature Communications, 11, 1645(2020).

    [35] J H NAM, E BRANDT, S BAUER et al. Low-latency time-of-flight non-line-of-sight imaging at 5 frames per second. Nature Communications, 12, 6526(2021).

    [36] Deyang Jiang, Xiaochun LIU, Jianwen LUO et al. Ring and radius sampling based phasor field diffraction algorithm for Non-Line-of-Sight reconstruction. IEEE Transactions on Pattern Analysis and Machine Intelligence, 44, 7841-7853(2022).

    [37] P CARAMAZZA, A BOCCOLINI, D BUSCHEK et al. Neural network identification of people hidden from view with a single-pixel, single-photon detector. Scientific Reports, 8, 1-6(2018).

    [38] Fangzhou MU, Sicheng MO, Jiayong PENG et al. Physics to the rescue: deep non-line-of-sight reconstruction for high-speed imaging. IEEE Transactions on Pattern Analysis and Machine Intelligence(2022).

    [39] V ARELLANO, D GUTIERREZ, A JARABO. Fast back-projection for non-line of sight reconstruction. Optics Express, 25, 11574-11583(2017).

    [40] D B LINDELL, G WETZSTEIN, M O'TOOLE. Wave-based non-line-of-sight imaging using fast f-k migration. ACM Transactions on Graphics (TOG), 38, 1-13(2019).

    Tools

    Get Citation

    Copy Citation Text

    Weiwei LI, Tongyi ZHANG, Yan KANG, Ruikai XUE, Xiaofang WANG, Jintao LIANG, Lifei LI. Color Non-line-of-sight Imaging Based on Time-correlated Single Photon Counting[J]. Acta Photonica Sinica, 2024, 53(11): 1111001

    Download Citation

    EndNote(RIS)BibTexPlain Text
    Save article for my favorites
    Paper Information

    Category:

    Received: Apr. 10, 2024

    Accepted: May. 8, 2024

    Published Online: Jan. 8, 2025

    The Author Email: ZHANG Tongyi (tyzhang@opt.ac.cn), KANG Yan (kangyan@opt.ac.cn)

    DOI:10.3788/gzxb20245311.1111001

    Topics