Laser & Optoelectronics Progress, Volume. 60, Issue 14, 1400001(2023)

Research Progresses on Non-Line-of-Sight Imaging Technology

Zhenyu Zhang, Yan Shi*, Shengxin Dai, Chunlian Zhan, Tianqi Zhao, and Shangzhong Jin
Author Affiliations
  • College of Optical and Electronic Technology, China Jiliang University, Hangzhou 310018, Zhejiang, China
  • show less
    References(64)

    [1] Altmann Y, McLaughlin S, Padgett M J et al. Quantum-inspired computational imaging[J]. Science, 361, eaat2298(2018).

    [3] Gupta O, Willwacher T, Velten A et al. Reconstruction of hidden 3D shapes using diffuse reflections[J]. Optics Express, 20, 19096-19108(2012).

    [4] Adib F, Hsu C Y, Mao H Z et al. Capturing the human figure through a wall[J]. ACM Transactions on Graphics, 34, 1-13(2015).

    [5] Chan S S, Warburton R E, Gariepy G et al. Non-line-of-sight tracking of people at long range[J]. Optics Express, 25, 10109-10117(2017).

    [6] Caramazza P, Boccolini A, Buschek D et al. Neural network identification of people hidden from view with a single-pixel, single-photon detector[J]. Scientific Reports, 8, 11945(2018).

    [7] Liu X C, Bauer S, Velten A. Analysis of feature visibility in non-line-of-sight measurements[C], 10132-10140(2020).

    [8] La Manna M, Nam J H, Reza S A et al. Non-line-of-sight-imaging using dynamic relay surfaces[J]. Optics Express, 28, 5331-5339(2020).

    [9] Geng R X, Hu Y, Chen Y. Recent advances on non-line-of-sight imaging: conventional physical models, deep learning, and new scenes[J]. APSIPA Transactions on Signal and Information Processing, 11, e1(2022).

    [10] Jin X, Du D Y, Deng R J. Progress and prospect of non-line-of-sight imaging[J]. Infrared and Laser Engineering, 51, 20220305(2022).

    [11] Faccio D, Velten A, Wetzstein G. Non-line-of-sight imaging[J]. Nature Reviews Physics, 2, 318-327(2020).

    [12] Kirmani A, Hutchison T, Davis J et al. Looking around the corner using ultrafast transient imaging[J]. International Journal of Computer Vision, 95, 13-28(2011).

    [13] Kadambi A, Zhao H, Shi B X et al. Occluded imaging with time-of-flight sensors[J]. ACM Transactions on Graphics, 35, 1-12(2016).

    [14] Jin C F, Tian X R, Tang M et al. Research advances on non-line-of-sight three-dimensional imaging lidar[J]. Infrared and Laser Engineering, 51, 20210471(2022).

    [15] Pandharkar R, Velten A, Bardagjy A et al. Estimating motion and size of moving non-line-of-sight objects in cluttered environments[C], 265-272(2011).

    [16] O’Toole M, Heide F, Lindell D B et al. Reconstructing transient images from single-photon sensors[C], 2289-2297(2017).

    [17] Xu F H, Shulkind G, Thrampoulidis C et al. Revealing hidden scenes by photon-efficient occlusion-based opportunistic active imaging[J]. Optics Express, 26, 9945-9962(2018).

    [18] Heide F, O’Toole M, Zang K et al. Non-line-of-sight imaging with partial occluders and surface normals[J]. ACM Transactions on Graphics, 38, 1-10(2019).

    [19] Thrampoulidis C, Shulkind G, Xu F H et al. Exploiting occlusion in non-line-of-sight active imaging[J]. IEEE Transactions on Computational Imaging, 4, 419-431(2018).

    [20] Ye J T, Huang X, Li Z P et al. Compressed sensing for active non-line-of-sight imaging[J]. Optics Express, 29, 1749-1763(2021).

    [21] Arellano V, Gutierrez D, Jarabo A. Fast back-projection for non-line of sight reconstruction[J]. Optics Express, 25, 11574-11583(2017).

    [22] Jin C F, Xie J H, Zhang S Q et al. Reconstruction of multiple non-line-of-sight objects using back projection based on ellipsoid mode decomposition[J]. Optics Express, 26, 20089-20101(2018).

    [23] la Manna M, Kine F, Breitbach E et al. Error backprojection algorithms for non-line-of-sight imaging[J]. IEEE Transactions on Pattern Analysis and Machine Intelligence, 41, 1615-1626(2019).

    [24] Metzler C A, Lindell D B, Wetzstein G. Keyhole imaging: non-line-of-sight imaging and tracking of moving objects along a single optical path[J]. IEEE Transactions on Computational Imaging, 7, 1-12(2021).

    [25] Pediredla A K, Buttafava M, Tosi A et al. Reconstructing rooms using photon echoes: a plane based model and reconstruction algorithm for looking around the corner[C](2017).

    [26] Reza S A, la Manna M, Bauer S et al. Phasor field waves: a Huygens-like light transport model for non-line-of-sight imaging applications[J]. Optics Express, 27, 29380-29400(2019).

    [27] Shen S Y, Wang Z, Liu P et al. Non-line-of-sight imaging via neural transient fields[J]. IEEE Transactions on Pattern Analysis and Machine Intelligence, 43, 2257-2268(2021).

    [28] Renna M, Nam J H, Buttafava M et al. Fast-gated 16 × 1 SPAD array for non-line-of-sight imaging applications[J]. Instruments, 4, 14(2020).

    [29] Pei C Q, Zhang A K, Deng Y et al. Dynamic non-line-of-sight imaging system based on the optimization of point spread functions[J]. Optics Express, 29, 32349-32364(2021).

    [31] Liu X C, Guillén I, la Manna M et al. Non-line-of-sight imaging using phasor-field virtual wave optics[J]. Nature, 572, 620-623(2019).

    [32] Feng X H, Gao L. Ultrafast light field tomography for snapshot transient and non-line-of-sight imaging[J]. Nature Communications, 12, 2179(2021).

    [33] Li Z P, Liu X T, Wang J Y et al. Fast non-line-of-sight imaging based on first photon event stamping[J]. Optics Letters, 47, 1928-1931(2022).

    [34] Xu W H, Chen S M, Tian Y Y et al. Fast non-line-of-sight imaging based on product-convolution expansions[J]. Optics Letters, 47, 4680-4683(2022).

    [35] Luesia P, Crespo M, Jarabo A et al. Non-line-of-sight imaging in the presence of scattering media using phasor fields[J]. Optics Letters, 47, 3796-3799(2022).

    [36] Feng S, Kane C, Lee P A et al. Correlations and fluctuations of coherent wave transmission through disordered media[J]. Physical Review Letters, 61, 834-837(1988).

    [37] Freund I, Rosenbluh M, Feng S C. Memory effects in propagation of optical waves through disordered media[J]. Physical Review Letters, 61, 2328-2331(1988).

    [38] Katz O, Heidmann P, Fink M et al. Non-invasive single-shot imaging through scattering layers and around corners via speckle correlations[J]. Nature Photonics, 8, 784-790(2014).

    [39] Smith B M, Desai P, Agarwal V et al. CoLux: multi-object 3D micro-motion analysis using speckle imaging[J]. ACM Transactions on Graphics, 36, 1-12(2017).

    [40] Xie X S, Liu Y K, Liang H W et al. Speckle correlation imaging: from point spread functions to light field plenoptics[J]. Acta Optica Sinica, 40, 0111004(2020).

    [41] Pei X C, Luo S Q, Shan H M et al. Model development and applications extension of the shower-curtain effect(invited)[J]. Infrared and Laser Engineering, 51, 20220299(2022).

    [42] Wu S K, Zhang Y N. Research progress of passive non-line-of-sight imaging methods[J]. Optoelectronic Technology, 41, 87-93(2021).

    [43] Viswanath A, Rangarajan P, MacFarlane D et al. Indirect imaging using correlography[C], CM2E.3(2018).

    [44] Smith B M, O’Toole M, Gupta M. Tracking multiple objects outside the line of sight using speckle imaging[C], 6258-6266(2018).

    [45] Metzler C A, Heide F, Rangarajan P et al. Deep-inverse correlography: towards real-time high-resolution non-line-of-sight imaging[J]. Optica, 7, 63-71(2020).

    [46] Lei X, He L Y, Tan Y X et al. Direct object recognition without line-of-sight using optical coherence[C], 11729-11738(2020).

    [47] Divitt S, Gardner D F, Watnik A T. Imaging around corners in the mid-infrared using speckle correlations[J]. Optics Express, 28, 11051-11064(2020).

    [48] Willomitzer F, Rangarajan P V, Li F Q et al. Fast non-line-of-sight imaging with high-resolution and wide field of view using synthetic wavelength holography[J]. Nature Communications, 12, 6647(2021).

    [49] Batarseh M, Sukhov S, Shen Z et al. Passive sensing around the corner using spatial coherence[J]. Nature Communications, 9, 3629(2018).

    [50] Beckus A, Tamasan A, Atia G K. Multi-modal non-line-of-sight passive imaging[J]. IEEE Transactions on Image Processing, 28, 3372-3382(2019).

    [51] Seidel S W, Ma Y T, Murray-Bruce J et al. Corner occluder computational periscopy: estimating a hidden scene from a single photograph[C](2019).

    [52] Velten A, Willwacher T, Gupta O et al. Recovering three-dimensional shape around a corner using ultrafast time-of-flight imaging[J]. Nature Communications, 3, 745(2012).

    [53] Baradad M, Ye V, Yedidia A B et al. Inferring light fields from shadows[C], 6267-6275(2018).

    [54] Yedidia A B, Baradad M, Thrampoulidis C et al. Using unknown occluders to recover hidden scenes[C], 12223-12231(2020).

    [55] Bouman K L, Ye V, Yedidia A B et al. Turning corners into cameras: principles and methods[C], 2289-2297(2017).

    [56] Tancik M, Swedish T, Satat G et al. Data-driven non-line-of-sight imaging with a traditional camera[C], IW2B.6(2018).

    [57] Saunders C, Murray-Bruce J, Goyal V K. Computational periscopy with an ordinary digital camera[J]. Nature, 565, 472-475(2019).

    [58] Chen Q, Chamoli S K, Yin P et al. Imaging of hidden object using passive mode single pixel imaging with compressive sensing[J]. Laser Physics Letters, 15, 126201(2018).

    [59] Musarra G, Lyons A, Conca E et al. Non-line-of-sight three-dimensional imaging with a single-pixel camera[J]. Physical Review Applied, 12, 011002(2019).

    [60] Klein J, Peters C, Martín J et al. Tracking objects outside the line of sight using 2D intensity images[J]. Scientific Reports, 6, 32491(2016).

    [61] Chen W Z, Daneau S, Brosseau C et al. Steady-state non-line-of-sight imaging[C], 6783-6792(2020).

    [62] Kaga M, Kushida T, Takatani T et al. Thermal non-line-of-sight imaging from specular and diffuse reflections[J]. IPSJ Transactions on Computer Vision and Applications, 11, 8(2019).

    [63] O’Toole M, Lindell D B, Wetzstein G. Confocal non-line-of-sight imaging based on the light-cone transform[J]. Nature, 555, 338-341(2018).

    [64] Lindell D B, Wetzstein G, O’Toole M. Wave-based non-line-of-sight imaging using fast f-k migration[J]. ACM Transactions on Graphics, 38, 1-13(2019).

    Tools

    Get Citation

    Copy Citation Text

    Zhenyu Zhang, Yan Shi, Shengxin Dai, Chunlian Zhan, Tianqi Zhao, Shangzhong Jin. Research Progresses on Non-Line-of-Sight Imaging Technology[J]. Laser & Optoelectronics Progress, 2023, 60(14): 1400001

    Download Citation

    EndNote(RIS)BibTexPlain Text
    Save article for my favorites
    Paper Information

    Category: Reviews

    Received: Nov. 22, 2022

    Accepted: Jan. 10, 2023

    Published Online: May. 23, 2023

    The Author Email: Shi Yan (shiyan@cjlu.edu.cn)

    DOI:10.3788/LOP223128

    Topics