Infrared and Laser Engineering, Volume. 51, Issue 3, 20210471(2022)

Research advances on non-line-of-sight three-dimensional imaging lidar

Chenfei Jin1, Xiaorui Tian1, Meng Tang1, Feng Wang2, Jie Yang1, Kai Qiao1, Xiaojie Shi1, and Siqi Zhang1
Author Affiliations
  • 1School of Physics, Harbin Institute of Technology, Harbin 150001, China
  • 2Tianjin Jinhang Institute of Technical Physics, Tianjin 300308, China
  • show less
    References(49)

    [1] Velten A, Willwacher T, Gupta O, et al. Recovering three-dimensional shape around a corner using ultrafast time-of-flight imaging[J]. Nature Communications, 3, 1-8(2012).

    [2] Gupta O, Willwacher T, Velten A, et al. Reconstruction of hidden 3D shapes using diffuse reflections[J]. Optics Express, 20, 19096-19108(2012).

    [3] Katz O, Heidmann P, Fink M, et al. Non-invasive single-shot imaging through scattering layers and around corners via speckle correlations[J]. Nature Photonics, 8, 784-790(2014).

    [4] Saunders C, Murray-Bruce J, Goyal V K. Computational periscopy with an ordinary digital camera[J]. Nature, 565, 472-475(2019).

    [5] [5] Maeda T, Wang Y, Raskar R, et al. Thermal nonlineofsight imaging[C]2019 IEEE International Conference on Computational Photography (ICCP). IEEE, 2019: 111.

    [6] Kaga M, Kushida T, Takatani T, et al. Thermal non-line-of-sight imaging from specular and diffuse reflections[J]. IPSJ Transactions on Computer Vision and Applications, 11, 1-6(2019).

    [7] [7] Lindell D B, Wetzstein G, Koltun V. Acoustic nonlineofsight imaging[C]Proceedings of the IEEECVF Conference on Computer Vision Pattern Recognition. 2019: 67806789.

    [8] [8] Scheiner N, Kraus F, Wei F, et al. Seeing around street cners: Nonlineofsight detection tracking inthewild using doppler radar[C]Proceedings of the IEEECVF Conference on Computer Vision Pattern Recognition, 2020: 20682077.

    [9] [9] Chen W, Daneau S, Mannan F, et al. Steadystate nonlineofsight imaging[C]Proceedings of the IEEECVF Conference on Computer Vision Pattern Recognition, 2019: 67906799.

    [10] Repasi E, Lutzmann P, Steinvall O, et al. Advanced short-wavelength infrared range-gated imaging for ground applications in monostatic and bistatic configurations[J]. Applied Optics, 48, 5956-5969(2009).

    [11] [11] Steinvall O, Elmqvist M, Larsson H. See around the cner using active imaging[C]ElectroOptical Remote Sensing, Photonic Technologies, Applications V, 2011, 8186: 818605.

    [12] Xu Kaida, Jin Weiqi, Liu Jing, et al. Non-line-of-sight imaging based on laser range-gated imaging technology[J]. Infrared and Laser Engineering, 41, 2073-2078(2012).

    [13] Xu Kaida, Jin Weiqi, Liu Jing, et al. Analysis of non-line-of-sight imaging characteristics based on laser range-gated imaging[J]. Acta ArmamentarII, 35, 2003-2009(2014).

    [14] Xu K, Jin W, Zhao S, et al. Image contrast model of non-line-of-sight imaging based on laser range-gated imaging[J]. Optical Engineering, 53, 1-9(2013).

    [15] Han Hongwei, Zhong Wei. Experimental study of non-line-of-sight imaging technology[J]. Optical Instruments, 37, 220-225(2015).

    [16] [16] Laurenzis M, Velten A. Nonlineofsight active imaging of scattered photons[C]ElectroOptical Remote Sensing, Photonic Technologies, Applications VII; Military Applications in Hyperspectral Imaging High Spatial Resolution Sensing, 2013, 8897: 889706.

    [17] Laurenzis M, Velten A. Nonline-of-sight laser gated viewing of scattered photons[J]. Optical Engineering, 53, 1-6(2014).

    [18] [18] Heide F, Xiao L, Heidrich W, et al. Diffuse mirrs: 3D reconstruction from diffuse indirect illumination using inexpensive timeofflight senss[C]Proceedings of the IEEE Conference on Computer Vision Pattern Recognition, 2014: 32223229.

    [19] [19] Hullin M B. Computational imaging of light in flight[C]Optoelectronic Imaging Multimedia Technology III, 2014, 9273: 927314.

    [20] Heide F, Hullin M B, Gregson J, et al. Low-budget transient imaging using photonic mixer devices[J]. ACM Transactions on Graphics (ToG), 32, 1-10(2013).

    [21] Buttafava M, Zeman J, Tosi A, et al. Non-line-of-sight imaging using a time-gated single photon avalanche diode[J]. Optics Express, 23, 20997-21011(2015).

    [22] Laurenzis M, Klein J, Bacher E, et al. Multiple-return single-photon counting of light in flight and sensing of non-line-of-sight objects at shortwave infrared wavelengths[J]. Optics Letters, 40, 4815-4818(2015).

    [23] Gariepy G, Tonolini F, Henderson R, et al. Detection and tracking of moving objects hidden from view[J]. Nature Photonics, 10, 23-26(2016).

    [24] Chan S, Warburton R E, Gariepy G, et al. Non-line-of-sight tracking of people at long range[J]. Optics Express, 25, 10109-10117(2017).

    [25] Shen Tianming, You Xiaoming. Preliminary study of non-line-of-sight imaging system[J]. Infrared, 39, 20-23(2018).

    [26] Wu Jingyao, Su Xiuqin, Tan Jingjing, et al. Study of theory for transient imaging of hidden object using single-photon array detector[J]. Infrared and Laser Engineering, 47, S122001(2018).

    [27] Xu F, Shulkind G, Thrampoulidis C, et al. Revealing hidden scenes by photon-efficient occlusion-based opportunistic active imaging[J]. Optics Express, 26, 9945-9962(2018).

    [28] O’Toole M, Lindell D B, Wetzstein G. Confocal non-line-of-sight imaging based on the light-cone transform[J]. Nature, 555, 338-341(2018).

    [29] Lindell D B, Wetzstein G, O'Toole M. Wave-based non-line-of-sight imaging using fast f-k migration[J]. ACM Transactions on Graphics (TOG), 38, 1-13(2019).

    [30] Liu X, Guillén I, La Manna M, et al. Non-line-of-sight imaging using phasor-field virtual wave optics[J]. Nature, 572, 620-623(2019).

    [31] La Manna M, Nam J H, Reza S A, et al. Non-line-of-sight-imaging using dynamic relay surfaces[J]. Optics Express, 28, 5331-5339(2020).

    [32] Renna M, Nam J H, Buttafava M, et al. Fast-gated 16×1 SPAD array for non-line-of-sight imaging applications[J]. Instruments, 4, 1-18(2020).

    [33] Wu C, Liu J, Huang X, et al. Non–line-of-sight imaging over 1.43 km[J]. Proceedings of the National Academy of Sciences, 118, 1-7(2021).

    [34] Laurenzis M, Velten A. Feature selection and back-projection algorithms for nonline-of-sight laser–gated viewing[J]. Journal of Electronic Imaging, 23, 1-6(2014).

    [35] [35] Laurenzis M, Velten A. Investigation of frametoframe back projection feature ion algithms f nonlineofsight laser gated viewing[C]ElectroOptical Remote Sensing, Photonic Technologies, Applications VIII; Military Applications in Hyperspectral Imaging High Spatial Resolution Sensing IIs, 2014, 9250: 92500J.

    [36] Arellano V, Gutierrez D, Jarabo A. Fast back-projection for non-line of sight reconstruction[J]. Optics Express, 25, 11574-11583(2017).

    [37] La Manna M, Kine F, Breitbach E, et al. Error backprojection algorithms for non-line-of-sight imaging[J]. IEEE Transactions on Pattern Analysis and Machine Intelligence, 41, 1615-1626(2018).

    [38] Li Hairui, Wu Xin, Zhang Jianqi. Reconstruction of the hidden 3D shape for transient imaging simulation[J]. Journal of Xidian University, 45, 66-70(2018).

    [39] Jin C, Xie J, Zhang S, et al. Richardson–Lucy deconvolution of time histograms for high-resolution non-line-of-sight imaging based on a back-projection method[J]. Optics Letters, 43, 5885-5888(2018).

    [40] Jin C, Xie J, Zhang S, et al. Reconstruction of multiple non-line-of-sight objects using back projection based on ellipsoid mode decomposition[J]. Optics Express, 26, 20089-20101(2018).

    [41] Heide F, O’Toole M, Zang K, et al. Non-line-of-sight imaging with partial occluders and surface normals[J]. ACM Transactions on Graphics (ToG), 38, 1-10(2019).

    [42] Kadambi A, Zhao H, Shi B, et al. Occluded imaging with time-of-flight sensors[J]. ACM Transactions on Graphics (ToG), 35, 1-12(2016).

    [43] [43] Pediredla A K, Buttafava M, Tosi A, et al. Reconstructing rooms using photon echoes: A plane based model reconstruction algithm f looking around the cner[C]2017 IEEE International Conference on Computational Photography (ICCP). IEEE, 2017: 112.

    [44] Huang L, Wang X, Yuan Y, et al. Improved algorithm of non-line-of-sight imaging based on the Bayesian statistics[J]. JOSA A, 36, 834-838(2019).

    [45] Ye J T, Huang X, Li Z P, et al. Compressed sensing for active non-line-of-sight imaging[J]. Optics Express, 29, 1749-1763(2021).

    [46] [46] Young S I, Lindell D B, Girod B, et al. Nonlineofsight surface reconstruction using the directional lightcone transfm[C]Proceedings of the IEEECVF Conference on Computer Vision Pattern Recognition, 2020: 14071416.

    [47] [47] Xin S, Nousias S, Kutulakos K N, et al. A they of Fermat paths f nonlineofsight shape reconstruction[C]Proceedings of the IEEECVF Conference on Computer Vision Pattern Recognition, 2019: 68006809.

    [48] Caramazza P, Boccolini A, Buschek D, et al. Neural network identification of people hidden from view with a single-pixel, single-photon detector[J]. Scientific Reports, 8, 1-6(2018).

    [49] [49] Tancik M, Swedish T, Satat G, et al. Datadriven nonlineofsight imaging with a traditional camera[C]Imaging Systems Applications(Optical Society of America), 2018: IW2B.6.

    CLP Journals

    [1] Lixia ZHENG, Wangqiao YOU, Kang HU, Jin WU, Weifeng SUN, Xingye ZHOU. Fast active-passive mixed quenching circuit applied to SPAD array[J]. Infrared and Laser Engineering, 2024, 53(7): 20240136

    [2] Jingpeng Zhang, Qihang Chen, Yanhui Wang, Lei Dong, Zhenzhen Zheng, Wenxin Zhang. Design of LEO target imaging mode with space-based Inverse Synthetic Aperture LADAR[J]. Infrared and Laser Engineering, 2023, 52(5): 20220679

    [3] Yang YANG, Gaoyong LU, Hongran ZENG, Xiaowei LI. Multifunctional integral imaging steganography toward battlefield situation awareness[J]. Infrared and Laser Engineering, 2025, 54(8): 20250001

    [4] Lixia Zheng, Jin Wu, Weifeng Sun, Chenggong Wan, Gaolong Liu, Jiaqi Wang, Bingqing Gu. Key technologies and development trends of SPAD array readout circuit (invited)[J]. Infrared and Laser Engineering, 2023, 52(3): 20220903

    [5] Xin Jin, Dongyu Du, Rujia Deng. Progress and prospect of non-line-of-sight imaging (invited)[J]. Infrared and Laser Engineering, 2022, 51(8): 20220305

    Tools

    Get Citation

    Copy Citation Text

    Chenfei Jin, Xiaorui Tian, Meng Tang, Feng Wang, Jie Yang, Kai Qiao, Xiaojie Shi, Siqi Zhang. Research advances on non-line-of-sight three-dimensional imaging lidar[J]. Infrared and Laser Engineering, 2022, 51(3): 20210471

    Download Citation

    EndNote(RIS)BibTexPlain Text
    Save article for my favorites
    Paper Information

    Category: Lasers & Laser optics

    Received: Jul. 12, 2021

    Accepted: --

    Published Online: Apr. 8, 2022

    The Author Email:

    DOI:10.3788/IRLA20210471

    Topics