Infrared and Laser Engineering, Volume. 52, Issue 2, 20220318(2023)
Review of Time-of-Flight imaging through scattering media technology
[1] W Jang, C Je, Y Seo, et al. Structured-light stereo: Comparative analysis and integration of structured-light and active stereo for measuring dynamic shape. Optics & Lasers in Engineering, 51, 1255-1264(2013).
[2] H Xiong, Z Zong, C Chen. Approach for accurately extracting the full resolution centers of structured light stripe. Optics and Precision Engineering, 17, 1057-1062(2009).
[3] [3] Ridan A O, Newe T, Toal D, et al. Stereo vision sensing: Review of existing systems[C]International Conference on Sensing Technology, 2018: 178184.
[4] J Sun, Z Wu, Q Liu, et al. Field calibration of stereo vision sensor with large FOV. Optics and Precision Engineering, 17, 633-640(2009).
[5] Q H Wang, S Wang, B Li, et al. In-situ 3D reconstruction of worn surface topography via optimized photometric stereo. Measurement, 190, 110679(2022).
[6] Y Bu, X Du, Z Zeng, et al. Research progress and trend analysis of non-scanning laser 3D imaging radar. Chinese Optics, 11, 711-727(2018).
[7] F Wang, W Tang, T Wang, et al. Design of 3D laser imaging receiver based on 8×8 APD detector array. Chinese Optics, 8, 422-427(2015).
[8] R Lange, P Seitz. Solid-state time-of-flight range camera. IEEE Journal of Quantum Electronics, 37, 390-397(2001).
[9] [9] Mufti F, Mahony R. Statistical analysis of measurement processes f timeofflight cameras[C]Proceedings of SPIE, 2009, 7447: 720–731.
[10] B Langmann, K Hartmann, O Loffeld. Increasing the accuracy of Time-of-Flight cameras for machine vision applications. Computers in Industry, 64, 1090-1098(2013).
[11] A Kadambi, R Raskar. Rethinking machine vision time of flight with GHz heterodyning. IEEE Access, 5, 26211-26223(2017).
[12] J Molina, M Escudero-Viñolo, A Signoriello, et al. Real-time user independent hand gesture recognition from time-of-flight camera video using static and dynamic models. Machine Vision & Applications, 24, 187-204(2013).
[13] [13] Behrje U, Himstedt M, Maehle E. An autonomous fklift with 3D timeofflight camerabased localization navigation[C]2018 15th International Conference on Control, Automation, Robotics Vision (ICARCV), 2018: 17391746.
[14] I Niskanen, M Immonen, L Hallman, et al. Time-of-flight sensor for getting shape model of automobiles toward digital 3D imaging approach of autonomous driving-ScienceDirect. Automation in Construction, 121, 103429(2021).
[15] Chunqing Lu, Mengfei Yang, Yanpeng Wu, et al. Research on pose measurement and ground object recognition technology based on C-TOF imaging. Infrared and Laser Engineering, 49, 0113005(2020).
[16] A Bhandari, R Raskar. Signal processing for time-of-flight imaging sensors: An introduction to inverse problems in computational 3-D imaging. IEEE Signal Processing Magazine, 33, 45-58(2016).
[17] [17] Lin J, Liu Y, Hullin M B, et al. Fourier analysis on transient imaging with a multifrequency timeofflight camera[C] 2014 IEEE Conference on Computer Vision Pattern Recognition, IEEE, 2014: 32303237.
[18] [18] Godbaz J P, Cree M J, Drington A A. Mixed pixel return separation f a fullfield ranger[C]Image & Vision Computing New Zeal, Ivcnz International Conference, IEEE, 2009: 16.
[19] [19] Drington A A, Godbaz J P, Cree M J, et al. Separating true range measurements from multipath scattering interference in commercial range cameras[C]Proceedings of SPIE, 2011, 7864: 110.
[20] S S Patil, P M Bhade, V S Inamdar. Depth recovery in time of flight range sensors via compressed sensing algorithm. International Journal of Intelligent Robotics and Applications, 4, 243-251(2020).
[21] [21] Freedman D, Krupka E, Smolin Y, et al. SRA: Fast removal of general multipath f ToF senss[C] European Conference on Computer Vision(ECCV 2014), 2014, 8689: 234249.
[22] B Jiang, X Jin, Y Peng, et al. Design of multipath error correction algorithm of coarse and fine sparse decomposition based on compressed sensing in time-of-flight cameras. The Imaging Science Journal, 67, 464-474(2020).
[23] [23] Bhari A, Feigin M, Izadi S, et al. Resolving multipath interference in Kinect: An inverse problem approach[C]Valencia, Spain Senss, IEEE, November 25, 2014: 614617.
[24] [24] Kirmani A, Benedetti A, Chou P A. SPUMIC: Simultaneous phase unwrapping multipath interference cancellation in timeofflight cameras using spectral methods[C]Multimedia Expo (ICME), 2013 IEEE International Conference , 2013: 16.
[25] R Whyte, L Streeter, M J Cree, et al. Resolving multiple propagation paths in time of flight range cameras using direct and global separation methods. Optical Engineering, 54, 1131109(2015).
[26] J Marco, Q Hernandez, A Muoz, et al. DeepToF: Off-the-shelf real-time correction of multipath interference in time-of-flight imaging. ACM Transactions on Graphics, 36, 1-12(2018).
[27] [27] Su S, Heide F, Wetzstein G, et al. Deep endtoend timeofflight imaging[C]2018 IEEECVF Conference on Computer Vision Pattern Recognition (CVPR), 2018: 63836392.
[28] [28] Agresti G, Schaefer H, Sart P, et al. Unsupervised domain adaptation f tof data denoising with adversarial learning[C]2019 IEEECVF Conference on Computer Vision Pattern Recognition (CVPR), 2020: 55795586.
[29] D Nitzan, A E Brain, R O Duda. The measurement and use of registered reflectance and range data in scene analysis. Proceedings of the IEEE, 65, 206-220(1977).
[30] T Spirig, P Seitz, O Vietze, et al. The lock-in CCD-two-dimensional synchronous detection of light. IEEE Journal of Quantum Electronics, 31, 1705-1708(1995).
[31] [31] Lange R, Seitz P, Biber A, et al. Timeofflight range imaging with a custom solid state image sens[C]Proceedings of SPIE, 1999, 3823: 180191.
[32] [32] Zanuttigh P, Marin G, Mutto C D, et al. Timeofflight structured light depth cameras: Technology applications[M]. Switzerl: Springer International Publishing, 2016: 27113.
[33] Chunqing Lu, Yuzhi Song, Yanpeng Wu, et al. Theoretical investigation on correlating time-of-flight 3 D sensation error. Infrared and Laser Engineering, 48, 1113002(2019).
[34] D Bronzi, Y Zou, F Villa, et al. Automotive three-dimensional vision through a single-photon counting SPAD camera. IEEE Transactions on Intelligent Transportation Systems, 17, 782-795(2016).
[35] [35] Laurenzis M, Christnacher F, Bacher E, et al. New approaches of threedimensional rangegated imaging in scattering environments[C] Proceedings of SPIE, 2011, 8186(1): 818603.
[36] D W Illig, W D Jemison, L J Mullen. Independent component analysis for enhancement of an FMCW optical ranging technique in turbid waters. Applied Optics, 55, C25-C33(2016).
[37] D Kijima, T Kushida, H Kitajima, et al. Time-of-flight imaging in fog using multiple time-gated exposures. Optics Express, 29, 6453-6467(2021).
[38] L G Henyey, J L Greenstein. Diffuse radiation in the Galaxy. Astrophysical Journal, 93, 70-83(1941).
[39] X Yin, H Cheng, K Yang, et al. Bayesian reconstruction method for underwater 3D range-gated imaging enhancement. Applied Optics, 59, 370-379(2020).
[40] C Consani, N Druml, M Dielacher, et al. Fog effects on time-of-flight imaging investigated by ray-tracing simulations. MPDI, 2, 859(2018).
[41] M Gupta, S K Nayar, M B Hullin, et al. Phasor imaging: A generalization of correlation-based time-of-flight imaging. ACM Transactions on Graphics, 34, 1-18(2015).
[42] T Muraji, K Tanaka, T Funatomi, et al. Depth from phasor distortions in fog. Optics Express, 27, 18858-18868(2019).
[43] [43] Fujimura Y, Sonogashira M, Iiyama M. Defogging kinect: Simultaneous estimation of object region depth in foggy scenes[EBOL]. (20190401)[20220509]. https:arxiv.gabs1904.00558.
[44] Y Fujimura, M Sonogashira, M Iiyama. Simultaneous estimation of object region and depth in participating media using a ToF camera. IEICE Transactions on Information and Systems, 103-D, 660-673(2020).
[45] Y Zhang, X Wang, Y Zhao, et al. Time-of-flight imaging in fog using polarization phasor imaging. Sensors, 22, 3159(2022).
[46] H Lu, Y Zhang, Y Li, et al. Depth map reconstruction for underwater kinect camera using inpainting and local image mode filtering. IEEE Access, 5, 7115-7122(2017).
[47] F Heide, M B Hullin, J Gregson, et al. Low-budget transient imaging using photonic mixer devices. ACM Transactions on Graphics, 32, 45(2013).
[48] [48] Smith A M, Skupski J, Davis J. Transient rendering[R]. Santa Cruz, CA: School of Engineering, University of Califnia, Santa Cruz, 2008.
[49] [49] Lin J, Liu Y, Hullin M B, et al. Fourier analysis on transient imaging with a multifrequency timeofflight camera[C]2014 IEEE Conference on Computer Vision Pattern Recognition, June, 2328, 2014, Columbus, OH, USA, 2014: 32303237.
[50] H Qiao, J Lin, Y Liu, et al. Resolving transient time profile in ToF imaging via log-sum sparse regularization. Optics Letters, 40, 918-921(2015).
[51] F Heide, L Xiao, A Kolb, et al. Imaging in scattering media using correlation image sensors and sparse convolutional coding. Optics Express, 22, 26338-26350(2014).
[52] R H Wu, J N Suo, F Dai, et al. Scattering robust 3D reconstruction via polarized transient imaging. Optics Letters, 41, 3948-3951(2016).
[53] R H Wu, J Adrian, J N Suo, et al. Adaptive polarization-difference transient imaging for depth estimation in scattering media. Optics Letters, 43, 1299-1302(2018).
[54] R H Wu, F Dai, D Yin, et al. Imaging through scattering media based on transient imaging technique. Chinese Journal of Computers, 41, 2421-2435(2018).
[55] R Klose, J Penlington, A Ruckelshausen. Usability of 3D time-of-flight cameras for automatic plant phenotyping. Image Anal Agric Prod Process, 69, 93-105(2011).
[56] W Kazmi, S Foix, G Alenya, et al. Indoor and outdoor depth imaging of leaves with time-of-flight and stereo vision sensors: Analysis and comparison. ISPRS Journal of Photo-grammetry & Remote Sensing, 88, 128-146(2014).
[57] A Dionisio, D José, F Q César, et al. An approach to the use of depth cameras for weed volume estimation. Sensors, 16, 972(2016).
[58] M Vazquez-Arellano, D Reiser, D S Paraforos, et al. 3-D reconstruction of maize plants using a time-of-flight camera. Comput Electron Agr, 145, 235-247(2018).
[59] [59] Tsui C L, Schipf D, Lin K R, et al. Using a time of flight method f underwater 3dimensional depth measurements point cloud imaging[C]OCEANS 2014 TAIPEI, IEEE, 2014.
[60] A Anwer, A S S Azhar, A Khan, et al. Underwater 3-D scene reconstruction using kinect v2 based on physical models for refraction and time of flight correction. IEEE Access, 5, 15960-15970(2017).
[61] [61] Digumarti S T, Chaurasia G, Taneja A, et al. Underwater 3D capture using a lowcost commercial depth camera[C]2016 IEEE Winter Conference on Applications of Computer Vision (WACV), 0710 March 2016.
[62] L Jian, H J Ju, W F Zhang, et al. Review of optical polarimetric dehazing technique. Acta Optica Sinica, 37, 0400001(2017).
[63] K M He, J Sun, X O Tang, et al. Single image haze removal using dark channel prior. IEEE Transactions on Pattern Analysis and Machine Intelligence, 33, 2341-2353(2011).
[64] J Han, K Yang, M Xia, et al. Resolution enhancement in active underwater polarization imaging with modulation transfer function analysis. Applied Optics, 54, 3294-3302(2015).
[65] J Xiao, R Stolkin, Y Gao, et al. Robust fusion of color and depth data for RGB-D target tracking using adaptive range-invariant depth models and spatio-temporal consistency constraints. IEEE Transactions on Cybernetics, 48, 2485-2499(2018).
Get Citation
Copy Citation Text
Xia Wang, Yixin Zhang, Yuwei Zhao, Weiqi Jin. Review of Time-of-Flight imaging through scattering media technology[J]. Infrared and Laser Engineering, 2023, 52(2): 20220318
Category: Optical imaging
Received: May. 9, 2022
Accepted: --
Published Online: Mar. 13, 2023
The Author Email: Wang Xia (angelniuniu@bit.edu.cn)