Researching | Phase unwrapping technology for structured light three-dimensional measurement: A review (invited)

[1] Chen Z, Jiang H Z, Chen X, et al. Measurement of surface defects of optical elements using digital holography[J]. Optics and Precision Engineering, 25, 576-583(2017).

[2] Sun M C, Ma T X, Song Y M, et al. Automatic registration of optical and SAR remote sensingimage based on phase feature[J]. Optics and Precision Engineering, 29, 616-627(2021).

[3] Maier F, Fuentes D, Weinberg J S, et al. Robust phase unwrapping for MR temperature imaging using a magnitude-sorted list, multi-clustering algorithm[J]. Magnetic Resonance in Medicine, 73, 1662-1668(2015).

[4] Wang Y M, Huang D, Su Y, et al. Two-dimensional phase unwrapping in Doppler Fourier domain optical coherence tomography[J]. Optics Express, 24, 26129-26145(2016).

[5] Zhang Z H, Liu W, Liu G D, et al. Overview of the development and application of 3D vision measurement technology[J]. Journal of Image and Graphics, 26, 1483-1502(2021).

[6] Wang Y M, Zhang Z H, Gao N. Review on three-dimensional surface measurement of specular objects based on full-field fringe reflection[J]. Optics and Precision Engineering, 26, 1014-1027(2018).

[7] Zhao J, Zhou Y, Zhao J W, et al. Precision position measurement of pmslm based on apfft and temporal sinusoidal fringe pattern phase retrieval[J]. IEEE Transactions on Industrial Informatics, 16, 7591-7601(2020).

[8] Rao G, Yang X D, Yu H B, et al. Fringe-projection-based normal direction measurement and adjustment for robotic drilling[J]. IEEE Transactions on Industrial Electronics, 67, 9560-9570(2020).

[9] Iskander D R, Wachel P, Simpson P N, et al. Principles of operation, accuracy and precision of an eye surface profiler[J]. Ophthalmic Physiol Optics, 36, 266-278(2016).

[10] Zhang Z H. Review of single-shot 3D shape measurement by phase calculation-based fringe projection techniques[J]. Optics and Lasers in Engineering, 50, 1097-1106(2012).

[11] Huntley J M, Saldner H O. Error-reduction methods for shape measurement by temporal phase unwrapping[J]. Optical Society of America A, 14, 3188-3196(1997).

[12] Marrugo A G, Gao F, Zhang S. State-of-the-art active optical techniques for three-dimensional surface metrology: A review [Invited][J]. Journal of the Optical Society of America A, 37, 60-77(2020).

[13] Zhang S. Absolute phase retrieval methods for digital fringe projection profilometry: A review[J]. Optics and Lasers in Engineering, 107, 28-37(2018).

[14] Zuo C, Feng S J, Huang L, et al. Phase shifting algorithms for fringe projection profilometry: A review[J]. Optics and Lasers in Engineering, 109, 23-59(2018).

[15] Zuo C, Huang L, Zhang M L, et al. Temporal phase unwrapping algorithms for fringe projection profilometry: A comparative review[J]. Optics and Lasers in Engineering, 85, 84-103(2016).

[16] Zuo C, Qian J M, Feng S J, et al. Deep learning in optical metrology: A review[J]. Light Science Applications, 11, 39(2022).

[17] Guo W B, Zhang Q C, Wu Z J. Real-time three-dimensional imaging technique based on phase-shift fringe analysis: A review[J]. Laser and Optoelectronics Progress, 58, 0800001(2021).

[18] Srinivasan V, Liu H C, Halioua M. Automated phase-measuring profilometry of 3D diffuse objects.[J]. Applied Optics, 23, 3105-3108(1984).

[19] Su X Y, Vonbally G, Vukicevic D. Phase-stepping grating profilometry-utilization of intensity modulation analysis in complex objects evaluation[J]. Optics Communications, 98, 141-150(1993).

[20] Zhang S, Yau S-T. High-resolution, real-time 3D absolute coordinate measurement based on a phase-shifting method[J]. Optics Express, 14, 2644-2649(2006).

[21] Zhong J G, Weng J W. Phase retrieval of optical fringe patterns from the ridge of a wavelet transform[J]. Optics Letters, 30, 2560-2562(2005).

[22] Su X Y, Chen W J. Fourier transform profilometry: A review[J]. Optics and Lasers in Engineering, 35, 263-284(2001).

[23] Su X Y, Zhang Q C. Dynamic 3D shape measurement method: A review[J]. Optics and Lasers in Engineering, 48, 191-204(2010).

[24] Su X Y, Zhang Q C, Chen W J. Three-dimensional imaging based on structured illumination[J]. Chinses Journal of Lasers, 41, 0209001(2014).

[25] Huntley J M, Saldner H O. Temporal phase-unwrapping algorithm for automated interferogram analysis[J]. Applied Optics, 32, 3047-3052(1993).

[26] Saldner H O, Huntley J M. Profilometry using temporal phase unwrapping and a spatial light modulator-based fringe projector[J]. Optical Engineering, 36, 610-615(1996).

[27] Saldner H O, Huntley J M. Temporal phase unwrapping: Application to surface profiling of discontinuous objects[J]. Applied Optics, 36, 2770-2775(1997).

[28] Huntley J M, Saldner H O. Shape measurement by temporalphase unwrapping: comparison of unwrapping algorithms[J]. Measurement Science and Technology, 8, 986-992(1997).

[29] Zhao H, Chen W Y, Tan Y S. Phase-unwrapping algorithm for the measurement of three-dimensional object shapes[J]. Applied Optics, 33, 4497-500(1994).

[30] Peng X, Yang Z L, Niu H B. Multi-resolution reconstruction of 3-D image with modified temporal unwrapping algorithm[J]. Optics Communications, 224, 35-44(2003).

[31] Inokuchi S, Sato K, Matsuda F. Range imaging system for 3-d object recognition[J]. International Conference on Computer Vision, 1984, 806-808(1984).

[32] Sansoni G, Carocci M, Rodella R. Three-dimensional vision based on a combination of Gray-code and phase-shift light projection: analysis and compensation of the systematic errors[J]. Applied Optics, 38, 6565-6573(1999).

[33] Zhang Q C, Su X Y, Xiang L Q, et al. 3D shape measurement based on complementary Gray-code light[J]. Optics and Lasers in Engineering, 50, 574-579(2012).

[34] Zheng D L, Da F P. Self-correction phase unwrapping method based on Gray-code light[J]. Optics and Lasers in Engineering, 50, 1130-1139(2012).

[35] Zheng D, Da F, Qian K M, et al. Phase-shifting profilometry combined with Gray-code patterns projection: unwrapping error removal by an adaptive median filter[J]. Optics Express, 25, 4700-4713(2017).

[36] Wu Z J, Zuo C, Guo W B, et al. High-speed three-dimensional shape measurement based on cyclic complementary Gray-code light[J]. Optics Express, 27, 1283-1297(2019).

[37] Wu Z J, Guo W B, Zhang Q C. High-speed three-dimensional shape measurement based on shifting Gray-code light[J]. Optics Express, 27, 22631-22644(2019).

[38] Lu L L, Wu Z J, Zhang Q C. Dynamic three-dimensional shape measurement method based on misaligned Gray-code[J]. Acta Optica Sinica, 42, 0512005(2022).

[39] Wu Z J, Guo W B, Li Y Y, et al. High-speed and high-efficiency three-dimensional shape measurement based on Gray-coded light[J]. Photonics Research, 8, 819-829(2020).

[40] Wu Z J, Guo W B, Pan B, et al. A DIC-assisted fringe projection profilometry for high-speed 3D shape, displacement and deformation measurement of textured surfaces[J]. Optics and Lasers in Engineering, 142, 106614(2021).

[41] Wu Z J, Guo W B, Lu L L, et al. Generalized phase unwrapping method that avoids jump errors for fringe projection profilometry[J]. Optics Express, 29, 27181-27192(2021).

[42] Zheng D L, Qian K M, Da F P, et al. Ternary Gray code-based phase unwrapping for 3D measurement using binary patterns with projector defocusing[J]. Applied Optics, 56, 3660-3665(2017).

[43] He X Y, Zheng D L, Qian K M, et al. Quaternary gray-code phase unwrapping for binary fringe projection profilometry[J]. Optics and Lasers in Engineering, 121, 358-368(2019).

[44] Zhang A, Sun Y Q Gao N, et al. Fringe projection profilometry byternary-gray encoded phase unwrapping method[J]. Optics and Precision Engineering, 30, 518-526(2022).

[45] Wang H R, Wu Z J, Zhang Q C, et al. High-speed three-dimensional shape measurement with time multiplexing coding light[J]. Acta Optica Sinica, 43, 0112003(2023).

[46] Li J L, Su H J, Su X Y. Two-frequency grating usedin phase-measuring profilometry[J]. Applied Optics, 36, 277-280(1997).

[47] Towers C E, Towers D P, Jones J D C. Optimum frequency selection in multifrequency interferometry[J]. Optics Letters, 28, 887-889(2003).

[48] Towers C E, Towers D P, Jones J D C. Absolute fringe order calculation using optimised multi-frequency selection in full-field profilometry[J]. Optics and Lasers in Engineering, 43, 788-800(2005).

[49] Zhang Z H, Towers C E, Towers D P. Time efficient color fringe projection system for 3D shape and color using optimum 3-frequency selection[J]. Optics Express, 14, 6444-6455(2006).

[50] Xu Z H. An algorithm of temporal phase unwrapping[J]. Journal of Sichuan University (Natural Science Edition), 45, 537-540(2008).

[51] Liu K, Wang Y C, Lau D L, et al. Dual-frequency pattern scheme for high-speed 3D shape measurement[J]. Optics Express, 18, 5229-5244(2010).

[52] Li L L. Error analysis and algorithm design of temporal phase unwrapping[J]. Journal of Sichuan University(Natural Science Edition), 49, 102-108(2012).

[53] Chen L, Deng W Y, Lou X P. Phase unwrapping method base on multi-frequency interferometry[J]. Optical Technique, 38, 73-78(2012).

[54] Zhang C, Zhao H, Zhang L. Fringe order error in multifrequency fringe projection phase unwrapping: reason and correction[J]. Applied Optics, 54, 9390(2015).

[55] Zhang C W, Zhao H, Jiang K J. Fringe-period selection for a multifrequency fringe-projection phase unwrapping method[J]. Measurement Science and Technology, 27, 085204(2016).

[56] Zhao W J, Chen W J, Su X Y. The comparison of several time phase unwrapping methods[J]. Journal of Sichuan University (Natural Science Edition), 53, 110-117(2016).

[57] Chen S L, Zhao J B, Xia R B. Improvement of the phase unwrapping method based on multi-frequency heterodyne principle[J]. Acta Optica Sinica, 36, 0412004(2016).

[58] Han Y, Yang Y Z, Shu X L. A phase unwrapping method based on multifrequency heterodyne[J]. Journal of Donghua University (Natural Science Edition), 47, 105-110, 127(2021).

[59] Wang Y, Laughner J I, Efimov I R, et al. 3D absolute shape measurement of live rabbit hearts with a superfast two-frequency phase-shifting technique[J]. Optics Express, 21, 5822-5832(2013).

[60] Zhang C W, Zhao H, Gu F F, et al. Phase unwrapping algorithm based on multi-frequency fringe projection and fringe background for fringe projection profilometry[J]. Measurement Science and Technology, 26, 045203(2015).

[61] Zhang M L, Chen Q, Tao T Y, et al. Robust and efficient multi-frequency temporal phase unwrapping: optimal fringe frequency and pattern sequence selection[J]. Optics Express, 25, 20381-20400(2017).

[62] [62] Zhang S. Digital multiple wavelength phase shifting algithm[C]Proceedings of SPIE, 2009, 7432: 74320N.

[63] Zhang S. Phase unwrapping error reduction framework for a multiple-wavelength phase-shifting algorithm[J]. Optical Engineering, 48, 105601(2009).

[64] Zhong J G, Zhang Y L. Absolute phase-measurement technique based on number theory in multifrequency grating projection profilometry[J]. Applied Optics, 40, 492-500(2001).

[65] Zhong J G, Wang M. Phase unwrapping by a lookup table method: application to phase maps with singular points[J]. Optical Engineering, 38, 2075-2080(1999).

[66] Zuo C, Chen Q, Gu G H, et al. High-speed three-dimensional shape measurement for dynamic scenes using bi-frequency tripolar pulse-width-modulation fringe projection[J]. Optics and Lasers in Engineering, 51, 953-960(2013).

[67] Anand A, Zhou W. Fast phase-unwrapping algorithmbased on a gray-scale mask and flood fill[J]. Applied Optics, 37, 5416-5420(1998).

[68] Fang S P, Meng L, Wang L J, et al. Quality-guided phase unwrapping algorithm based on reliability evaluation[J]. Applied Optics, 50, 5446-5452(2011).

[69] Li S K, Chen W J, Su X Y. Reliability-guided phase unwrapping in wavelet-transform profilometry[J]. Applied Optics, 47, 3369-3377(2008).

[70] Qian K M, Gao W J, Wang H X. Windowed Fourier-filtered and quality-guided phase-unwrapping algorithm[J]. Applied Optics, 47, 5420-5428(2008).

[71] Qian K M, Gao W J, Wang H X. Windowed Fourier filtered and quality guidedphase unwrapping algorithm: On locallyhigh-order polynomial phase[J]. Applied Optics, 49, 1075-1079(2010).

[72] Su X Y. Phase unwrapping techniques for 3D shape measurement[J]. International Conference on Holography and Optical Information Processing, 2866, 460-465(1996).

[73] Su X Y, Chen W J. Reliability-guided phase unwrapping algorithm: A review[J]. Optics and Lasers in Engineering, 42, 245-261(2004).

[74] Zhang S, Li X L, Yau S T. Multilevel quality-guided phase unwrapping algorithm forreal-time three-dimensional shape reconstruction[J]. Applied Optics, 46, 50-57(2007).

[75] Itoh K. Analysis of the phase unwrapping algorithm[J]. Applied Optics, 21, 2470(1982).

[76] Zhao M, Huang L, Zhang Q C, et al. Quality-guided phase unwrapping technique: Comparison of quality maps and guiding strategies[J]. Applied Optics, 50, 6214-6224(2011).

[77] Zhao M, Qian K M. Quality-guided phase unwrapping implementation: an improved indexed interwoven linked list[J]. Applied Optics, 53, 3492-3500(2014).

[78] Amjad J M. Robust and fast filtering method for enhancement of two-dimensional quality-guided path unwrapping algorithms[J]. Applied Optics, 59, 3920-3926(2020).

[79] Arevalillo-herraez M, Villatoro F R, Gdeisat M A. A robust and simple measure for quality-guided 2 D phase unwrapping algorithms[J]. IEEE Transactions on Image Processing, 25, 2601-2609(2016).

[80] Goldstein R M, Zebker H A, Werner C L. Satellite radar interferometry: Two-dimensional phase unwrapping[J]. Radio Science, 23, 713-720(1988).

[81] Huntley J M. Noise-immune phase unwrapping algorithm[J]. Applied Optics, 28, 3268-3270(1989).

[82] Zheng D L, Da F P. A novel algorithm for branch cut phase unwrapping[J]. Optics and Lasers in Engineering, 49, 609-617(2011).

[83] Zhang Y, Feng D Z, Qu X N, et al. Application of a novel branch-cut algorithm in phase unwrapping[J]. Journal of University of Electronic Science and Technology of China, 42, 555-558(2013).

[84] Desouza J C, Oliveira M E, Dossantos P A. Branch-cut algorithm for optical phase unwrapping[J]. Optics Letters, 40, 3456-3459(2015).

[85] Chang L, Yang Z C, Guo Y M, et al. Application of improved branch-cut algorithm in dynamic 3D reconstruction[J]. Electronic Measurement Technology, 44, 22-25(2021).

[86] Gdeisat M A, Burton D R, Lilley F, et al. Aiding phase unwrapping by increasing the number of residues in two-dimensional wrapped-phase distributions[J]. Applied Optics, 54, 10073-10078(2015).

[87] Du G L, Wang M M, Zhou C L, et al. A simple spatial domain algorithm to increase the residues of wrapped phase maps[J]. Journal of Modern Optics, 64, 231-237(2016).

[88] Block H D. The perceptron: A model for brain functioning. I[J]. Reviews of Modern Physics, 34, 123-135(1962).

[89] Bengio Y, Lamblin P, Popovici D, et al. Greedy layer-wise training of deep networks[J]. Neural Information Processing Systems, 19, 153-160(2006).

[90] Hinton G E, Osindero S. A fast learning algorithm for deep belief net[J]. Neural Computation, 18, 1527-1554(2006).

[91] Jin K H, Mccann M T. Deep convolutional neural network for inverse problems in imaging[J]. IEEE Transactions on Image Processing, 26, 4509-4522(2017).

[92] Lecun Y, Bengio Y, Hinton G. Deep learning[J]. Nature, 521, 436-444(2015).

[93] Lucas A, Iliadis M, Molina R, et al. Using deep neural networks for inverse problems in imaging: Beyond analytical methods[J]. IEEE Signal Processing Magazine, 35, 20-36(2018).

[94] Schmidhuber J. Deep learning in neural networks: An overview[J]. Neural Netw, 61, 85-117(2015).

[95] Barbastathis G, Ozcan A, Situ G H. On the use of deep learning for computational imaging[J]. Optica, 6, 921-943(2019).

[96] [96] Spothi G E, Gthi S, Gthi R K S. A deep learningbased model f phase unwrapping[C]Proceedings of the 11th Indian Conference on Computer Vision, Graphics Image Processing, Hyderabad, India: ICVGIP, 2018: 18.

[97] Spoorthi G E, Gorthi S, Gorthi R K S. Phase net: A deep convolutional neural network for two-dimensional phase unwrapping[J]. IEEE Signal Processing Letters, 26, 54-58(2019).

[98] Spoorthi G E, Sai Subrahmanyam Gorthi R K, Gorthi S. PhaseNet 2.0: Phase unwrapping of noisy data based on deep learning approach[J]. IEEE Transactions on Image Processing, 29, 4862-4872(2020).

[99] Wang K Q, Li Y, Qian K M, et al. One-step robust deep learning phase unwrapping[J]. Optics Express, 27, 15100-15115(2019).

[100] Zhang J C, Tian X B, Shao J B, et al. Phase unwrapping in optical metrology via denoised and convolutional segmentation networks[J]. Optics Express, 27, 14903-14912(2019).

[101] Zhang T, Jiang S W, Zhao Z X, et al. Rapid and robust two-dimensional phase unwrapping via deep learning[J]. Optics Express, 27, 23173-23185(2019).

[102] Liang J, Zhang J C, Shao J B, et al. Deep convolutional neural network phase unwrapping for fringe projection 3D imaging[J]. Sensors, 20, 3691(2020).

[103] Sumanth K, Ravi V, Gorthi R K. A multi-task learning for 2D phase unwrapping in fringe projection[J]. IEEE Signal Processing Letters, 29, 797-801(2022).

[104] Yin W, Chen Q, Feng S J, et al. Temporal phase unwrapping using deep learning[J]. Scientific Reports, 9, 20175(2019).

[105] Yao P C, Gai S Y, Da F P. Coding-Net: A multi-purpose neural network for fringe projection profilometry[J]. Optics Communications, 489, 126887(2021).

[106] Yao P C, Gai S Y, Chen Y C, et al. A multi-code 3D measurement technique based on deep learning[J]. Optics and Lasers in Engineering, 143, 106623(2021).

[107] Feng S J, Chen Q, Gu G H, et al. Fringe pattern analysis using deep learning[J]. Advanced Photonics, 1, 025001(2019).

[108] Feng S J, Zuo C, Hu Y, et al. Deep-learning-based fringe-pattern analysis with uncertainty estimation[J]. Optica, 8, 1507-1510(2021).

[109] Qian J M, Feng S J, Tao T Y, et al. Deep-learning-enabled geometric constraints and phase unwrapping for single-shot absolute 3D shape measurement[J]. APL Photonics, 5, 046105(2020).

[110] Yu H T, Chen X Y, Zhang Z, et al. Dynamic 3-D measurement based on fringe-to-fringe transformation using deep learning[J]. Optics Express, 28, 9405-9418(2020).

[111] Qian J M, Feng S J, Li Y X, et al. Single-shot absolute 3D shape measurement with deep-learning-based color fringe projection profilometry[J]. Optics Letters, 45, 1842-1845(2020).

[112] Li Y X, Qian J M, Feng S K, et al. Composite fringe projection deep learning profilometry for single-shot absolute 3D shape measurement[J]. Optics Express, 30, 3424-3442(2022).

[113] Li Y X, Qian J M, Feng S J, et al. Deep-learning-enabled dual-frequency composite fringe projection profilometry for single-shot absolute 3D shape measurement[J]. Opto-Electronic Advances, 5, 210021(2022).

[114] Li W J, Yu J, Gai S Y, et al. Absolute phase retrieval for a single-shot fringe projection profilometry based on deep learning[J]. Optical Engineering, 60, 064104(2021).

[115] [115] Liu K, Zhang Y Z. Tempal phase unwrapping with a lightweight deep neural wk[C]Optics Frontier Online 2020: Optics Imagine Display(OFO1), Shanghai, China, 2020, 11571: 115710N.

[116] Bai S L, Luo X L, Xiao K, et al. Deep absolute phase recovery from single- frequency phase map for handheld 3D measurement[J]. Optics Communications, 512, 128008(2022).

[117] Yu H T, Han B, Bai L, et al. Untrained deep learning-based fringe projection profilometry[J]. APL Photonics, 7, 016102(2022).

[118] Zhu J P, Su X Y, You Z S, et al. Temporal-spatial encoding binary fringes toward three-dimensional shape measurement without projector nonlinearity[J]. Optical Engineering, 54, 054108(2015).

[119] Zhou P, Zhu J P, Su X Y, et al. Experimental study of temporal-spatial binary pattern projection for 3D shape acquisition[J]. Applied Optics, 56, 2995-3003(2017).

[120] Zhu J P, Zhou P, Su X Y, et al. Accurate and fast 3D surface measurement with temporal-spatial binary encoding structured illumination[J]. Optics Express, 24, 28549-28560(2016).

[121] Zhong K, Li Z W, Shi Y S, et al. Fast phase measurement profilometry for arbitrary shape objects without phase unwrapping[J]. Optics and Lasers in Engineering, 51, 1213-1222(2013).

[122] Hyun J S, Zhang S. Enhanced two-frequency phase-shifting method[J]. Applied Optics, 55, 4395-4401(2016).

[123] An Y, Hyun J S, Zhang S. Pixel-wise absolute phase unwrapping using geometric constraints of structured light system[J]. Optics Express, 24, 18445-18459(2016).

[124] Yin W, Zuo C, Feng S J, et al. High-speed three-dimensional shape measurement using geometry-constraint-based number-theoretical phase unwrapping[J]. Optics and Lasers in Engineering, 115, 21-31(2019).

[125] Dai J, An Y, Zhang S. Absolute three-dimensional shape measurement with a known object[J]. Optics Express, 25, 10384-10396(2017).

[126] Qi Z S, Liu X J, Wang Z, et al. Photometric constraint for absolute phase unwrapping from single-frequency fringe patterns[J]. Optical Express, 29, 12663-12680(2021).

[127] Di J L, Tang Ju, Wu J, et al. Reasearch progress in the applications of convolutional neural networks in optical information processing[J]. Laser and Optoelectronics Progress, 58, 1600001(2021).

[128] Yue H M. Temporal phase unwrapping progress[J]. Laser Journal, 25, 9-12(2004).