Infrared and Laser Engineering, Volume. 49, Issue 3, 0303001(2020)

Has 3D finally come of age? ——An introduction to 3D structured-light sensor

Chao Zuo1,2, Xiaolei Zhang3, Yan Hu1,2,3, Wei Yin1,2,3, Detong Shen3, Jinxin Zhong1,2,3, Jing Zheng3, and Qian Chen2
Author Affiliations
  • 1Smart Computational Imaging Laboratory (SCILab), School of Electronic and Optical Engineering, Nanjing University of Science and Technology, Nanjing 210094, China
  • 2Jiangsu Key Laboratory of Spectral Imaging & Intelligent Sense, Nanjing University of Science and Technology, Nanjing 210094, China
  • 3Nanjing Zircon optoelectronic technology co. LTD, Nanjing 210014, China
  • show less
    References(210)

    [3] R J Woodham. Photometric method for determining surface orientation from multiple images. Optical Engineering, 19, 191139(1980).

    [5] H Deresiewicz, R Skalak. On uniqueness in dynamic poroelasticity. Bulletin of the Seismological Society of America, 53, 783-788(1963).

    [7] [7] Park J S, Tou J T. Highlight separation surface ientations f 3D specular objects[C]10th International Conference on Pattern Recognition. IEEE, 1990, 1: 331–335.

    [8] K Ikeuchi. Determining surface orientations of specular surfaces by using the photometric stereo method. IEEE Transactions on Pattern Analysis and Machine Intelligence, 661-669(1981).

    [9] [9] Wu T P, Tang C K. Dense photometric stereo using a mirr sphere graph cut[C] 2005 IEEE Computer Society Conference on Computer Vision Pattern Recognition (CVPR’05), 2005, 1: 140–147.

    [11] [11] Geiger A, Roser M, Urtasun R. Efficient largescale stereo matching[C]Asian Conference on Computer Vision, 2010: 25–38.

    [12] [12] Tan X, Sun C, Wang D, et al. Soft cost aggregation with multiresolution fusion[C]European Conference on Computer Vision, 2014: 17–32.

    [13] [13] Yang Q, Yang R, Davis J, et al. Spatialdepth super resolution f range images[C] 2007 IEEE Conference on Computer Vision Pattern Recognition, 2007: 1–8.

    [14] K J Yoon, I S Kweon. Adaptive support-weight approach for correspondence search. IEEE Transactions on Pattern Analysis & Machine Intelligence, 650-656(2006).

    [15] A Hosni, C Rhemann, M Bleyer. Fast cost-volume filtering for visual correspondence and beyond. IEEE Transactions on Pattern Analysis and Machine Intelligence, 35, 504-511(2012).

    [16] Q Yang, L Wang, R Yang. Stereo matching with color-weighted correlation, hierarchical belief propagation, and occlusion handling. IEEE Transactions on Pattern Analysis and Machine Intelligence, 31, 492-504(2008).

    [17] [17] Klaus A, Smann M, Karner K. Segmentbased stereo matching using belief propagation a selfadapting dissimilarity measure[C]18th International Conference on Pattern Recognition (ICPR’06), 2006, 3: 15–18.

    [19] [19] Loop C, Zhang Z. Computing rectifying homographies f stereo vision[C]1999 IEEE Computer Society Conference on Computer Vision Pattern Recognition (Cat. No PR00149), 1999, 1: 125–131.

    [20] [20] Gehrig S K, Eberli F, Meyer T. A realtime lowpower stereo vision engine using semiglobal matching[C]International Conference on Computer Vision Systems, 2009: 134–143.

    [21] [21] Drington A A, Kelly C D B, McClure S H, et al. Advantages of 3D timeofflight range imaging cameras in machine vision applications[C]16th New Zeal Conference (ENZCon), 2009: 18–20.

    [22] [22] Ganapathi V, Plagemann C, Koller D, et al. Real time motion capture using a single timeofflight camera[C]2010 IEEE Computer Society Conference on Computer Vision Pattern Recognition, 2010: 755–762.

    [23] [23] Hsu S, Aya S, Rafii A, et al. Advanced Microsystems f Automotive Applications 2006[M]. Berlin: Springer, 2006: 205–219.

    [24] H Shim, S Lee. Performance evaluation of time-of-flight and structured light depth sensors in radiometric/geometric variations. Optical Engineering, 51, 094401(2012).

    [25] [25] Hahne U, Alexa M. Depth imaging by combining timeofflight ondem stereo[C]Wkshop on Dynamic 3D Imaging, 2009: 70–83.

    [26] [26] Schuon S, Theobalt C, Davis J, et al. Highquality scanning using timeofflight depth superresolution[C]2008 IEEE Computer Society Conference on Computer Vision Pattern Recognition Wkshops, 2008: 1–7.

    [27] Y Cui, S Schuon, S Thrun. Algorithms for 3d shape scanning with a depth camera. IEEE Transactions on Pattern Analysis and Machine Intelligence, 35, 1039-1050(2012).

    [28] [28] Zhang Zuxun, Zhang Jianqing. Solutions ce techniques of city modeling[D]. Wuhan: Wuhan University, 2003. (in Chinese)

    [29] [29] Wang Jizhou, Li Chengming, Lin Zongjian. A survey on the technology of three dimensional spatial data acquisition[D]. Beijing: Chinese Academy of Surveying Mapping, 2004. (in Chinese)

    [30] Lewen Yu, Da Zhang, Bin Yu. Research of 3D laser scanning measurement system for mining. Metal Mine, 436, 101-103(2012).

    [31] [31] Gao Zhiguo. The research of terrestrial laser scanning data processing modeling[D]. Xi''an: Chang''an University, 2010. (in Chinese)

    [32] [32] Fang Wei. Research on automatic texture mapping of terrestrial laser scanning data combining photogrammetry techniques[D]. Wuhan: Wuhan University. (in Chinese)

    [39] K L Boyer, A C Kak. Color-encoded structured light for rapid active ranging. IEEE Transactions on Pattern Analysis and Machine Intelligence, 14-28(1987).

    [40] [40] Zhang L, Curless B, Seitz S M. Rapid shape acquisition using col structured light multipass dynamic programming[C]First International Symposium on 3D Data Processing Visualization Transmission, 2002: 24–36.

    [44] [44] Mita H, Yajima K, Sakata S. Reconstruction of surfaces of 3d objects by marray pattern projection method[C]Second International Conference on Computer Vision, 1988: 468–473.

    [49] [49] Je C, Lee S W, Park RH. Highcontrast colstripe pattern f rapid structuredlight range imaging[C]European Conference on Computer Vision, 2004: 95–107.

    [52] S S Gorthi, P Rastogi. Fringe projection techniques: Whither we are?. Optics & Lasers in Engineering, 48, 133-140(2010).

    [58] Z Wang, D A Nguyen, J C Barnes. Some practical considerations in fringe projection profilometry. Optics & Lasers in Engineering, 48, 218-225(2010).

    [60] [60] Kühmstedt P, Munckelt C, Heinze M, et al. 3D shape measurement with phase crelation based fringe projection[C]SPIE, 2007, 6616: 66160B.

    [64] X Su, Q Zhang. Dynamic 3-D shape measurement method: A review. Optics and Lasers in Engineering, 48, 191-204(2010).

    [68] [68] Malacara D. Optical Shop Testing[M]. New Yk: John Wiley & Sons, 2007.

    [71] J Li, L G Hassebrook, C Guan. Optimized two-frequency phase-measuring-profilometry light-sensor temporal-noise sensitivity. Journal of the Optical Society of America A, 20, 106-15(2003).

    [72] S Zhang. Recent progresses on real-time 3D shape measurement using digital fringe projection techniques. Optics and Lasers in Engineering, 48, 149-158(2010).

    [86] [86] Burke J, Bothe T, Osten W, et al. Reverse engineering by fringe projection[C] SPIE, 2002, 4778: 312–325.

    [97] C Zuo, L Huang, M Zhang. Temporal phase unwrapping algorithms for fringe projection profilometry: A comparative review. Optics and Lasers in Engineering, 85, 84-103(2016).

    [100] [100] Kinect[J]. Wikipedia, 2019.

    [114] [114] Snavely N, Seitz S M, Szeliski R. Photo tourism: expling photo collections in 3D[C]ACM SIGGRAPH 2006 Proceedings, Association f Computing Machinery, 2006: 835846.

    [121] [121] OSA | Recent Advances of VCSEL Photonics[EBOL]. [20200108]. https:www.osapublishing.gjltabstract.cfmuri=jlt24124502.

    [122] G J Swanson, W B Veldkamp. Diffractive optical elements for use in infrared systems. Optical Engineering, 28, 286605(1989).

    [124] [124] Wiedenmann D, Grabherr M, Jäger R, et al. High volume production of singlemode VCSELs[C]SPIE, 2006, 6132: 613202.

    [125] [125] VCSEL amplifier dot project with foldedpath slowlight waveguide f 3D depth sensing[EBOL]. [20200108]. https:ieeexple.ieee.gabstractdocument8516183.

    [126] [126] Minaga M, Gu X, Shimura K, et al. Compact dot project based on folded path VCSEL amplifier f structured light sensing[C]Conference on Lasers ElectroOptics (2019), Optical Society of America, 2019: SM4N. 4.

    [129] [129] Durdle N G, Thayyo J, Raso V J. An improved structured light technique f surface reconstruction of the human trunk[C]Conference Proceedings. IEEE Canadian Conference on Electrical Computer Engineering (Cat. No. 98TH8341), 1998, 2: 874–877.

    [134] [134] Mei X, Sun X, Zhou M, et al. On building an accurate stereo matching system on graphics hardware[C] 2011 IEEE International Conference on Computer Vision Wkshops (ICCV Wkshops), 2011: 467–474.

    [136] [136] Hirschmuller H. Accurate efficient stereo processing by semiglobal matching mutual infmation[C]2005 IEEE Computer Society Conference on Computer Vision Pattern Recognition (CVPR’05), 2005, 2: 807–814.

    [140] J Sun, N N Zheng, H Y Shum. Stereo matching using belief propagation. IEEE Transactions on Pattern Analysis and Machine Intelligence, 25, 14(2003).

    [141] [141] Jae Chul Kim, Kyoung Mu Lee, Byoung Tae Choi, et al. A dense stereo matching using twopass dynamic programming with generalized ground control points[C]2005 IEEE Computer Society Conference on Computer Vision Pattern Recognition (CVPR’05), 2005, 2: 1075–1082.

    [142] [142] Fstmann S, Kanou Y, Jun Ohya, et al. Realtime stereo by using dynamic programming[C] 2004 Conference on Computer Vision Pattern Recognition Wkshop, IEEE, 2004: 29–29.

    [159] [159] Weise T, Leibe B, Van Gool L. Fast 3D Scanning with automatic motion compensation[C]Computer Vision Pattern Recognition, 2007. CVPR ’07. IEEE Conference on, 2007: 1–8.

    [166] Y Zhang, Z Xiong, Z Yang. Real-time scalable depth sensing with hybrid structured light illumination. IEEE Transactions on Image Processing, 23, 97-109(2013).

    [169] L Song, Y Ru, Y Yang. Full-view three-dimensional measurement of complex surfaces. Optical Engineering, 57, 1(2018).

    [170] M Nießner, M Zollhöfer, S Izadi. Real-time 3D reconstruction at scale using voxel hashing. ACM Transactions on Graphics, 32, 1-11(2013).

    [171] [171] Epstein E, GrangerPiche M, Poulin P. Exploiting mirrs in interactive reconstruction with structured light[C]Vision, Modeling, Visualization, 2004: 125132.

    [174] D Holz, A E Ichim, F Tombari. Registration with the point cloud library: A modular framework for aligning in 3-D. IEEE Robotics & Automation Magazine, 22, 110-124(2015).

    [187] [187] Zhang B, Ouyang Y, Zhang S. High dynamic range saturation intelligence avoidance f threedimensional shape measurement[C]IEEE, 2015: 981–990.

    [193] [193] Waddington C, Kofman J. Saturation avoidance by adaptive fringe projection in phaseshifting 3D surfaceshape measurement[C] IEEE, 2010: 1–4.

    [203] Z Qi, Z Wang. Highlight removal based on the regional-projection fringe projection method. Optical Engineering, 57, 1(2018).

    [205] [205] Chen T, Lensch H P A, Fuchs C, et al. Polarization phaseshifting f 3D scanning of translucent objects[C] IEEE, 2007: 1–8.

    [207] [207] Cai Z, Liu X, Peng X, et al. Structured light field 3D imaging[J]. Optics Express, 2016, 24(18): 2032420334.

    [221] S Feng, Q Chen, G Gu. Fringe pattern analysis using deep learning. Advanced Photonics, 1, 025001(2019).

    [244] S Heist. 5D hyperspectral imaging: fast and accurate measurement of surface shape and spectral characteristics using structured light. Optics Express, 14(2018).

    CLP Journals

    [1] Bin Liu, Qian Qiao, Jing Zhao, Zimiao Zhang, Zhiwei Li, Baofeng Zhang. 3D profile measurement based on depth from focus method using high-frequency component variance weighted entropy image sharpness evaluation function[J]. Infrared and Laser Engineering, 2021, 50(5): 20200326

    [2] Tiejun Li, Luming Xue, Jinyue Liu, Xiaohui Jia. Research on 3D reconstruction technology of extended depth of field based on auxiliary camera[J]. Infrared and Laser Engineering, 2023, 52(4): 20220647

    [3] Fei Liu, Huifang Luo, Hanli Jiang, Yinnan Zhang, Jin Yan. Modified three-dimensional reconstruction based on three-frequency three-step phase shifting algorithm[J]. Infrared and Laser Engineering, 2022, 51(4): 20210179

    [4] Peng Wang, Jiaqi Liu, Changku Sun, Baoshang Zhang. Correction of Gamma nonlinearity method by orthogonal fringe order subregional precoding[J]. Infrared and Laser Engineering, 2022, 51(6): 20210503

    [5] Zhangying Wang, Ningning Zhang, Nan Gao, Kui Li, Zhaozong Meng, Zonghua Zhang. 3D surface shape measurement of high dynamic range object based on monochrome fringe projection[J]. Infrared and Laser Engineering, 2023, 52(8): 20230327

    [6] Suqin Wang, Taiqin Chen, Feng Zhang, Min Shi, Dengming Zhu. High-precision 3D reconstruction method for topography measurement of complex mechanical parts[J]. Infrared and Laser Engineering, 2022, 51(7): 20210730

    [7] Yanjun Fu, Xiaoqi Cai, Kejun Zhong, Baiheng Ma, Zhanjun Yan. Method for phase-height mapping calibration based on fringe projection profilometry[J]. Infrared and Laser Engineering, 2022, 51(4): 20210403

    [8] Jingwen Yang, Zonghua Zhang, Lina Fu, Yanling Li, Nan Gao, Feng Gao. Depth range enhancement of three-dimensional profiling measurement technology based on dithering algorithms[J]. Infrared and Laser Engineering, 2023, 52(8): 20230059

    [9] Renjie Ruan, Yinhua Cao, Xiaofan Wang, Yanhong Ma, Zhiyong Wang, Tian Lan. Design of on-chip dot array structured light projector using bottom-emitting VCSEL[J]. Infrared and Laser Engineering, 2022, 51(6): 20210640

    [10] Rong Wu, Shili Zhao, Yang Zhao, Fengyun Xie. Fringe projection profilometry for 3D measurement of objects with different depth of fields[J]. Infrared and Laser Engineering, 2022, 51(11): 20220088

    [11] Haoming Yang, Zijie Sun, Yanbiao Sun, Jigui Zhu. Temperature drift compensation method for triple scan measuring system of binocular surface structured light[J]. Infrared and Laser Engineering, 2024, 53(1): 20230456

    Tools

    Get Citation

    Copy Citation Text

    Chao Zuo, Xiaolei Zhang, Yan Hu, Wei Yin, Detong Shen, Jinxin Zhong, Jing Zheng, Qian Chen. Has 3D finally come of age? ——An introduction to 3D structured-light sensor[J]. Infrared and Laser Engineering, 2020, 49(3): 0303001

    Download Citation

    EndNote(RIS)BibTexPlain Text
    Save article for my favorites
    Paper Information

    Category:

    Received: Dec. 25, 2019

    Accepted: --

    Published Online: Apr. 22, 2020

    The Author Email:

    DOI:10.3788/IRLA202049.0303001

    Topics