Photonics Research, Volume. 9, Issue 6, 1084(2021)

Generalized framework for non-sinusoidal fringe analysis using deep learning

Shijie Feng1,2,3、*, Chao Zuo1,2,4、*, Liang Zhang1,2, Wei Yin1,2, and Qian Chen2,5、*
Author Affiliations
  • 1Smart Computational Imaging (SCI) Laboratory, Nanjing University of Science and Technology, Nanjing 210094, China
  • 2Jiangsu Key Laboratory of Spectral Imaging & Intelligent Sense, Nanjing University of Science and Technology, Nanjing 210094, China
  • 3e-mail: shijiefeng@njust.edu.cn
  • 4e-mail: zuochao@njust.edu.cn
  • 5e-mail: chenqian@njust.edu.cn
  • show less
    Figures & Tables(20)
    Simulated sinusoidal fringe images and their cross sections. (a) An ideal sinusoidal pattern. (b) A gamma-distorted sinusoidal pattern. (c) A defocused binary stripe image. (d) A saturated sinusoidal fringe image. (e) A fringe image affected by both the gamma distortion and the image saturation. (f) A fringe image affected by both the defocusing and the image saturation.
    Intensity and spectrum of different sinusoidal patterns. (a)–(c) The intensity profile of the ideal sinusoidal fringe, the gamma-distorted fringe, and the defocused fringe, respectively. (d)–(f) The corresponding spectra of (a)–(c).
    Intensity and spectrum of different sinusoidal patterns. (a)–(c) The intensity profile of the saturated sinusoidal fringe, the saturated gamma-distorted fringe, and the saturated defocused fringe, respectively. (d)–(f) The corresponding spectra of (a)–(c).
    Performance of N-step phase-shifting algorithms for various kinds of non-sinusoidal fringes.
    Proposed deep neural network to process non-sinusoidal fringe images.
    3D reconstructions from fringe images that were distorted by the projector’s gamma of 2.2. (a) One of the captured three-step PS images. (b) The 3D result obtained by the traditional three-step PS algorithm. (c) The 3D result obtained by the proposed method. (d) The 3D result obtained by the 12-step PS algorithm.
    3D reconstructions of a pair of ceramic spheres when the projector’s gamma was 2.2. (a) One of the captured three-step PS images. (b) The 3D result obtained by the traditional three-step PS algorithm. (c) The 3D result obtained by the proposed method. (d) The 3D result obtained by the 12-step PS algorithm. (e) The absolute error map of the three-step PS algorithm. (f) The absolute error map of the proposed method.
    3D reconstructions of a ceramic plate when the gamma was 2.2. (a) The 3D result obtained by the traditional three-step PS algorithm (3PS). (b) The 3D result obtained by the deep-learning-based method (DL). (c) The 3D result obtained by the 12-step PS algorithm. (d) Comparison of the measurement errors of the three-step PS method and the proposed method.
    3D reconstructions with slightly defocused binary fringe images. (a) One of the three-step PS images. (b) The 3D result obtained by the traditional three-step PS algorithm. (c) The 3D result obtained by the proposed method. (d) The 3D result obtained by the 12-step PS algorithm.
    3D reconstructions of a pair of ceramic spheres with slightly defocused binary fringe images. (a) One of the captured three-step PS images. (b) The 3D result obtained by the traditional three-step PS algorithm. (c) The 3D result obtained by the proposed method. (d) The 3D result obtained by the 12-step PS algorithm. (e) The absolute error map of the three-step PS algorithm. (f) The absolute error map of the proposed method.
    3D reconstructions of a ceramic plate with slightly defocused binary fringe images. (a) The 3D result obtained by the traditional three-step PS algorithm (3PS). (b) The 3D result obtained by the proposed method (DL). (c) The 3D result obtained by the 12-step PS algorithm. (d) Comparison of the measurement errors of the three-step PS method and the proposed method.
    3D reconstructions with saturated PS images. (a) One of the captured three-step PS images. (b) The 3D result obtained by the traditional three-step PS algorithm. (c) The 3D result obtained by the proposed method. (d) The 3D result obtained by the 12-step PS algorithm.
    3D reconstructions of a pair of ceramic spheres with saturated fringe images. (a) One of the captured three-step PS images. (b) The 3D result obtained by the traditional three-step PS algorithm. (c) The 3D result obtained by the proposed method. (d) The 3D result obtained by the 12-step PS algorithm. (e) The absolute error map of the three-step PS algorithm. (f) The absolute error map of the proposed method.
    3D reconstructions of a ceramic plate with saturated fringe images. (a) The 3D result obtained by the traditional three-step PS algorithm (3PS). (b) The 3D result obtained by the proposed method (DL). (c) The 3D result obtained by the 12-step PS algorithm. (d) Comparison of the measurement errors of the three-step PS method and the proposed method.
    3D reconstructions under the coupling non-sinusoidal case where the gamma effect of 2.2 was coupled with the image saturation. (a) One of the captured three-step phase-shifting images. (b) The 3D result obtained by the traditional three-step PS algorithm. (c) The 3D result obtained by the proposed method. (d) The 3D result obtained by the 12-step PS algorithm.
    3D reconstructions of a pair of ceramic spheres in the coupling non-sinusoidal case where the gamma effect of 2.2 was coupled with the image saturation. (a) One of the captured three-step PS images. (b) The 3D result obtained by the traditional three-step PS algorithm. (c) The 3D result obtained by the proposed method. (d) The 3D result obtained by the 12-step PS algorithm. (e) The absolute error map of the three-step PS algorithm. (f) The absolute error map of the proposed method.
    3D reconstructions of a ceramic plate in the coupling non-sinusoidal case where the gamma effect of 2.2 was coupled with the image saturation. (a) The 3D result obtained by the traditional three-step PS algorithm (3PS). (b) The 3D result obtained by the proposed method (DL). (c) The 3D result obtained by the 12-step PS algorithm. (d) Comparison of the measurement errors of the three-step PS method and the proposed method.
    3D reconstructions under the coupling non-sinusoidal case where the images were projected through a slightly defocused projector and were captured with the pixel saturation. (a) One of the captured three-step phase-shifting images. (b) The 3D result obtained by the traditional three-step PS algorithm. (c) The 3D result obtained by the proposed method. (d) The 3D result obtained by the 12-step PS algorithm.
    3D reconstructions of a pair of ceramic spheres under the coupling non-sinusoidal case where the effect of the slightly defocusing projection was coupled with the image saturation. (a) One of the captured three-step PS images. (b) The 3D result obtained by the traditional three-step PS algorithm. (c) The 3D result obtained by the proposed method. (d) The 3D result obtained by the 12-step PS algorithm. (e) The absolute error map of the three-step PS algorithm. (f) The absolute error map of the proposed method.
    3D reconstructions of a ceramic plate under the coupling non-sinusoidal case where the effect of the slightly defocusing projection was coupled with the image saturation. (a) The 3D result obtained by the traditional three-step PS algorithm (3PS). (b) The 3D result obtained by the proposed method (DL). (c) The 3D result obtained by the 12-step PS algorithm. (d) Comparison of the measurement errors of the three-step PS method and the proposed method.
    Tools

    Get Citation

    Copy Citation Text

    Shijie Feng, Chao Zuo, Liang Zhang, Wei Yin, Qian Chen, "Generalized framework for non-sinusoidal fringe analysis using deep learning," Photonics Res. 9, 1084 (2021)

    Download Citation

    EndNote(RIS)BibTexPlain Text
    Save article for my favorites
    Paper Information

    Category: Image Processing and Image Analysis

    Received: Feb. 2, 2021

    Accepted: Apr. 13, 2021

    Published Online: May. 27, 2021

    The Author Email: Shijie Feng (shijiefeng@njust.edu.cn), Chao Zuo (zuochao@njust.edu.cn), Qian Chen (chenqian@njust.edu.cn)

    DOI:10.1364/PRJ.420944

    Topics