PhotoniX, Volume. 5, Issue 1, 25(2024)

Deep-learning-enabled temporally super-resolved multiplexed fringe projection profilometry: high-speed kHz 3D imaging with low-speed camera

Wenwu Chen1...2,3, Shijie Feng1,2,3,*, Wei Yin1,2,3, Yixuan Li1,2,3, Jiaming Qian1,2,3, Qian Chen3,**, and Chao Zuo1,23,*** |Show fewer author(s)
Author Affiliations
  • 1Smart Computational Imaging Laboratory (SCILab), School of Electronic and Optical Engineering, Nanjing University of Science and Technology, Nanjing, 210094 Jiangsu Province, China
  • 2Smart Computational Imaging Research Institute (SCIRI) of Nanjing University of Science and Technology, Nanjing, 210019 Jiangsu Province, China
  • 3Jiangsu Key Laboratory of Spectral Imaging & Intelligent Sense, Nanjing University of Science and Technology, Nanjing, 210094 Jiangsu Province, China
  • show less

    Recent advances in imaging sensors and digital light projection technology have facilitated rapid progress in 3D optical sensing, enabling 3D surfaces of complex-shaped objects to be captured with high resolution and accuracy. Nevertheless, due to the inherent synchronous pattern projection and image acquisition mechanism, the temporal resolution of conventional structured light or fringe projection profilometry (FPP) based 3D imaging methods is still limited to the native detector frame rates. In this work, we demonstrate a new 3D imaging method, termed deep-learning-enabled multiplexed FPP (DLMFPP), that allows to achieve high-resolution and high-speed 3D imaging at near-one-order of magnitude-higher 3D frame rate with conventional low-speed cameras. By encoding temporal information in one multiplexed fringe pattern, DLMFPP harnesses deep neural networks embedded with Fourier transform, phase-shifting and ensemble learning to decompose the pattern and analyze separate fringes, furnishing a high signal-to-noise ratio and a ready-to-implement solution over conventional computational imaging techniques. We demonstrate this method by measuring different types of transient scenes, including rotating fan blades and bullet fired from a toy gun, at kHz using cameras of around 100 Hz. Experiential results establish that DLMFPP allows slow-scan cameras with their known advantages in terms of cost and spatial resolution to be used for high-speed 3D imaging tasks.

    Tools

    Get Citation

    Copy Citation Text

    Wenwu Chen, Shijie Feng, Wei Yin, Yixuan Li, Jiaming Qian, Qian Chen, Chao Zuo. Deep-learning-enabled temporally super-resolved multiplexed fringe projection profilometry: high-speed kHz 3D imaging with low-speed camera[J]. PhotoniX, 2024, 5(1): 25

    Download Citation

    EndNote(RIS)BibTexPlain Text
    Save article for my favorites
    Paper Information

    Category: Research Articles

    Received: May. 7, 2024

    Accepted: Aug. 2, 2024

    Published Online: Jan. 23, 2025

    The Author Email: Feng Shijie (shijiefeng@njust.edu.cn), Chen Qian (chenqian@njust.edu.cn), Zuo Chao (zuochao@njust.edu.cn)

    DOI:10.1186/s43074-024-00139-2

    Topics