Acta Optica Sinica, Volume. 40, Issue 4, 0410001(2020)

High Precision Three-Dimensional Face Reconstruction Algorithm Based on Gradient Light Image

Shuo Huang1,2,3, Yong Hu1,2、*, Cailan Gong1,2, Hongyi Bo1,4, Geng Gu4, Qi Xu4, and Wei Wang4
Author Affiliations
  • 1Shanghai Institute of Technical Physics, Chinese Academy of Sciences, Shanghai 200083, China
  • 2Key Laboratory of Infrared System Detection and Imaging Technology, Shanghai Institute of Technical Physics, Chinese Academy of Sciences, Shanghai 200083, China
  • 3University of Chinese Academy of Sciences, Beijing 100049, China
  • 4Jiaxing Opto-Electronic Engineering Center, Chinese Academy of Sciences, Jiaxing, Zhejiang 314022, China
  • show less
    Figures & Tables(12)
    Flowchart of 3D face reconstruction
    Results of reflected light separation. (a) Vertically polarized image; (b) parallel polarized image; (c) specular reflection image
    Gradient light images in different directions. (a) Along the X direction; (b) along the -X direction; (c) along the Y direction; (d) along the -Y direction; (e) along the Z direction; (f) all light
    Normal mapping principle
    Image acquisition device. (a) Shooting device; (b) relative position of the cameras
    Experiment of specular reflection and diffuse reflection separation
    Results of normal map fusion. (a) Diffuse reflection normal map; (b) specular reflection normal map; (c) fusion normal map
    Comparison of normal map reconstruction with different fusion modes. (a) Low precision model; (b) reconstruction with 2∶1 fusion ratio; (c) reconstruction with 5×5 high-pass filtering and 1∶1 fusion ratio; (d) reconstruction with 5×5 high-pass filtering and 2∶1 fusion ratio; (e) reconstruction with 7×7 high-pass filtering and 1∶1 fusion ratio; (f) reconstruction with 7×7 high-pass filtering and 2∶1 fusion ratio
    Multi-view images. (a) Multi-view images; (b) multi-view normal maps
    Results of fine 3D face reconstruction
    Comparison of the render of highprecision model and normal map model. (a) Model1; (b) model2; (c) model3; (d) rendering of model1; (e) rendering of model2; (f) rendering of model3
    • Table 1. Parameters of simplified model

      View table

      Table 1. Parameters of simplified model

      ParameterModel1Model2Model3
      Poly3000101010272102
      Point150660507481075
    Tools

    Get Citation

    Copy Citation Text

    Shuo Huang, Yong Hu, Cailan Gong, Hongyi Bo, Geng Gu, Qi Xu, Wei Wang. High Precision Three-Dimensional Face Reconstruction Algorithm Based on Gradient Light Image[J]. Acta Optica Sinica, 2020, 40(4): 0410001

    Download Citation

    EndNote(RIS)BibTexPlain Text
    Save article for my favorites
    Paper Information

    Category: Image Processing

    Received: Jul. 17, 2019

    Accepted: Oct. 21, 2019

    Published Online: Feb. 11, 2020

    The Author Email: Hu Yong (shuo_huang_sitp@sina.com)

    DOI:10.3788/AOS202040.0410001

    Topics