Laser & Optoelectronics Progress, Volume. 60, Issue 8, 0811011(2023)

Application of Deep Learning Technology to Photometric Stereo Three-dimensional Reconstruction

Guohui Wang* and Yanting Lu
Author Affiliations
  • School of Optoelectronic Engineering, Xi'an Technological University, Xi'an 710021, Shaanxi, China
  • show less
    Figures & Tables(19)
    The imaging model of SFS[35]
    The imaging model of photometric stereo
    The illustration of photometric stereo 3D reconstruction[43]. (a)-(e) The synthetic images I1(x,y)-I5(x,y) of a sphere; (f) the reconstructed albedo ρ(x,y); (g) the reconstructed vector field g(x,y); (h) the reconstructed normal field N(x,y); (i) the reconstructed shape z(x,y) of the sphere
    The illustration of the commonly used synthetic photometric stereo datasets. (a) Blobby photometric stereo dataset[72];(b) Sculpture photometric stereo dataset[72]; (c) CyclesPS photometric stereo dataset[79]
    Schematic diagrams of DiLiGenT dataset[62-63]. (a) Photometric stereo images under a certain light direction; (b) surface normal of the objects
    The architecture of DPSN[69]
    Reconstruction results for several objects from DiLiGenT dataset[69]
    The architecture of PS-FCN[72]
    Visualization of the feature map after fusion[72]. (a)-(f) 6 of 128 channels of the fused feature map
    The architecture of SDPS-Net[73]
    The coordinate system for observation map
    The framework of the prediction module of CNN-PS[79]
    The architecture of SPLINE-Net[80]
    The architecture of LMPS[75]
    The architecture of DR-PSN[77]
    The architecture of IRPS[114]
    • Table 1. Details of the commonly used synthetic photometric stereo datasets

      View table

      Table 1. Details of the commonly used synthetic photometric stereo datasets

      Used datasets3D shape(number)BRDF(number)Light(number)Number of images
      Reference[69-70Blobby81(8)MERL84(100)DiLiGenT62-63(96)76800,28800
      Reference[72-74,71,77-78]Blobby81(8)+Sculpture82(8)MERL84(2 of 100)Random(64)1658880+3794688
      Reference[75Blobby81(9)MERL84(8 of 100)Random(144)10368
      Reference[79-80CyclesPS79(15)

      Disney85

      (~15000)86

      Uniform(1000/1280)53400
    • Table 2. Details of the commonly used real-photoed photometric stereo datasets

      View table

      Table 2. Details of the commonly used real-photoed photometric stereo datasets

      DatasetsNumber of 3D shapesNumber of viewsNumber of lightsNumber of images
      DiLiGenT62-6310196960
      Gourd & Apple8731102,98,112312
      Light Stage Data Gallery8861/22532277
      Harvard897120140
      DiLiGenT-MV90520969600
      Kaya4531260780
      LUCES91-9214152728
      DiLiGenT102[9310(×10)110010000
    • Table 3. Comparison of reconstruction results for different methods on the DiLiGenT benchmark dataset[62-63]

      View table

      Table 3. Comparison of reconstruction results for different methods on the DiLiGenT benchmark dataset[62-63]

      Methodballbearbuddhacatcowgobletharvestpot1pot2readingaverage
      BASELINE74.108.3914.928.4125.6018.5030.628.8914.6519.8015.39
      DPSN692.026.3112.686.548.0111.2816.867.057.8615.519.41
      PS-FCN722.827.557.916.167.338.6015.857.137.2513.338.39
      UPS-FCN726.6211.2315.8714.6811.9120.7227.7913.9814.1923.2616.02
      SDPS-Net732.776.898.978.068.4811.9117.438.147.5014.909.51
      CNN-PS792.24.17.94.68.07.314.05.46.012.67.2
      SPLINE-Net80*4.965.9910.077.528.8010.4319.058.7711.7916.1310.35
      LMPS75*3.978.7311.366.6910.1910.4617.337.309.7414.3710.02
      DR-PSN772.275.467.845.427.018.4915.407.087.2112.747.90
      IRPS1141.475.7910.365.446.3211.4722.596.097.7611.038.83
    Tools

    Get Citation

    Copy Citation Text

    Guohui Wang, Yanting Lu. Application of Deep Learning Technology to Photometric Stereo Three-dimensional Reconstruction[J]. Laser & Optoelectronics Progress, 2023, 60(8): 0811011

    Download Citation

    EndNote(RIS)BibTexPlain Text
    Save article for my favorites
    Paper Information

    Category: Imaging Systems

    Received: Jan. 1, 2023

    Accepted: Feb. 22, 2023

    Published Online: Apr. 17, 2023

    The Author Email: Wang Guohui (booler@126.com)

    DOI:10.3788/LOP230431

    Topics