Laser & Optoelectronics Progress, Volume. 59, Issue 4, 0415006(2022)

Digital Restoration Method of Sculpture Face Based on Deep Learning

Fuhong Zhu1, Cailin Li1,2、*, Baoyun Guo1, Zhiyong Wang1, and Xiangcan Liao1
Author Affiliations
  • 1School of Civil and Architectural Engineering, Shandong University of Technology, Zibo , Shandong 255049, China
  • 2Key Laboratory of Geospatial Technology for the Middle and Lower Yellow River Regions, Ministry of Education, Henan University, Kaifeng , Henan 475001, China
  • show less
    Figures & Tables(10)
    Recovery process
    Relationship between voxel discretization degree and error
    Network structure that outputs 3D voxel models after 2D images are input into the deep learning network
    Registration fusion process between image point cloud and laser point cloud
    Facial missing laser point cloud. (a) Newton statue; (b) Madame Curie statue
    Facial image point cloud generated by the pre-training network compared with the facial image point cloud generated by 3DDFA-V2 network and facial laser point cloud.(a) (f) Point cloud images; (b) (g) point cloud front; (c) (h) point cloud right; (d) (i) 3DDFA-V2 point cloud right; (e) (j) laser point cloud
    Effect comparison of the recovery model obtained by proposed method.(a) (d) Simulation of facial damage model; (b) (e) facial restoration model; (c) (f) three-dimensional model before facial damage
    Effect comparison between the proposed method and the symmetry restoration model.(a) (d) Restoration model of the proposed method; (b) (e) restoration model front based on symmetry; (c) (f) restoration model side based on symmetry
    Visualization results of distance between points with the same name.(a) (c) Visualization results of homonymous point distance between 3D point cloud and laser point cloud generated from single statue face image; (b) (d) visualization results of homonymous point distance between statue face point cloud and laser point cloud after symmetry repair
    • Table 1. Average distance of homonymous point

      View table

      Table 1. Average distance of homonymous point

      ConditionStatue of NewtonStatue of Madame Curie
      Image generation point cloud0.8100.903
      Point cloud restored by symmetry method1.2031.259
    Tools

    Get Citation

    Copy Citation Text

    Fuhong Zhu, Cailin Li, Baoyun Guo, Zhiyong Wang, Xiangcan Liao. Digital Restoration Method of Sculpture Face Based on Deep Learning[J]. Laser & Optoelectronics Progress, 2022, 59(4): 0415006

    Download Citation

    EndNote(RIS)BibTexPlain Text
    Save article for my favorites
    Paper Information

    Category: Machine Vision

    Received: Jul. 6, 2021

    Accepted: Sep. 13, 2021

    Published Online: Feb. 15, 2022

    The Author Email: Cailin Li (licailin@sdut.edu.cn)

    DOI:10.3788/LOP202259.0415006

    Topics