Laser & Optoelectronics Progress, Volume. 62, Issue 8, 0837002(2025)

Three-Dimensional Facial UV Texture Restoration Based on Gated Convolution

Zhenhua Zhao, Bo Yang*, Qiuhang Chen, and Yiming Ying
Author Affiliations
  • School of Optoelectronic Information and Computer Engineering, University of Shanghai for Science and Technology, Shanghai 200093, China
  • show less

    In this study, a three-dimensional (3D) facial UV texture restoration algorithm based on gated convolution is proposed to address the texture loss caused by self-occlusion in unconstrained facial images captured from large viewing angles during reconstructing 3D facial structures from a single image. First, a gated convolution mechanism is designed to learn a dynamic feature selection approach for each channel and spatial position, thereby enhancing the network's ability to capture complex nonlinear features. These gated convolutions are then stacked to form an encoder-decoder network that repairs 3D facial UV texture images with irregular defects. In addition, a spectral normalization loss function is introduced to stabilize the generative adversarial network, and a segmented training approach is implemented to overcome the challenges of cost and accessibility in collecting 3D facial texture datasets. The experimental results show that the proposed algorithm outperforms mainstream algorithms in terms of the peak signal-to-noise ratio and structural similarity. The proposed algorithm effectively restores UV texture maps under large angle occlusion, yielding more comprehensive facial texture maps with natural, coherent pixel restoration, and realistic texture details.

    Keywords
    Tools

    Get Citation

    Copy Citation Text

    Zhenhua Zhao, Bo Yang, Qiuhang Chen, Yiming Ying. Three-Dimensional Facial UV Texture Restoration Based on Gated Convolution[J]. Laser & Optoelectronics Progress, 2025, 62(8): 0837002

    Download Citation

    EndNote(RIS)BibTexPlain Text
    Save article for my favorites
    Paper Information

    Category: Digital Image Processing

    Received: Aug. 13, 2024

    Accepted: Sep. 24, 2024

    Published Online: Apr. 2, 2025

    The Author Email: Bo Yang (1351939582@qq.com)

    DOI:10.3788/LOP241833

    CSTR:32186.14.LOP241833

    Topics