Laser & Optoelectronics Progress, Volume. 60, Issue 16, 1633001(2023)

Mural Style Transfer with Feature Clustering and Deep Residual Shrinkage Network

Meng Wu1、*, Yining Gao1, and Jia Wang2
Author Affiliations
  • 1School of Information and Control Engineering, Xi'an University of Architecture and Technology, Xi'an 710055, Shaanxi, China
  • 2Shaanxi History Museum, Xi'an 710061, Shaanxi, China
  • show less

    Ancient murals are unique surviving copies and unique in artistic style. However, the effect of reconstructing missing information is poor as reference data are scarce. The key to improving the reconstruction process of murals is producing enough reference samples. In this study, an improved style transfer method is proposed to generate high-quality mural images. First, clustering is performed in the low-dimensional space of the input images to maintain their structural integrity. Second, a residual shrinkage module based on the attention mechanism and soft threshold function is introduced to remove redundant information in the images and effectively retain texture details. Finally, the content and matched style clustering sets are converted into real-time features to obtain migration images of any style. The experimental results show that the proposed method can generate natural and clear mural images as well as achieve better results in terms of peak signal-to-noise ratio and structural similarity than other common style transfer methods. Moreover, in an experiment of mural digitization based on a generative adversarial network, the superiority of the proposed method over the conventional augmentation method is verified.

    Tools

    Get Citation

    Copy Citation Text

    Meng Wu, Yining Gao, Jia Wang. Mural Style Transfer with Feature Clustering and Deep Residual Shrinkage Network[J]. Laser & Optoelectronics Progress, 2023, 60(16): 1633001

    Download Citation

    EndNote(RIS)BibTexPlain Text
    Save article for my favorites
    Paper Information

    Category: Vision, Color, and Visual Optics

    Received: Sep. 20, 2022

    Accepted: Nov. 24, 2022

    Published Online: Aug. 18, 2023

    The Author Email: Wu Meng (wumeng@xauat.edu.cn)

    DOI:10.3788/LOP222583

    Topics