Laser & Optoelectronics Progress, Volume. 60, Issue 16, 1633001(2023)

Mural Style Transfer with Feature Clustering and Deep Residual Shrinkage Network

Meng Wu1、*, Yining Gao1, and Jia Wang2
Author Affiliations
  • 1School of Information and Control Engineering, Xi'an University of Architecture and Technology, Xi'an 710055, Shaanxi, China
  • 2Shaanxi History Museum, Xi'an 710061, Shaanxi, China
  • show less
    Figures & Tables(18)
    Network framework
    Algorithm flow
    Cluster graph comparison. (a) Input image; (b) VGG19 space; (c) RGB space
    Algorithm flow
    Color space comparison. (a) Input image; (b) RGB space; (c) LAB space
    RSB structure
    Soft threshold function and its derivative. (a) Soft threshold function; (b) soft threshold function derivative
    Image representation of different network levels. (a) Original image; (b) Conv_1_1; (c) Conv_2_1; (d) Conv_3_1; (e) Conv_4_1
    RSB validity verification. (a) Content image; (b) without RSB; (c) with RSB
    The effect of style transfer with different cluster numbers. (a) Input image; (b) K=1; (c) K=3; (d) K=5; (e) K=10
    The effect of style transfer with different fusion coefficients. (a) Input image; (b) αk= 0.2; (c) αk= 0.6; (d) αk=1.0
    The effect of style transfer with different coverage ratios. (a) Input image; (b) coverage ratio is 0.25; (c) coverage ratio is 0.5; (d) coverage ratio is 1.0
    Comparison of different style transfer methods. (a) Content images; (b) style images; (c) method of reference [5]; (d) AdaIN; (e) SANet; (f) MST; (g) proposed method
    Comparison results of different data augmentation methods. (a) Original image; (b) flip horizontal; (c) rotate 90°; (d) rotate 180°; (e) rotate 270°; (f) contrast; (g) color enhancement; (h) brightness enhancement
    Effect of different dataset generation. (a) Original murals; (b) masked images; (c) real; (d) real+s.a.; (e) synthetic; (f) real+synthetic
    • Table 1. Quantitative statistical results of stylized test

      View table

      Table 1. Quantitative statistical results of stylized test

      ImageMethodMSSIMRPSNREMSE /103
      picture1Method of reference[50.569.307.65
      AdaIN0.589.038.13
      SANet0.527.387.15
      MST0.459.207.82
      Proposed method0.6411.254.88
      picture2Method of reference[50.4812.813.40
      AdaIN0.5113.193.12
      SANet0.3711.884.21
      MST0.3911.624.48
      Proposed method0.5314.692.21
      picture3Method of reference[50.5315.641.76
      AdaIN0.4815.251.94
      SANet0.3414.362.38
      MST0.3413.672.79
      Proposed method0.5516.101.59
      picture4Method of reference[50.4315.781.24
      AdaIN0.3817.851.15
      SANet0.2816.451.47
      MST0.3416.711.38
      Proposed method0.4518.251.13
    • Table 2. Comparison of average generation time of different methods

      View table

      Table 2. Comparison of average generation time of different methods

      MethodRunning time /s
      AdaIN0.40
      SANet0.89
      MST4.77
      Proposed method1.65
    • Table 3. Mural digital generation results

      View table

      Table 3. Mural digital generation results

      MethodMSSIMRPSNREMSE /103
      AdaIN0.4318.762.68
      SANet0.4118.222.94
      MST0.3817.783.52
      Proposed method0.4919.262.31
    Tools

    Get Citation

    Copy Citation Text

    Meng Wu, Yining Gao, Jia Wang. Mural Style Transfer with Feature Clustering and Deep Residual Shrinkage Network[J]. Laser & Optoelectronics Progress, 2023, 60(16): 1633001

    Download Citation

    EndNote(RIS)BibTexPlain Text
    Save article for my favorites
    Paper Information

    Category: Vision, Color, and Visual Optics

    Received: Sep. 20, 2022

    Accepted: Nov. 24, 2022

    Published Online: Aug. 18, 2023

    The Author Email: Wu Meng (wumeng@xauat.edu.cn)

    DOI:10.3788/LOP222583

    Topics