Laser & Optoelectronics Progress, Volume. 59, Issue 4, 0410014(2022)

Generation Model of Character Posture TransferBased on Self-attention Mechanism

Ning Zhao and Libo Liu*
Author Affiliations
  • School of Information Engineering, Ningxia University, Yinchuan , Ningxia 750021, China
  • show less
    Figures & Tables(8)
    Two-stage character pose transfer image generation model
    Improved self-attention mechanism
    Texture refinement generation network
    Residual block with self-attention mechanism
    Perform ablation experiments on the DeepFashion dataset.(a) Sample 1; (b) sample 2; (c) sample 3; (d) sample 4
    Perform ablation experiments on the Market-1501dataset. (a) Sample 1; (b) sample 2; (c) sample 3; (d) sample 4
    • Table 1. Ablation experiment

      View table

      Table 1. Ablation experiment

      ModelMarket-1501Deepfashion
      SSIMISMask-SSIMMask-ISSSIMIS
      Baseline0.2743.4720.7123.4560.6143.112
      Baseline+D0.3153.4700.7893.4490.7613.108
      Baseline+D+Lper0.3113.5010.7673.6720.7593.301
      Baseline+D+Lper+SA0.3183.4960.8233.6650.7943.478
      Real data1.0003.8901.0003.7061.0003.898
    • Table 2. Comparision of SSIM and IS by different methods

      View table

      Table 2. Comparision of SSIM and IS by different methods

      ModelMarket-1501DeepFashion
      SSIMISMask-SSIMMask-ISSSIMIS
      PG2[40.2533.4600.7923.4350.7623.090
      DPIG190.0993.4830.6143.4910.6143.228
      Def-GAN200.2903.1850.8053.5020.7563.439
      UPIS210.1513.4310.7423.4850.7472.971
      PATN10.3113.3230.8113.7730.7733.209
      XingGAN60.3133.5060.8163.8720.7783.476
      Ours0.3183.4960.8233.6650.7943.478
      Real data1.0003.8901.0003.7061.0003.898
    Tools

    Get Citation

    Copy Citation Text

    Ning Zhao, Libo Liu. Generation Model of Character Posture TransferBased on Self-attention Mechanism[J]. Laser & Optoelectronics Progress, 2022, 59(4): 0410014

    Download Citation

    EndNote(RIS)BibTexPlain Text
    Save article for my favorites
    Paper Information

    Category: Image Processing

    Received: Mar. 10, 2021

    Accepted: Apr. 2, 2021

    Published Online: Jan. 25, 2022

    The Author Email: Libo Liu (liulib@163.com)

    DOI:10.3788/LOP202259.0410014

    Topics