Laser & Optoelectronics Progress, Volume. 59, Issue 4, 0410014(2022)

Generation Model of Character Posture TransferBased on Self-attention Mechanism

Ning Zhao and Libo Liu*
Author Affiliations
  • School of Information Engineering, Ningxia University, Yinchuan , Ningxia 750021, China
  • show less

    This paper proposes a character pose transfer generative model fused with the self-attention mechanism to address the issues of loss of texture details and unreasonable pose transfer in images generated by character pose transfer. First, based on the two-stage pose transfer generative model, the improved self-attention module is introduced into the generative adversarial network to reduce the interaction between similar features,which improves the ability to learn texture details and capture information, enhances saliency modeling of posture features. Then, the Markov discriminative model is used to enhance the ability to discriminate the details of the generated image. Finally, the optimized content loss function is used to constrain the image feature information loss of the entire model, promote semantic consistency between the generated and the real images,and strengthen the rationality of pose transfer. The experimental results demonstrate that, compared with the PG2 method on the DeepFashion and Market-1501 datasets, the IS and SSIM values of our model has increased in 0.388 and 0.032, 0.036 and 0.065, respectively.

    Tools

    Get Citation

    Copy Citation Text

    Ning Zhao, Libo Liu. Generation Model of Character Posture TransferBased on Self-attention Mechanism[J]. Laser & Optoelectronics Progress, 2022, 59(4): 0410014

    Download Citation

    EndNote(RIS)BibTexPlain Text
    Save article for my favorites
    Paper Information

    Category: Image Processing

    Received: Mar. 10, 2021

    Accepted: Apr. 2, 2021

    Published Online: Jan. 25, 2022

    The Author Email: Liu Libo (liulib@163.com)

    DOI:10.3788/LOP202259.0410014

    Topics