Chinese Journal of Liquid Crystals and Displays, Volume. 40, Issue 9, 1381(2025)

Multi-resolution human posture transfer algorithm based on PATN and self-attention mechanism

Qingdong HUANG1,2、*, Yuhui SU1, Yihua LIU1, Zihuang CHEN1, and Yongqi YAO1
Author Affiliations
  • 1School of Communications and Information Engineering, Xi'an University of Posts and Telecommunications, Xi'an 710121, China
  • 2Shaanxi Key Laboratory of Information Communication Network and Security, Xi'an 710121, China
  • show less

    Aiming at the problem that the existing human pose transfer methods suffer from image deformation and distortion due to improper feature processing in the encoding stage, a multi-resolution human pose transfer method based on pose-attentional transfer network (PATN) and self-attention mechanism is proposed. Firstly, a pose-guided self-attention module is designed to enhance the weight of the feature channel of the key body region through the multi-head attention mechanism, reduce the influence of background-irrelevant features, and adaptively explore the correlation between the two branch features. Secondly, a multi-scale attention module is added in the decoding stage to enhance the expression of pose information at different scales, effectively improve the fidelity of local details and overall texture. Finally, the ternary pixel loss is introduced to constrain the generated image, which improves the feature consistency and structural consistency of the image. The experimental results are verified on the DeepFashion and Market-1501 datasets. They show that the proposed method is superior to the existing PATN method in terms of structural similarity (SSIM), initial score (IS) and perceptual similarity (LPIPS), and has improved visual perception and edge texture, showing important potential in the downstream task of person re-identification.

    Keywords
    Tools

    Get Citation

    Copy Citation Text

    Qingdong HUANG, Yuhui SU, Yihua LIU, Zihuang CHEN, Yongqi YAO. Multi-resolution human posture transfer algorithm based on PATN and self-attention mechanism[J]. Chinese Journal of Liquid Crystals and Displays, 2025, 40(9): 1381

    Download Citation

    EndNote(RIS)BibTexPlain Text
    Save article for my favorites
    Paper Information

    Category:

    Received: May. 15, 2025

    Accepted: --

    Published Online: Sep. 25, 2025

    The Author Email: Qingdong HUANG (huangqingdong@xupt.edu.cn)

    DOI:10.37188/CJLCD.2025-0100

    Topics