Laser & Optoelectronics Progress, Volume. 59, Issue 24, 2411001(2022)

Blind Restoration Method for Incomplete and Sparse Text Images Based on Content Style Transfer

Dongbin Liu1, Huiqin Wang1、*, Ke Wang1, Zhan Wang2, and Gang Zhen2
Author Affiliations
  • 1School of Information and Control Engineering, Xi'an University of Architecture and Technology, Xi'an 710055, Shaanxi, China
  • 2Shaanxi Provincial Institute of Cultural Relics Protection, Xi'an 710075, Shaanxi, China
  • show less

    The existing incomplete text image restoration must identify and fill the Mask region. The Mask region cannot be determined if the residual information of the incomplete text part is too sparse. A blind restoration method of incomplete and sparse text images based on content style transfer is proposed to address this issue. Using a cyclic generative adversarial network to construct the global related pixel information between the text images before and after restoration, the image content style features of the incomplete text were transferred to complete text images for restoration. The selfattention mechanism is added to the network to globally restrict the sparse pixels, thereby resolving the issue of weak dependence between the text sparse pixels far away in the migration process. simultaneously, the maximum pooling is used in the selfattention mechanism to enhance the texture features of the text images after migration and restoration. To improve migration accuracy, the least square loss function is used to replace the sigmoid cross-entropy loss function in the original network model. The proposed algorithm can repair random unknown missing regions in sparse incomplete text images without the assistance of Mask, according to experimental results.

    Tools

    Get Citation

    Copy Citation Text

    Dongbin Liu, Huiqin Wang, Ke Wang, Zhan Wang, Gang Zhen. Blind Restoration Method for Incomplete and Sparse Text Images Based on Content Style Transfer[J]. Laser & Optoelectronics Progress, 2022, 59(24): 2411001

    Download Citation

    EndNote(RIS)BibTexPlain Text
    Save article for my favorites
    Paper Information

    Category: Imaging Systems

    Received: Sep. 1, 2021

    Accepted: Oct. 27, 2021

    Published Online: Jan. 11, 2023

    The Author Email: Wang Huiqin (hqwang@xauat.edu.cn)

    DOI:10.3788/LOP202259.2411001

    Topics