Optics and Precision Engineering, Volume. 30, Issue 18, 2241(2022)

Unsupervised representation learning for cultural relics based on local-global bidirectional reasoning

Jie LIU1...2, Guohua GENG1,2,*, Yu TIAN1,2, Yi WANG1,2, Yangyang LIU1,2, and Mingquan ZHOU12 |Show fewer author(s)
Author Affiliations
  • 1National and Local Joint Engineering Research Center for Cultural Heritage Digitization, Northwest University, Xi'an7027, China
  • 2College of Information Science and Technology, Northwest University, Xi'an71017, China
  • show less

    Existing representation learning methods of cultural relics require numerous labels. Manual labeling is time-consuming and labor-intensive. Furthermore, supervised learning methods cannot effectively learn the internal structure information of point clouds. We propose an unsupervised representation learning network to extract the deep features of ceramic cultural relics. The approach is based on local-global bidirectional reasoning. First, we propose a multi-scale shell convolution-based hierarchical encoder to extract local features at different scales. Second, the local-to-global reasoning module is used to map the extracted local features to the global features. The differences between the two types of features are measured using metric learning for iterative learning. Third, a fold-based decoder is used to obtain better reconstruction effects from the acquired global features in a coarse-to-fine manner. A local-to-global reasoning module supervises only the local representation to be near the global one. We propose using a low-level generation task as a self-supervision signal. The global feature can capture more basic structural information about point clouds, and the bidirectional inference between local structures and global shapes at different levels was used to learn point cloud representations. Finally, the learned representations are applied in the downstream task of point cloud classification. Experiments on the Terracotta Warriors and ModelNet40 datasets show that the proposed model significantly improves in terms of classification accuracy. The classification accuracies were 93.33% and 92.02%, respectively. The algorithm improved by approximately 4.4% and 2.82% compared with the supervised algorithm PointNet. The results demonstrate that our model achieves a comparable performance and narrows the gap between unsupervised and supervised learning approaches in downstream object classification tasks.

    Tools

    Get Citation

    Copy Citation Text

    Jie LIU, Guohua GENG, Yu TIAN, Yi WANG, Yangyang LIU, Mingquan ZHOU. Unsupervised representation learning for cultural relics based on local-global bidirectional reasoning[J]. Optics and Precision Engineering, 2022, 30(18): 2241

    Download Citation

    EndNote(RIS)BibTexPlain Text
    Save article for my favorites
    Paper Information

    Category: Information Sciences

    Received: Mar. 27, 2022

    Accepted: --

    Published Online: Oct. 27, 2022

    The Author Email: GENG Guohua (ghgeng@nwu.edu.cn)

    DOI:10.37188/OPE.20223018.2241

    Topics