Optics and Precision Engineering, Volume. 32, Issue 20, 2987(2024)

Shape from polarization based on sparse self-attention

Zhichao YU1... Zhenhua WAN2 and Kaichun ZHAO1,* |Show fewer author(s)
Author Affiliations
  • 1Department of Precision Instrument, Tsinghua University, Beijing00084, China
  • 2Faculty of Mechanical Engineering, Guangxi University, Nanning530004; China
  • show less

    Accurate estimation of surface normal plays a vital role in various computer vision tasks. Physically-based shape from polarization methods have limitations restricting their applications. Conversely, learning-based shape from polarization methods outperform physical methods in both accuracy and applicability. To further improve the accuracy of shape from polarization and make it applicable to a broader range of practical tasks, we proposed a novel method. First, we introduced a new polarization information representation combining Stokes vectors, enhancing the model's ability to extract polarization physical prior information. Then, we integrated a bi-level routing sparse self-attention mechanism to improve the model's perception of global contextual information, enabling better disambiguation of local polarization information. Testing on the DeepSfP dataset and out test data, experimental results demonstrate our proposed method achieves an average angular error of 13.37° on the DeepSfP dataset, outperforming existing methods in all tested metrics including accuracy and angular error. This indicates a significant improvement in normal estimation effectiveness with our proposed method. By introducing a novel polarization information representation and sparse self-attention mechanism, our approach enhances the accuracy and applicability of polar surface normal estimation, providing stronger support for practical task applications.

    Keywords
    Tools

    Get Citation

    Copy Citation Text

    Zhichao YU, Zhenhua WAN, Kaichun ZHAO. Shape from polarization based on sparse self-attention[J]. Optics and Precision Engineering, 2024, 32(20): 2987

    Download Citation

    EndNote(RIS)BibTexPlain Text
    Save article for my favorites
    Paper Information

    Category:

    Received: May. 9, 2024

    Accepted: --

    Published Online: Jan. 10, 2025

    The Author Email: ZHAO Kaichun (kaichunz@mail.tsinghua.edu.cn)

    DOI:10.37188/OPE.20243220.2987

    Topics