Laser & Optoelectronics Progress, Volume. 60, Issue 16, 1615009(2023)

Multi-View 3D Reconstruction Method Based on Self-Attention Mechanism

Guangzhao Zhu, Bo Wei*, Afeng Yang, and Xin Xu
Author Affiliations
  • School of Communication Engineering, Hangzhou Dianzi University, Hangzhou 310037, Zhejiang, China
  • show less
    Figures & Tables(10)
    Overall structure of SA-PatchmatchNet
    Internal structure of self-attention layer
    Learnable PatchmatchNet structure
    DTU dataset benchmark results. (a) Depth map; (b) confidence map; (c) point cloud result
    Relationship between the overall error and GPU memory and running time, the image size is 1152×864. (a) Relationship between overall error and GPU memory consumption; (b) relationship between overall error and running time
    Depth map comparison of ablation experiment. (a) Depth map without improvement; (b) improved depth map; (c) GT
    Point cloud local magnification comparison map in the ablation experiment
    • Table 1. Test results of different methods on the DTU dataset

      View table

      Table 1. Test results of different methods on the DTU dataset

      MethodAcc /mmComp /mmOverall /mm
      Camp0.8350.5540.695
      Furu0.6130.9410.777
      Tola0.3421.1900.766
      Gipuma0.2830.8730.578
      MVSNet0.3960.5270.462
      R-MVSNet0.3830.4520.417
      P-MVSNet0.4060.4340.420
      Point-MVSNet0.3420.4110.376
      Fast-MVSNet0.3360.4030.370
      CasMVSNet0.3250.3850.355
      CVP-MVSNet0.2960.4060.351
      M3VSNet0.6360.5310.583
      PatchmatchNet0.4270.2770.352
      Proposed method0.4270.2610.344
    • Table 2. Results of different methods on Tanks and Temples dataset

      View table

      Table 2. Results of different methods on Tanks and Temples dataset

      MethodF-score
      COLMAP27.24
      R-MVSNet24.91
      CasMVSNet31.12
      PatchmatchNet32.31
      Proposed method32.72
    • Table 3. Comparison of quantitative results of ablation experiment

      View table

      Table 3. Comparison of quantitative results of ablation experiment

      ModuleAcc /mmComp /mmOverall /mmGPU /GBRunning time /sVertices
      MsFe0.4270.2770.35210.890.21051527707
      SA-MsFe0.4270.2610.3447.80.56252289896
    Tools

    Get Citation

    Copy Citation Text

    Guangzhao Zhu, Bo Wei, Afeng Yang, Xin Xu. Multi-View 3D Reconstruction Method Based on Self-Attention Mechanism[J]. Laser & Optoelectronics Progress, 2023, 60(16): 1615009

    Download Citation

    EndNote(RIS)BibTexPlain Text
    Save article for my favorites
    Paper Information

    Category: Machine Vision

    Received: Oct. 8, 2022

    Accepted: Nov. 24, 2022

    Published Online: Aug. 18, 2023

    The Author Email: Wei Bo (weibo@hdu.edu.cn)

    DOI:10.3788/LOP222692

    Topics