Laser & Optoelectronics Progress, Volume. 58, Issue 16, 1615001(2021)

Vision-Language Navigation Algorithm Based on Cosine Similarity

Jie Jin1, Kaiyan Liu1, and Shunkao Zha2、*
Author Affiliations
  • 1School of Electrical and Information Engineering, Tianjin University, Tianjin 300072, China
  • 2School of Software Engineering, University of Science and Technology of China, Suzhou, Jiangsu 215123, China
  • show less
    Figures & Tables(4)
    Regretful agent framework[13]
    Distribution of scene nodes in dataset
    Examples of complex navigation scenarios
    • Table 1. Comparison of different models

      View table

      Table 1. Comparison of different models

      ModelValidation-SeenValidation-UnseenTest (unseen)
      NE↓SR↑OSR↑SPL↑NE↓SR↑OSR↑SPL↑NE↓SR↑OSR↑SPL↑
      Random9.450.160.21--9.230.160.22--9.770.130.180.12
      Seq-to-Seq6.010.390.53--7.810.220.28--7.850.200.270.18
      RPA5.560.430.53--7.650.250.32--7.530.250.330.23
      Speaker-Follower3.360.660.74--6.620.360.45--6.620.350.440.28
      RCM3.370.670.77--5.880.430.52--6.010.430.510.35
      Self-Monitoring3.220.670.780.585.520.450.560.325.990.430.550.32
      Regretful3.690.650.720.595.360.480.610.37--------
      Regretful*3.230.690.770.635.320.500.590.415.690.480.560.40
      Ours3.230.700.760.655.330.520.610.425.690.500.570.41
    Tools

    Get Citation

    Copy Citation Text

    Jie Jin, Kaiyan Liu, Shunkao Zha. Vision-Language Navigation Algorithm Based on Cosine Similarity[J]. Laser & Optoelectronics Progress, 2021, 58(16): 1615001

    Download Citation

    EndNote(RIS)BibTexPlain Text
    Save article for my favorites
    Paper Information

    Category: Machine Vision

    Received: Oct. 12, 2020

    Accepted: Dec. 6, 2020

    Published Online: Aug. 19, 2021

    The Author Email: Shunkao Zha (zhashunkao@gmail.com)

    DOI:10.3788/LOP202158.1615001

    Topics