Laser & Optoelectronics Progress, Volume. 60, Issue 20, 2028009(2023)

Adaptive Tightly Coupled Lidar-Visual Simultaneous Localization and Mapping Framework

Weichao Zhou1,2 and Jun Huang1,2、*
Author Affiliations
  • 1Shanghai Advanced Research Institute, Chinese Academy of Sciences, Shanghai 201210, China
  • 2University of Chinese Academy of Sciences, Beijing 100049, China
  • show less
    Figures & Tables(10)
    Flow chart of proposed algorithm
    Illustration of flexible depth association
    Adaptive sliding window factor graph
    Comparison of odometer trajectory and ground truth
    • Table 1. Translational error index of odometry localization accuracy

      View table

      Table 1. Translational error index of odometry localization accuracy

      Seq. No.0001020304050607080910Average
      VINS1.302.301.431.481.331.381.331.071.751.781.811.52
      F-LOAM0.982.201.291.520.810.740.541.221.371.001.811.16
      AVLS-VLO0.971.211.271.450.600.651.040.521.281.281.741.12
    • Table 2. Rotational error index of odometry localization accuracy

      View table

      Table 2. Rotational error index of odometry localization accuracy

      Seq. No.0001020304050607080910Average
      VINS0.630.350.530.490.700.710.690.830.670.530.850.61
      F-LOAM0.600.560.650.910.450.550.331.030.560.470.850.60
      AVLS-VLO0.510.300.470.850.470.400.360.460.480.500.730.48
    • Table 3. Ablation study of the dynamic weighting scheme (ATE/ARE)

      View table

      Table 3. Ablation study of the dynamic weighting scheme (ATE/ARE)

      Seq. No.VLO_1VLO_2VLO_3VLOAVLS_VLO
      Average1.24/0.501.13/0.491.19/0.511.20/0.501.12/0.48
      000.98/0.510.96/0.510.97/0.511.08/0.550.97/0.51
      011.23/0.291.32/0.371.50/0.361.02/0.231.21/0.30
      021.24/0.451.28/0.471.27/0.471.38/0.501.27/0.47
      031.42/0.851.42/0.851.70/0.921.28/0.591.45/0.85
      041.11/0.900.66/0.510.61/0.480.68/0.560.60/0.47
      050.63/0.390.63/0.390.66/0.400.77/0.440.65/0.40
      061.42/0.680.99/0.390.70/0.310.69/0.391.04/0.36
      071.42/0.680.51/0.430.54/0.470.64/0.590.52/0.46
      081.29/0.481.28/0.481.28/0.481.42/0.551.28/0.48
      093.35/1.091.44/0.591.25/0.501.50/0.541.28/0.50
      101.50/0.601.67/0.694.12/0.731.57/0.601.74/0.73
    • Table 4. Comparison of environmental differences in KITTI dataset

      View table

      Table 4. Comparison of environmental differences in KITTI dataset

      Seq. No.0001020304050607080910
      EnvUHU+CCCUUUU+CU+CU+C
      ωAvg1.32.52.00.82.11.11.90.91.11.41.5
      VAvg /(m/s)7.921.510.56.814.07.710.86.17.610.37.4
    • Table 5. Performance evaluation of a complete SLAM system with loopback (ATE/ARE)

      View table

      Table 5. Performance evaluation of a complete SLAM system with loopback (ATE/ARE)

      Seq. No.Length /mLeGO-LOAMVINS*DEMOISC-LOAMLITAMINAVLS
      Average1.56/0.661.16/1.35/0.521.59/0.431.01/0.42
      0037241.38/0.571.18/0.631.05/1.02/0.420.95/0.410.88/0.38
      01245328.03/2.692.16/0.341.87/2.92/0.6311.3/0.451.17/0.28
      0250672.14/0.841.72/0.720.93/1.67/0.541.25/0.451.08/0.44
      035601.21/0.791.46/0.490.99/1.15/0.721.17/0.561.17/0.52
      043931.27/0.841.33/0.691.23/1.50/0.5618.7/0.470.62/0.47
      0522050.91/0.481.40/0.671.04/0.81/0.370.70/0.350.49/0.32
      0612320.80/0.430.86/0.560.96/0.76/0.410.63/0.320.61/0.31
      076940.74/0.540.67/0.541.16/0.56/0.430.45/0.330.53/0.44
      0832221.40/0.541.73/0.671.24/1.20/0.501.03/0.371.32/0.52
      0917051.25/0.601.85/0.561.17/1.40/0.591.06/0.431.29/0.45
      109191.70/0.691.81/0.851.14/1.87/0.623.78/0.901.63/0.65
    • Table 6. Evaluation of localization accuracy (RMSE)

      View table

      Table 6. Evaluation of localization accuracy (RMSE)

      Seq. No.77808489111115119144265279
      F-LOAM0.681.010.812.582.450.821.540.911.421.32
      AVLS1.250.580.620.540.981.021.160.860.780.99
      Seq. No.281309311314335343481486489494
      F-LOAM1.244.531.030.630.740.840.731.061.370.88
      AVLS0.844.880.511.011.130.810.770.681.000.39
      Seq. No.547549604610615621827830834841
      F-LOAM1.261.112.451.061.100.954.542.161.771.52
      AVLS1.500.421.590.840.340.574.521.611.521.61
      Seq. No.9339399411027102810301032103710391043
      F-LOAM3.601.380.931.591.111.670.811.761.521.72
      AVLS3.461.290.681.101.411.080.321.970.981.80
    Tools

    Get Citation

    Copy Citation Text

    Weichao Zhou, Jun Huang. Adaptive Tightly Coupled Lidar-Visual Simultaneous Localization and Mapping Framework[J]. Laser & Optoelectronics Progress, 2023, 60(20): 2028009

    Download Citation

    EndNote(RIS)BibTexPlain Text
    Save article for my favorites
    Paper Information

    Category: Remote Sensing and Sensors

    Received: Nov. 30, 2022

    Accepted: Feb. 6, 2023

    Published Online: Oct. 13, 2023

    The Author Email: Jun Huang (huangj@sari.ac.cn)

    DOI:10.3788/LOP223209

    Topics