Semiconductor Optoelectronics, Volume. 45, Issue 2, 327(2024)

SLAM Based on Deep Learning and Optical Flow Constraints in Dynamic Scenes

LIU Yanju, YAN Jiahua, and FENG Yingbin
Author Affiliations
  • [in Chinese]
  • show less

    To address the problems of low localization accuracy and map vignetting in Visual Simultaneous Localization and Mapping (VSLAM) technology in dynamic environments,this paper proposes a dynamic SLAM algorithm based on deep learning. The proposed algorithm utilizes YOLOv8n, which has few network parameters and a high target recognition rate, to improve the visual front end of the system, add semantic information to the visual front end, and extract the dynamic region feature points. The LK optical flow method is then used to identify the dynamic feature points in the dynamic region, eliminate these dynamic feature points, and retain the static feature points in the dynamic region so as to improve the utilization rate of feature points. In addition, the proposed algorithm increases the map construction thread,eliminates the dynamic object point cloud extracted by YOLOv8n, receives the semantic information extracted by the front end, constructs a static semantic map, and eliminates the virtual shadow produced by dynamic objects. Experimental verification indicates that the proposed algorithm improves the localization accuracy in dynamic environments by 92.71% as compared to that of ORB-SLAM3. Further, it achieves a small improvement compared with other dynamic vision SLAM algorithms.

    Tools

    Get Citation

    Copy Citation Text

    LIU Yanju, YAN Jiahua, FENG Yingbin. SLAM Based on Deep Learning and Optical Flow Constraints in Dynamic Scenes[J]. Semiconductor Optoelectronics, 2024, 45(2): 327

    Download Citation

    EndNote(RIS)BibTexPlain Text
    Save article for my favorites
    Paper Information

    Category:

    Received: Nov. 8, 2023

    Accepted: --

    Published Online: Aug. 14, 2024

    The Author Email:

    DOI:10.16818/j.issn1001-5868.2023110804

    Topics