Laser & Optoelectronics Progress, Volume. 60, Issue 6, 0615005(2023)

Robot Dynamic Object Positioning and Grasping Method based on Two Stages

Yuebo Meng1、*, Qi Huang1, Jiuqiang Han2, Shengjun Xu1, and Zhou Wang1
Author Affiliations
  • 1College of Information and Control Engineering, Xi'an University of Architecture and Technology, Xi'an 710055, Shaanxi , China
  • 2College of Automation Science and Engineering, Xi'an Jiaotong University, Xi'an 710049, Shaanxi , China
  • show less

    A two-stage dynamic multi-object positioning and grasping method is proposed to solve the problem of fast and accurate grasping of various types of dynamic objects on a factory assembly line. In the first stage, the proposed multiscale context-aware single-branch fusion semantic segmentation network is used to obtain the mask area of the target object: first, the feature extraction network adopts a single-branch structure, which reduces the number of network parameters while ensuring the extraction of rich spatial information and high-level semantic information; subsequently, the feature fusion network improves the expression ability of spatial data and semantic information through the bilateral guided feature fusion module; finally, the feature enhancement network is designed, and the feature assisted convergence module is embedded in the shallow and deep networks to accelerate the convergence speed of the network. In the second stage, a quick pose estimation strategy based on contour point detection is applied to predict the optimum posture of the grasping point in the mask region. The test results on the self-built dataset and the pipeline platform grab experiments demonstrate that the proposed method can detect and predict the position and posture of the object grab points in real time and accurately complete the object grab. Furthermore, its segmentation accuracy, prediction time, and grab success rate are better than the comparison method.

    Tools

    Get Citation

    Copy Citation Text

    Yuebo Meng, Qi Huang, Jiuqiang Han, Shengjun Xu, Zhou Wang. Robot Dynamic Object Positioning and Grasping Method based on Two Stages[J]. Laser & Optoelectronics Progress, 2023, 60(6): 0615005

    Download Citation

    EndNote(RIS)BibTexPlain Text
    Save article for my favorites
    Paper Information

    Category: Machine Vision

    Received: Dec. 27, 2021

    Accepted: Jan. 27, 2022

    Published Online: Mar. 16, 2023

    The Author Email: Meng Yuebo (mengyuebo@163.com)

    DOI:10.3788/LOP213364

    Topics