Optics and Precision Engineering, Volume. 32, Issue 18, 2792(2024)

Occluded target grasping detection method based on spatial information aggregation

Renxiang CHEN1,*... Tianran QIU1, Lixia YANG2, Zhitong ZHANG1 and Liang XIA3 |Show fewer author(s)
Author Affiliations
  • 1Chongqing Jiaotong University, Chongqing Engineering Laboratory of Traffic Engineering Application Robot, Chongqing400074, China
  • 2School of Business Administration, Chongqing University of Science and Technology, Chongqing401331, China
  • 3Chongqing Intelligent Robot Research Institute, Chongqing 4000714, China
  • show less

    Aiming at the problem of low accuracy of occlusion target grasping position detection when the robot relies on vision grasping, we proposed an occlusion target grasping position detection method based on spatial information aggregation. Occlusion led to the change of the target's intrinsic features in the camera's field of view, which affected the target's positional information and shape-structural features. First, coordinate convolution was used instead of traditional convolution for feature extraction, and a new coordinate channel was added after the input feature map to improve the network's ability to perceive position information. Second, the spatial information aggregation module was designed, which adopted a parallel structure to increase the local sensing field and encoded the channels along the spatial direction to obtain multi-scale spatial information, and then aggregated the information through nonlinear fitting to make the model better understand the target structure and shape. Finally, the grasping position detection network outputted the grasping mass, angle and width, and calculated the optimal grasping position to establish the optimal grasping rectangular box. Validated on the Cornell Grasping dataset, the self-constructed occlusion dataset, and the Jacquard dataset, the detection accuracies reach 98.9%, 94.7%, and 96.0%, respectively, and the success rate is 93% in 100 real grasping experiments on the target in the experimental platform. The proposed method achieves the highest detection accuracy on all three datasets, and the detection effect is better in real scenes.

    Keywords
    Tools

    Get Citation

    Copy Citation Text

    Renxiang CHEN, Tianran QIU, Lixia YANG, Zhitong ZHANG, Liang XIA. Occluded target grasping detection method based on spatial information aggregation[J]. Optics and Precision Engineering, 2024, 32(18): 2792

    Download Citation

    EndNote(RIS)BibTexPlain Text
    Save article for my favorites
    Paper Information

    Category:

    Received: May. 16, 2024

    Accepted: --

    Published Online: Nov. 18, 2024

    The Author Email: CHEN Renxiang (manlou.yue@126.com)

    DOI:10.37188/OPE.20243218.2792

    Topics