Laser & Optoelectronics Progress, Volume. 59, Issue 16, 1610004(2022)

Human Instance Segmentation Based on Two-Stream Convolutional Neural Network

Zitong Ma and Guodong Wang*
Author Affiliations
  • College of Computer Science & Technology, Qingdao University, Qingdao 266071, Shandong , China
  • show less

    Segmentation of human instances is a fundamental problem in human-centered scene understanding and recognition. However, due to the diversity of human body shapes and interactions, spatial relations become complex, posing significant challenges for segmentation tasks. At the moment, most of the mainstream instance segmentation methods rely heavily on the boundary box detection of objects, and thus, are usually unable to effectively separate two highly overlapping objects. In this paper, human skeleton features with complete data annotation are used to provide a priori knowledge for the human instance segmentation task, and a two-stream network structure is proposed to extract skeleton and context features, respectively. The feature fusion module (FFB) then adaptively combines the features from different streams and sends them into the segmentation module, where the final segmentation result is obtained. The proposed algorithm’s average accuracy on the COCOPersons and OCHuman datasets is 59.5% and 56.7%, respectively, which is improved better than other algorithms.

    Tools

    Get Citation

    Copy Citation Text

    Zitong Ma, Guodong Wang. Human Instance Segmentation Based on Two-Stream Convolutional Neural Network[J]. Laser & Optoelectronics Progress, 2022, 59(16): 1610004

    Download Citation

    EndNote(RIS)BibTexPlain Text
    Save article for my favorites
    Paper Information

    Category: Image Processing

    Received: May. 18, 2021

    Accepted: Jun. 27, 2021

    Published Online: Jul. 22, 2022

    The Author Email: Wang Guodong (doctorwgd@gmail.com)

    DOI:10.3788/LOP202259.1610004

    Topics