Semiconductor Optoelectronics, Volume. 44, Issue 1, 134(2023)

Research on Instance Segmentation Algorithm Based on YOLACT and Transformer

ZHAO Jingwei1,2, LIN Shanling2,3, MEI Ting1,2, LIN Zhixian1,2,3、*, and GUO Tailiang1,2
Author Affiliations
  • 1[in Chinese]
  • 2[in Chinese]
  • 3[in Chinese]
  • show less

    In order to improve the segmentation accuracy of single stage instance segmentation and improve the situation of missed and wrong detection of small targets, an improved YOLACTR algorithm is proposed based on YOLACT algorithm. The algorithm first used the combination of CNN and Transformer to design a new head prediction network to further extract features, and used two-way attention to correlate the mask information of the same instance and distinguish the mask features between different instances. It paid attention to the correlation information around the feature points, making the prediction of the detection box more accurate. Then the mask branch was formed by the combination of multi-level up sampling module and the designed CS attention module, which integrated a variety of different scale information. Then the CS attention module was used to pay attention to different scale information. On the MS COCO data, compared with YOLACT algorithm, YOLACTR algorithm improves the detection accuracy of box and mask by 7.4% and 2.9% respectively, and improves the detection accuracy of small targets by 18.9% and 13.5% respectively. Experiments results show that YOLACTR algorithm can improve the accuracy of detection, segmentation and classification in multi-target complex scenes, which improves the problem of missed and wrong detection of small targets and overlapping targets.

    Tools

    Get Citation

    Copy Citation Text

    ZHAO Jingwei, LIN Shanling, MEI Ting, LIN Zhixian, GUO Tailiang. Research on Instance Segmentation Algorithm Based on YOLACT and Transformer[J]. Semiconductor Optoelectronics, 2023, 44(1): 134

    Download Citation

    EndNote(RIS)BibTexPlain Text
    Save article for my favorites
    Paper Information

    Category:

    Received: Nov. 2, 2022

    Accepted: --

    Published Online: Apr. 7, 2023

    The Author Email: Zhixian LIN (lzx2005000@163.com)

    DOI:10.16818/j.issn1001-5868.2022110201

    Topics