Laser & Optoelectronics Progress, Volume. 61, Issue 8, 0837015(2024)

Few-Shot Object Detection Based on Association and Discrimination

Jianli Jia1,2,3, Huiyan Han1,2,3、*, Liqun Kuang1,2,3, Fangzheng Han1,2,3, Xinyi Zheng1,2,3, and Xiuquan Zhang1,2,3
Author Affiliations
  • 1School of Computer Science and Technology, North University of China, Taiyuan 030051, Shanxi , China
  • 2Shanxi Key Laboratory of Machine Vision and Virtual Reality, Taiyuan 030051, Shanxi , China
  • 3Shanxi Province’s Vision Information Processing and Intelligent Robot Engineering Research Center, Taiyuan 030051, Shanxi , China
  • show less

    Deep learning-based object detection algorithms have matured considerably. However, detecting novel classes based on a limited number of samples remains challenging as deep learning can easily lead to feature space degradation under few-shot conditions. Most of the existing methods employ a holistic fine-tuning paradigm to pretrain on base classes with abundant samples and subsequently construct feature spaces for the novel classes. However, the novel class implicitly constructs a feature space based on multiple base classes, and its structure is relatively dispersed, thereby leading to poor separability between the base class and the novel class. This study proposes the method of associating a novel class with a similar base class and then discriminating each class for few-shot object detection. By introducing dynamic region of interest headers, the model improves the utilization of training samples and explicitly constructs a feature space for new classes based on the semantic similarity between the two. Furthermore, by decoupling the classification branches of the base and new classes, integrating channel attention modules, and implementing boundary loss functions, we substantially improve the separability between the classes. Experimental results on the standard PASCAL VOC dataset reveal that our method surpasses the nAP50 mean scores of TFA, MPSR, and DiGeo by 10.2, 5.4, and 7.8, respectively.

    Tools

    Get Citation

    Copy Citation Text

    Jianli Jia, Huiyan Han, Liqun Kuang, Fangzheng Han, Xinyi Zheng, Xiuquan Zhang. Few-Shot Object Detection Based on Association and Discrimination[J]. Laser & Optoelectronics Progress, 2024, 61(8): 0837015

    Download Citation

    EndNote(RIS)BibTexPlain Text
    Save article for my favorites
    Paper Information

    Category: Digital Image Processing

    Received: Jul. 5, 2023

    Accepted: Aug. 22, 2023

    Published Online: Apr. 16, 2024

    The Author Email: Han Huiyan (hhy980344@163.com)

    DOI:10.3788/LOP231658

    Topics