Optics and Precision Engineering, Volume. 31, Issue 21, 3145(2023)

Intra-inter channel attention for few-shot classification

Liping YANG1,*... Tianyang ZHANG1, Yuyang WANG1 and Xiaohua GU2 |Show fewer author(s)
Author Affiliations
  • 1Key Laboratory of Optoelectronic Technique & System of Ministry of Education, Chongqing University, Chongqing400044, China
  • 2School of Electrical Engineering, Chongqing University of Science & Technology, Chongqing401331, China
  • show less

    As only one or a few training samples are used for few-shot classification tasks, the features extracted via a prototypical network cannot guarantee much discriminative power. Accordingly, this paper proposes an intra-inter channel attention few-shot classification (ICAFSC) method. This method uses an intra–inter channel attention module (ICAM) to calculate channel weights based on an intra-inter distance metric. The module is integrated into the prototypical network to make the embedded features more discriminative. To overcome the problems of overfitting or underfitting when directly learning the ICAM in the few-shot classification's meta-training stage, ICAFSC adds a pre-training stage before the meta-training of the prototypical network. We design adequate classification tasks with a large number of labeled samples to learn optimal parameters of the ICAM in the pre-training stage. Subsequently, in the meta-training and meta-testing stages of the prototypical network, ICAFSC first freezes the parameters of the ICAM to guarantee a stable channel attention relationship. It then achieves few-shot classification experience learning and transfer via meta-training and meta-testing. We conduct 1-shot and 5-shot few-shot classification experiments on the MiniImagenet dataset. The experimental results indicate that, compared to the prototypical network, the proposed ICAFSC method shows improvements of 1.93% and 1.15% for the 1-shot and 5-shot scenarios, respectively.

    Tools

    Get Citation

    Copy Citation Text

    Liping YANG, Tianyang ZHANG, Yuyang WANG, Xiaohua GU. Intra-inter channel attention for few-shot classification[J]. Optics and Precision Engineering, 2023, 31(21): 3145

    Download Citation

    EndNote(RIS)BibTexPlain Text
    Save article for my favorites
    Paper Information

    Category:

    Received: Apr. 6, 2023

    Accepted: --

    Published Online: Jan. 5, 2024

    The Author Email: YANG Liping (yanglp@cqu.edu.cn)

    DOI:10.37188/OPE.20233121.3145

    Topics