Computer Applications and Software, Volume. 42, Issue 4, 319(2025)

FEW-SHOT LEARNING BASED ON KNOWLEDGE DISTILLATION AND TRANSFER LEARNING

Huang Youwen, Hu Yanfang, and Wei Guoqing
Author Affiliations
  • School of Information Engineering, Jiangxi University of Science and Technology, Ganzhou 341000, Jiangxi, China
  • show less
    References(24)

    [4] [4] Vinyals O, Blundell C, Lillicrap T, et al. Matching networks for one shot learning[C]//30th International Conference on Neural Information Processing Systems, 2016: 3630 -3638.

    [5] [5] Snell J, Swersky K, Zemel R. Prototypical networks for fewshot learning[C]//31st International Conference on Neural Information Processing Systems, 2017: 4080-4090.

    [6] [6] Sung F, Yang Y X, Zhang L, et al. Learning to compare: Relation network for few-shot learning[C]//IEEE/CVF Conference on Computer Vision and Pattern Recognition, 2018: 1199-1208.

    [7] [7] Hou R B, Chang H, Ma B P, et al. Cross attention network for few-shot classification[C]//33rd Conference on Neural Information Processing Systems, 2019: 4005-4016.

    [8] [8] Liu B, Cao Y, Lin Y T, et al. Negative margin matters: Understanding margin in few-shot classification[C]//16th European Conference on Computer Vision, 2020: 438-455.

    [9] [9] Ravi S, Larochelle H. Optimization as a model for few-shot learning[C]//5th International Conference on Learning Representations, 2017.

    [10] [10] Finn C, Abbeel P, Levine S. Model-agnostic meta-learning for fast adaptation of deep networks[C]//34th International Conference on Machine Learning, 2017: 1126-1135.

    [11] [11] Rusu A, Rao D, Sygnowski J, et al. Meta-learning with latent embedding optimization[C]//6th International Conference on Learning Representations, 2019.

    [12] [12] Sun Q R, Liu Y, Chua T S, et al. Meta-transfer learning for few-shot learning[C]//IEEE/CVF Conference on Computer Vision and Pattern Recognition, 2019: 403-412.

    [13] [13] Liu Y, Schiele B, Sun Q R. An ensemble of epoch-wise empirical bayes for few-shot learning[C]//16th European Conference on Computer Vision, 2020: 404-421.

    [14] [14] Zhang R X, Che T, Ghahramani Z, et al. MetaGAN: An adversarial approach to few-shot learning[C]//32nd International Conference on Neural Information Processing Systems, 2018: 2371-2380.

    [15] [15] Schwartz E, Karlinsky L, Shtok J, et al. Delta-encoder: An effective sample synthesis method for few-shot object recognition[C]//32rd Conference on Neural Information Processing Systems, 2018.

    [16] [16] Yang S, Liu L, Xu M. Free lunch for few-shot learning: Distribution calibration[C]//International Conference on Learning Representations, 2021.

    [17] [17] Dhillon G S, Chaudhari P, Ravichandran A, et al. A baseline for few-shot image classification[C]//International Conference on Learning Representations, 2020.

    [18] [18] Kolesnikov A, Beyer L, Zhai X H, et al. Big transfer (BIT): General visual representation learning[C]//16th European Conference on Computer Vision, 2020: 491-507.

    [19] [19] Hinton G, Vinyals O, Dean J. Distilling the knowledge in a neural network[EB]. arXiv: 1503.02531, 2015.

    [20] [20] Gidaris S, Bursuc A, Komodakis N, et al. Boosting few-shot visual learning with self-supervision[C]//IEEE/CVF International Conference on Computer Vision, 2019: 8058-8067.

    [21] [21] Tian Y L, Wang Y, Krishnan D, et al. Rethinking few-shot image classification: A good embedding is all you need?[C]//16th European Conference on Computer Vision, 2020: 266-282.

    [22] [22] Mobahi H, Farajtabar M, Bartlett P L. Self-distillation amplifies regularization in Hilbert space[C]//34th International Conference on Neural Information Processing System, 2020: 3351-3361.

    [23] [23] Yosinski J, Clune J, Bengio Y, et al. How transferable are features in deep neural networks?[C]//28th Conference on Neural Information Processing Systems, 2014: 3320-3328.

    [26] [26] Xu W J, Xu Y F, Wang H J, et al. Attentional constellation nets for few-shot learning[C]//International Conference on Learning Representations, 2021.

    [27] [27] Kim J, Kim H, Kim G. Model-agnostic boundary-adversarial sampling for test-time generalization in few-shot learning[C]//16th European Conference on Computer Vision, 2020: 599-617.

    [28] [28] Qiao S, Liu C, Shen W, et al. Few-shot image recognition by predicting parameters fromActivations[C]//IEEE Conference on Computer Vision and Pattern Recognition, 2018: 7229-7238.

    [29] [29] Lee K, Maji S, Ravichandran A, et al. Meta learning with differentiable convex optimization[C]//IEEE/CVF Conference on Computer Vision and Pattern Recognition, 2019: 10649-10657.

    Tools

    Get Citation

    Copy Citation Text

    Huang Youwen, Hu Yanfang, Wei Guoqing. FEW-SHOT LEARNING BASED ON KNOWLEDGE DISTILLATION AND TRANSFER LEARNING[J]. Computer Applications and Software, 2025, 42(4): 319

    Download Citation

    EndNote(RIS)BibTexPlain Text
    Save article for my favorites
    Paper Information

    Category:

    Received: Nov. 13, 2021

    Accepted: Aug. 25, 2025

    Published Online: Aug. 25, 2025

    The Author Email:

    DOI:10.3969/j.issn.1000-386x.2025.04.045

    Topics