Optics and Precision Engineering, Volume. 31, Issue 17, 2598(2023)

Lightweight deep global-local knowledge distillation network for hyperspectral image scene classification

Yingxu LIU1... Chunyu PU1, Diankun XU2, Yichuan YANG1 and Hong HUANG1,* |Show fewer author(s)
Author Affiliations
  • 1Key Laboratory of Optoelectronic Technology and Systems of the Education Ministry of China, Chongqing University, Chongqing400044, China
  • 2Measurement and Control Technology and Instrument major, College of Optoelectronic Engineering, Chongqing University, Chongqing400044, China
  • show less

    To address the challenges of the complex spatial layouts of target scenes and inherent spatial-spectral information redundancy of HSIs, an end-to-end lightweight deep global–local knowledge distillation (LDGLKD) method is proposed herein. To explore the global sequence properties of spatial-spectral features, the vision transformer (ViT) is used as the teacher to guide the lightweight student model for HSI scene classification. In LDGLKD, pre-trained VGG16 is selected as the student model to extract local detail information. After collaborative training of ViT and VGG16 through knowledge distillation, the teacher model transmits the learned long-range contextual information to the small-scale student model. By combining the advantages of the two models through knowledge distillation, the optimal classification accuracy of LDGLKD on the Orbita HSI scene classification dataset (OHID-SC) and hyperspectral remote sensing dataset for scene classification (HSRS) reached 91.62% and 97.96%, respectively. The experimental results revealed that the proposed LDGLKD method presented good classification performance. In addition, the OHID-SC based on the remote sensing data obtained by the Orbita Zhuhai-1 satellite could reflect the detailed information of land cover and provide data support for HSI scene classification.

    Tools

    Get Citation

    Copy Citation Text

    Yingxu LIU, Chunyu PU, Diankun XU, Yichuan YANG, Hong HUANG. Lightweight deep global-local knowledge distillation network for hyperspectral image scene classification[J]. Optics and Precision Engineering, 2023, 31(17): 2598

    Download Citation

    EndNote(RIS)BibTexPlain Text
    Save article for my favorites
    Paper Information

    Category: Information Sciences

    Received: Jan. 3, 2023

    Accepted: --

    Published Online: Oct. 9, 2023

    The Author Email: HUANG Hong (hhuang@cqu.edu.cn)

    DOI:10.37188/OPE.20233117.2598

    Topics