Optics and Precision Engineering, Volume. 31, Issue 17, 2598(2023)
Lightweight deep global-local knowledge distillation network for hyperspectral image scene classification
To address the challenges of the complex spatial layouts of target scenes and inherent spatial-spectral information redundancy of HSIs, an end-to-end lightweight deep global–local knowledge distillation (LDGLKD) method is proposed herein. To explore the global sequence properties of spatial-spectral features, the vision transformer (ViT) is used as the teacher to guide the lightweight student model for HSI scene classification. In LDGLKD, pre-trained VGG16 is selected as the student model to extract local detail information. After collaborative training of ViT and VGG16 through knowledge distillation, the teacher model transmits the learned long-range contextual information to the small-scale student model. By combining the advantages of the two models through knowledge distillation, the optimal classification accuracy of LDGLKD on the Orbita HSI scene classification dataset (OHID-SC) and hyperspectral remote sensing dataset for scene classification (HSRS) reached 91.62% and 97.96%, respectively. The experimental results revealed that the proposed LDGLKD method presented good classification performance. In addition, the OHID-SC based on the remote sensing data obtained by the Orbita Zhuhai-1 satellite could reflect the detailed information of land cover and provide data support for HSI scene classification.
Get Citation
Copy Citation Text
Yingxu LIU, Chunyu PU, Diankun XU, Yichuan YANG, Hong HUANG. Lightweight deep global-local knowledge distillation network for hyperspectral image scene classification[J]. Optics and Precision Engineering, 2023, 31(17): 2598
Category: Information Sciences
Received: Jan. 3, 2023
Accepted: --
Published Online: Oct. 9, 2023
The Author Email: HUANG Hong (hhuang@cqu.edu.cn)