Laser & Optoelectronics Progress, Volume. 61, Issue 13, 1330002(2024)

Application of Segmented Transformer Feature Extraction in Near Infrared Spectral Data Classification

Yongsheng Li1, Xianwei Hao1, Shu Xiang2, Yidan Shi3、*, and Xiaorun Li2
Author Affiliations
  • 1China Tobacco Zhejiang Industrial Co., Ltd., Hangzhou 310008, Zhejiang , China
  • 2College of Electrical Engineering, Zhejiang University, Hangzhou 310027, Zhejiang , China
  • 3Ocean College, Zhejiang University, Zhoushan 316000, Zhejiang , China
  • show less

    A segmented Transformer feature extraction network is proposed to address the challenges posed by near infrared spectroscopy, including high dimensionality, susceptibility to noise interference, and high spectral similarity among samples from different provinces. This network is applied to tobacco leaf origin identification to enhance classification accuracy. First, based on the one-dimensional structure of near infrared spectroscopy, an embedding layer is designed to compress features using one-dimensional convolution. Second, the data is divided into three parts along the spectral dimension using sliding windows. The Transformer architecture is improved to extract spectral features, addressing the issue of computational inefficiency caused by a large number of spectral bands. Last, to adapt to the characteristics of spectral data, a regression head with multiple layers of one-dimensional convolution is designed to predict the origin of the samples. To validate the effectiveness of the proposed algorithm, several comparative experiments are conducted, comparing classification accuracy, precision, recall, and other metrics with other algorithms. The superiority of each structure in the model is verified. The experimental results demonstrate that the proposed model effectively utilizes the spectral structure for feature extraction and noise suppression, successfully accomplishing the task of tobacco leaf origin identification.

    Keywords
    Tools

    Get Citation

    Copy Citation Text

    Yongsheng Li, Xianwei Hao, Shu Xiang, Yidan Shi, Xiaorun Li. Application of Segmented Transformer Feature Extraction in Near Infrared Spectral Data Classification[J]. Laser & Optoelectronics Progress, 2024, 61(13): 1330002

    Download Citation

    EndNote(RIS)BibTexPlain Text
    Save article for my favorites
    Paper Information

    Category: Spectroscopy

    Received: Sep. 28, 2023

    Accepted: Nov. 8, 2023

    Published Online: Jul. 17, 2024

    The Author Email: Yidan Shi (22134042@zju.edu.cn)

    DOI:10.3788/LOP232211

    CSTR:32186.14.LOP232211

    Topics