Laser & Optoelectronics Progress, Volume. 61, Issue 13, 1330002(2024)

Application of Segmented Transformer Feature Extraction in Near Infrared Spectral Data Classification

Yongsheng Li1, Xianwei Hao1, Shu Xiang2, Yidan Shi3、*, and Xiaorun Li2
Author Affiliations
  • 1China Tobacco Zhejiang Industrial Co., Ltd., Hangzhou 310008, Zhejiang , China
  • 2College of Electrical Engineering, Zhejiang University, Hangzhou 310027, Zhejiang , China
  • 3Ocean College, Zhejiang University, Zhoushan 316000, Zhejiang , China
  • show less
    Figures & Tables(14)
    The overall structure of the model
    Illustration of one-dimensional convolution for spectral data
    Structure of simplified Transformer
    Structure of self-attention module
    Data distribution before and after data balancing
    Original spectral curve
    Confusion matrices of different algorithm classification results. (a) Support vector machine; (b) decision tree; (c) proposed algorithm
    • Table 1. Band range of different feature subsets

      View table

      Table 1. Band range of different feature subsets

      Subset123
      Band range1‒D/2D/4‒3D/4D/2‒D
    • Table 2. Distribution of sample origin

      View table

      Table 2. Distribution of sample origin

      ProvinceGuangdongGuizhouHubeiYunnan
      Number452141881830
    • Table 3. Comparison of the impact of different preprocessing algorithms on classification accuracy

      View table

      Table 3. Comparison of the impact of different preprocessing algorithms on classification accuracy

      Preprocess methodRaccuracy /%
      Original data96.40
      1st derivative99.67
      2nd derivative99.38
      SNV97.28
      MSC99.09
    • Table 4. Comparison of performance of Embedding layers with different structures

      View table

      Table 4. Comparison of performance of Embedding layers with different structures

      ModuleRaccuracy /%
      FC Embedding64.57
      1D-Conv Embedding99.09
    • Table 5. Performance comparison of different number of feature subsets

      View table

      Table 5. Performance comparison of different number of feature subsets

      Number of parts2345
      Raccuracy /%91.2699.0998.8597.50
    • Table 6. Performance comparison of different data fusion methods and regression head

      View table

      Table 6. Performance comparison of different data fusion methods and regression head

      ModuleRaccuracy /%
      Concatenate+FC94.42
      Stack+1D-Conv99.09
    • Table 7. Comparison of different algorithms

      View table

      Table 7. Comparison of different algorithms

      AlgorithmRaccuracy /%Rprecision /%Rrecall /%
      SVM-linear27.567.0025.00
      SVM-rbf92.6293.5092.25
      Decision Tree97.0596.7597.00
      ResNet91.7492.4691.74
      Proposed algorithm99.0999.0999.11
    Tools

    Get Citation

    Copy Citation Text

    Yongsheng Li, Xianwei Hao, Shu Xiang, Yidan Shi, Xiaorun Li. Application of Segmented Transformer Feature Extraction in Near Infrared Spectral Data Classification[J]. Laser & Optoelectronics Progress, 2024, 61(13): 1330002

    Download Citation

    EndNote(RIS)BibTexPlain Text
    Save article for my favorites
    Paper Information

    Category: Spectroscopy

    Received: Sep. 28, 2023

    Accepted: Nov. 8, 2023

    Published Online: Jul. 17, 2024

    The Author Email: Yidan Shi (22134042@zju.edu.cn)

    DOI:10.3788/LOP232211

    CSTR:32186.14.LOP232211

    Topics