Optical Instruments, Volume. 45, Issue 2, 26(2023)

Fruit damage detection and classification based on attention mechanism

Jie ZHANG... Chunlei XIA*, Rongfu ZHANG, Julaiti HALIZHATI and Yi LIU |Show fewer author(s)
Author Affiliations
  • School of Optical-Electrical and Computer Engineering, University of Shanghai for Science and Technology, Shanghai 200093, China
  • show less
    Figures & Tables(19)
    ResNet34 network structure
    Residual module
    Structure of SE module
    Structure of CBAM module
    Structure of Residual Block-SE
    Improved model structure
    Fruit data set
    Visualization thermodynamic diagram of each layer feature extracted by mode
    Comparison of accuracy results of each network model for the validation set
    Comparison of the loss value of each network model for the train set
    Apples data set
    Comparison of network in the fresh apples category
    Comparison of network in the rotten apples category
    • Table 1. Comparison of classification performance of each network model

      View table
      View in Article

      Table 1. Comparison of classification performance of each network model

      模型准确率/%精确率/%召回率/%
      ResNet3497.997.997.9
      ResNet34+SE98.798.798.8
      ResNet34+CBAM98.398.498.4
      ResNet34+SE+CBAM98.898.899.0
    • Table 2. Results of each variety in test set

      View table
      View in Article

      Table 2. Results of each variety in test set

      类别精确率/%召回率/%特异度/%
      新鲜苹果98.299.399.5
      新鲜香蕉100.099.8100.0
      新鲜橙子98.899.399.8
      腐烂苹果98.397.799.5
      腐烂香蕉99.699.399.9
      腐烂橙子99.598.299.9
    • Table 3. Comparison of experimental test set results

      View table
      View in Article

      Table 3. Comparison of experimental test set results

      类别精确率/%召回率/%F1-Score/%
      ResNet34+SE+CBAM文献[5] ResNet34+SE+CBAM文献[5] ResNet34+SE+CBAM文献[5]
      新鲜苹果98.29899.39998.797
      新鲜香蕉100.09999.89899.897
      新鲜橙子98.89999.39999.099
      腐烂苹果98.39897.79997.998
      腐烂香蕉99.69999.39899.498
      腐烂橙子99.59998.29998.899
    • Table 4. Comparison of performance effects before and after network improvement before the data is added into the validation set

      View table
      View in Article

      Table 4. Comparison of performance effects before and after network improvement before the data is added into the validation set

      类别模型精确率/%召回率/%特异度/%
      新鲜苹果ResNet3497.898.899.2
      ResNet34+SE98.099.299.4
      ResNet34+CBAM97.998.999.3
      ResNet34+SE+CBAM98.299.399.5
      腐烂苹果ResNet3497.197.299.1
      ResNet34+SE98.097.599.5
      ResNet34+CBAM97.797.299.4
      ResNet34+SE+CBAM98.397.799.5
    • Table 5. Comparison of performance effects before and after network improvement after the data is added into the validation set

      View table
      View in Article

      Table 5. Comparison of performance effects before and after network improvement after the data is added into the validation set

      类别模型精确率/%召回率/%特异度/%
      新鲜苹果ResNet3493.891.399.0
      ResNet34+SE97.191.499.3
      ResNet34+CBAM94.191.499.1
      ResNet34+SE+CBAM97.391.699.5
      腐烂苹果ResNet3496.089.297.6
      ResNet34+SE96.592.697.4
      ResNet34+CBAM96.195.197.8
      ResNet34+SE+CBAM96.796.297.9
    • Table 6. Comparison of performance effects after data enhancement before and after network improvement

      View table
      View in Article

      Table 6. Comparison of performance effects after data enhancement before and after network improvement

      类别损失值准确率/%
      ResNet340.24597.4
      ResNet34+SE0.19598.0
      ResNet34+CBAM0.23597.8
      ResNet34+SE+CBAM0.19398.9
    Tools

    Get Citation

    Copy Citation Text

    Jie ZHANG, Chunlei XIA, Rongfu ZHANG, Julaiti HALIZHATI, Yi LIU. Fruit damage detection and classification based on attention mechanism[J]. Optical Instruments, 2023, 45(2): 26

    Download Citation

    EndNote(RIS)BibTexPlain Text
    Save article for my favorites
    Paper Information

    Category: APPLICATION TECHNOLOGY

    Received: Sep. 17, 2022

    Accepted: --

    Published Online: Jun. 12, 2023

    The Author Email: XIA Chunlei (xiachunlei@usst.edu.cn)

    DOI:10.3969/j.issn.1005-5630.2023.002.004

    Topics