Acta Optica Sinica, Volume. 44, Issue 21, 2114003(2024)

Keyhole TIG Defect Detection and Classification Based on ResNet

Xuan Zhang1, Chenchen Ma2, and Mingdi Wang3、*
Author Affiliations
  • 1School of Mechanical and Electric Engineering, Soochow University, Suzhou 215131, Jiangsu , China
  • 2School of Textile and Clothing, Nantong University, Nantong 226019, Jiangsu , China
  • 3School of Mechanical and Electric Engineering, Soochow University, Suzhou 215131, Jiangsu , China
  • show less
    Figures & Tables(16)
    Camera and robot setup
    ResNet-18 model
    Convolutional layer
    Convolutions dynamics within CNN
    Pooling layer
    Six categories of images. (a) Good weld seam; (b) burn through; (c) contamination; (d) lack of fusion; (e) misalignment; (f) lack of penetration
    Data augmentation. (a) Origin; (b) rotation; (c) random horizontal; (d) random crop; (e) random brightness; (f) contrast adjustment
    Curves of accuracy and loss. (a) Accuracy curves; (b) loss curves
    Confusion matrix
    2D spatial distribution of deep features. (a) Combination of Softmax loss and center loss; (b) Softmax loss only
    Feature maps of ResNet features from different layers. (a) Input image; (b) convex function optimization layer; (c) layer 1; (d) final layer
    Process of obtaining guided grad-CAM
    Example of guided grad-CAM for welding image. (a) Input; (b) CAM; (c) guided grad-CAM
    • Table 1. Process parameter of keyhole TIG

      View table

      Table 1. Process parameter of keyhole TIG

      ParameterBaselineDeviation from baseline
      Gas flow rate /(L/min)3010, 15, 35, 40
      Traveling speed /(cm/min)20.010.0, 23.2, 24.8, 26.4, 33.4, 50.0
      Voltage /V1812, 22
      Current /A200100, 150, 220, 235
    • Table 2. Number of categories in the training and test sets

      View table

      Table 2. Number of categories in the training and test sets

      LabelTraining setTest set
      Good weld seam86522589
      Burn through1529400
      Contamination69542065
      Lack of fusion4258995
      Misalignment2854800
      Lack of penetration4605356
      Total288527205
    • Table 3. Comparison of classification performance between center loss model and Softmax loss model

      View table

      Table 3. Comparison of classification performance between center loss model and Softmax loss model

      TypeCenter loss-ResNetSoftmax loss model
      PrecisionAccuracyPrecisionAccuracy
      Lack of fusion0.9850.9510.7510.851
      Good weld seam0.9740.9500.5700.912
      Burn through1.0000.9711.0000.305
      Contamination0.9520.9620.9110.920
      Misalignment0.9470.9320.9650.964
      Lack of penetration0.9890.9810.8990.891
    Tools

    Get Citation

    Copy Citation Text

    Xuan Zhang, Chenchen Ma, Mingdi Wang. Keyhole TIG Defect Detection and Classification Based on ResNet[J]. Acta Optica Sinica, 2024, 44(21): 2114003

    Download Citation

    EndNote(RIS)BibTexPlain Text
    Save article for my favorites
    Paper Information

    Category: Lasers and Laser Optics

    Received: May. 22, 2024

    Accepted: Jul. 3, 2024

    Published Online: Nov. 19, 2024

    The Author Email: Wang Mingdi (wangmingdidi@126.com)

    DOI:10.3788/AOS241057

    CSTR:32393.14.AOS241057

    Topics