Chinese Journal of Lasers, Volume. 51, Issue 4, 0402105(2024)

Intelligent Online Detection of Laser Welding Defects Based on High Density Point Clouds (Invited)

Chen Zhang1、*, Peipei Hu2, Xinwang Zhu3, and Changqi Yang2
Author Affiliations
  • 1The Institute of Technological Sciences, Wuhan University, Wuhan 430072, Hubei , China
  • 2Shanghai Spaceflight Precision Machinery Institute, Shanghai 201600, China
  • 3Hubei Institute of Measurement and Testing Technology, Wuhan 430223, Hubei , China
  • show less
    Figures & Tables(15)
    Overall workflow chart of defect detection
    Experiment system for laser welding defect detection
    Complete sample images of typical welds. (a) Sheet butt weld;(b) thick plate butt weld; (c) bead-on-plate weld
    Different forms of data during data preprocessing. (a) Preprocessing of point cloud HDM data; (b) RGB images of surface defects; (c) high-density point cloud data; (d) depth images including 3D profile information of defects
    Structural diagram of Faster R-CNN
    Detection results using Faster R-CNNs based on ResNet18, ResNet50, and ResNet101
    Statistical results of three models. (a) Loss evolution of different models; (b) point cloud detection precisions and recall rates with different models; (c) detection precisions and recall rates of defects for point clouds and RGB images with different models; (d) detection mAPs of defects for point clouds and RGB images with different models; (e) testing time of different models
    Typical false negative test results of Faster R-CNN model based on ResNet50
    Measurement process of defect sizes. (a) RGB images; (b) point clouds; (c) depth gray images; (d) threshold segmentation; (e) locating defect areas; (f) defect feature size measurement
    Relative errors of defect measurement results
    • Table 1. Specific parameters of binocular structured light sensor

      View table

      Table 1. Specific parameters of binocular structured light sensor

      ParameterValue
      Size of sensor /(pixel×pixel)(2×103)×(2×103
      Repeatability in Z direction /μm3.3
      Resolution of image on XY plane /mm0.06‒0.09
      Field of view /(mm×mm)71×90 ‒100×154
      Clearance distance /mm164
      Measuring range /mm110
    • Table 2. Welding parameters

      View table

      Table 2. Welding parameters

      ParameterRangeValue in online test
      SaggingUndercut
      Laser power /kW1‒624
      Welding speed /(m/min)0.5‒10.025
      Defocus /mm-5‒5-2-2
      Shielding gas flow rate /(L/min)1‒201515
    • Table 3. Datasets after data augmentation

      View table

      Table 3. Datasets after data augmentation

      ImageDatasetUndercutSaggingDefect-freeTotal numberData augmentation
      Point cloud imageTotal170150130450

      Noise addition

      Mirroring

      Training11910591315
      Testing514539135
      RBG imageTotal848036200

      Noise addition

      Mirroring

      Training585626140
      Testing26241060
    • Table 4. Performance parameters of three models based on point cloud analysis

      View table

      Table 4. Performance parameters of three models based on point cloud analysis

      ModelOverall precision /%Overall recall rate /%mAP /%Run time /s
      ResNet187977.072.40.191
      ResNet509389.591.90.194
      ResNet1017366.562.40.253
    • Table 5. Measurement results of defect sizes

      View table

      Table 5. Measurement results of defect sizes

      No.Defect typeMaximum depth /mmArea /mm2Width /mmLength /mmActual width /mmActual length /mm
      1Sagging1.5147.533.003.552.963.52
      22.0308.672.205.852.175.83
      31.8109.683.354.003.393.94
      4Undercut0.43818.971.4530.551.4730.64
      50.56533.661.2056.251.1856.34
      60.47323.860.9539.250.9239.32
    Tools

    Get Citation

    Copy Citation Text

    Chen Zhang, Peipei Hu, Xinwang Zhu, Changqi Yang. Intelligent Online Detection of Laser Welding Defects Based on High Density Point Clouds (Invited)[J]. Chinese Journal of Lasers, 2024, 51(4): 0402105

    Download Citation

    EndNote(RIS)BibTexPlain Text
    Save article for my favorites
    Paper Information

    Category: Laser Forming Manufacturing

    Received: Oct. 16, 2023

    Accepted: Nov. 27, 2023

    Published Online: Feb. 19, 2024

    The Author Email: Zhang Chen (c.zhang@whu.edu.cn)

    DOI:10.3788/CJL231293

    CSTR:32183.14.CJL231293

    Topics