Chinese Journal of Lasers, Volume. 51, Issue 24, 2402110(2024)

Laser Stripe Segmentation of Weld Seam Based on CNN‑Transformer Hybrid Networks

Ying Wang1、*, Sheng Gao2, and Zhe Dai1
Author Affiliations
  • 1School of Computer Information Technology, Northeast Petroleum University, Daqing 163318, Heilongjiang , China
  • 2School of Mechanical Science and Engineering, Northeast Petroleum University, Daqing 163318, Heilongjiang , China
  • show less
    Figures & Tables(15)
    Structure diagram of MobileViT
    Image blocks in MobileViT block
    Weld laser stripe segmentation model
    Dual non-local block
    Sub-pixel convolution strategy
    Welding site picture
    Welding seam image acquisition and processing system
    Sample data enhancement effect
    Semantic annotation process. (a) Original images; (b) gray scale, thresholded images; (c) Steger operator processed images; (d) manually labeled images
    CTIM
    Training results for 20th round of each model
    • Table 1. Welding experiment parameters of GMAW

      View table

      Table 1. Welding experiment parameters of GMAW

      ParameterValue
      Dual pulse frequency /Hz3
      Welding current /A243
      Wire feed speed /(m·min-18.0
      Welding speed /(m·min-10.45
      Gas flow /(L·min-118
    • Table 2. Ablation test results

      View table

      Table 2. Ablation test results

      ProgramModelPPAPmPAPmIoUInference time /msParameter /M
      1MobileViT-S0.9600.9130.852606.4
      2MobileViT-XS0.9480.8570.774312.9
      3MobileViT-XXS0.9120.7940.678201.9
      4CTIM0.9520.8950.819343.4
      5CTIM-DNB0.9640.9210.867373.9
      6CTIM-ESPCN0.9680.9300.874373.7
      7Proposed model0.9800.9640.921404.1
    • Table 3. Experimental results with different loss functions

      View table

      Table 3. Experimental results with different loss functions

      Loss functionPlaserPPAPmPAPmIoUTotal training time /sStopping round
      Dice0.7710.9560.8790.8314025.45143
      BCE0.8240.9640.9050.8585003.12957
      Jaccard0.8530.9680.9200.8744969.24554
      BCE-Dice0.8060.9600.8960.8494721.11050
      Focal0.8820.9720.9340.8896180.14678
      Proposed loss function0.9410.9800.9640.9213679.56234
    • Table 4. Test results of different models

      View table

      Table 4. Test results of different models

      ModelPPAPmPAPmIoUInference time /ms
      DeepLabv3+0.9280.8500.76480
      PSPNet0.9600.9170.85296
      SegNet0.9520.8880.82388
      FCN-32s0.9720.9480.894110
      Unet0.9080.8340.71868
      RefineNet0.9640.9310.867102
      Proposed model0.9800.9640.92140
    Tools

    Get Citation

    Copy Citation Text

    Ying Wang, Sheng Gao, Zhe Dai. Laser Stripe Segmentation of Weld Seam Based on CNN‑Transformer Hybrid Networks[J]. Chinese Journal of Lasers, 2024, 51(24): 2402110

    Download Citation

    EndNote(RIS)BibTexPlain Text
    Save article for my favorites
    Paper Information

    Category: Laser Forming Manufacturing

    Received: Mar. 26, 2024

    Accepted: Jun. 21, 2024

    Published Online: Dec. 11, 2024

    The Author Email: Wang Ying (wangying@nepu.edu.cn)

    DOI:10.3788/CJL240710

    CSTR:32183.14.CJL240710

    Topics