Acta Optica Sinica, Volume. 41, Issue 5, 0515002(2021)

Detection and Segmentation of Structured Light Stripe in Weld Image

Shikuan Zhang1,2,3,4, Qingxiao Wu1,2,3、*, and Zhiyuan Lin1,2,3,4
Author Affiliations
  • 1Key Laboratory of Opto-Electronic Information Processing, Chinese Academy of Sciences, Shenyang, Liaoning 110016, China
  • 2Shenyang Institute of Automation, Chinese Academy of Sciences, Shenyang, Liaoning 110016, China
  • 3Institutes for Robotics and Intelligent Manufacturing, Chinese Academy of Sciences, Shenyang, Liaoning 110169, China
  • 4University of Chinese Academy of Sciences, Beijing 100049, China
  • show less
    Figures & Tables(11)
    Network architecture
    Parallel downsampling module
    Weld structured light stripe images. (a) Image 1; (b) image 2; (c) image 3
    Schematic diagram of prediction process of detection branch
    Weld images. (a) Original image; (b) annotated image of segmentation
    Prediction results for each branch. (a)(b) Original images; (c)(d) results of Branch-dec; (e)(f) results of Branch-seg; (g)(h) total results; (i)(j) ground truth
    Recognition results of different networks. (a)(b)(c)(d) Original images; (e)(f)(g)(h) test results of DT-Net; (i)(j)(k)(l) test results of Tiny DT-Net; (m)(n)(o)(p) test results of DT-ENet; (q)(r)(s)(t) test results of DT-MobileNet_UNet
    • Table 1. Model comparison

      View table

      Table 1. Model comparison

      ModelParameterFLOPs
      U-Net1.32×1079.68×1011
      Modified U-Net1.50×1062.36×1010
    • Table 2. Prediction speed and accuracy of each branch

      View table

      Table 2. Prediction speed and accuracy of each branch

      ModelIcls0 /%Icls1 /%Mean IOU /%AP /%Time /msFrame rate /(frame·s-1)
      Branch-seg99.7487.8193.78——4025
      Branch-dec——————97.401759
      Total-result99.7487.8193.7897.404224
    • Table 3. Performance comparison of different loss functions

      View table

      Table 3. Performance comparison of different loss functions

      LossIcls0 /%Icls1 /%Mean IOU /%
      Lbce(Ypred,Ygt)99.7286.7493.23
      Lbce_Dice(Ypred,Ygt)99.7487.8193.78
    • Table 4. Performance comparison of different networks

      View table

      Table 4. Performance comparison of different networks

      ModelIcls0 /%Icls1 /%Mean IOU /%AP /%Time /msFrame rate /(frame·s-1)
      DT-Net99.7588.0193.8897.912484
      Tiny DT-Net99.7487.8193.7897.404224
      DT-ENet99.7286.7393.2297.401357
      DT-MobileNet_UNet99.7186.2892.9995.567413
    Tools

    Get Citation

    Copy Citation Text

    Shikuan Zhang, Qingxiao Wu, Zhiyuan Lin. Detection and Segmentation of Structured Light Stripe in Weld Image[J]. Acta Optica Sinica, 2021, 41(5): 0515002

    Download Citation

    EndNote(RIS)BibTexPlain Text
    Save article for my favorites
    Paper Information

    Category: Machine Vision

    Received: Sep. 14, 2020

    Accepted: Nov. 2, 2020

    Published Online: Apr. 7, 2021

    The Author Email: Wu Qingxiao (wuqingxiao@sia.cn)

    DOI:10.3788/AOS202141.0515002

    Topics