Acta Optica Sinica, Volume. 44, Issue 4, 0415001(2024)

Multi-Objective Optimization-Based Planning Algorithm for Efficient Visual Inspection

Haihua Cui1、*, Longfei Tian1、**, Jiarui Wang1, Junxue Qu1, Feng Yang2, and Jungang Guo2
Author Affiliations
  • 1College of Mechanical and Electrical Engineering, Nanjing University of Aeronautics & Astronautics, Nanjing 210016, Jiangsu, China
  • 2Avic Xi'an Aircraft Industry Group Company Ltd., Xi'an 710089, Shaanxi, China
  • show less
    Figures & Tables(19)
    Schematic of inspection planning
    Illustration of visual sensor field of view and viewpoint sampling
    Sampling viewpoint pose determination
    Viewpoint visibility analytics
    Chromosomal encoding
    Crossover operation
    Population update process
    Mesh models of target objects. (a) Model 1; (b) model 2
    Pareto frontier solution set. (a) Model 1; (b) model 2
    Inspection planning renderings. (a), (c) Viewpoint sampling renderings; (b), (d) holistic planning renderings of viewpoints and paths
    Comparison of optimal solutions for inspection time cost planned by different algorithms. (a) Model 1; (b) model 2
    Comparison of number of viewpoints planned by different algorithms. (a) Model 1; (b) model 2
    Comparison of computing time of different algorithms
    Experimental scene. (a) Physical scene; (b) Rviz simulation scene
    Photo and 3D reconstruction point cloud of target object. (a), (b) Object 1; (c), (d) object 2
    • Table 1. Planning results of C-NSGA-Ⅱ

      View table

      Table 1. Planning results of C-NSGA-Ⅱ

      Target object

      Number of

      sampled viewpoints

      Number of

      planned viewpoints

      Viewpoint coverage k /%Inspection time cost w
      Model 12652999.511803.6
      Model 21792199.541386.7
    • Table 2. Comparison results of viewpoint sampling methods

      View table

      Table 2. Comparison results of viewpoint sampling methods

      Target object

      Number of

      sampled viewpoints

      Average inspection time cost w
      Random samplingCurvature-based sampling
      Model 12652097.21805.4
      Model 21791496.61393.3
    • Table 3. Optimal solution results of planned inspection time costs

      View table

      Table 3. Optimal solution results of planned inspection time costs

      Planning algorithmAverage inspection time cost w
      Model 1Model 2
      Greedy-Greedy2421.61842.5
      Greedy-GA2246.91652.1
      GA-GA2017.71602.9
      GA2004.11567.5
      C-NSGA-Ⅱ1805.41393.3
    • Table 4. Planned inspection time cost versus actual inspection time results

      View table

      Table 4. Planned inspection time cost versus actual inspection time results

      Planning algorithmObject 1Object 2
      Planned inspection time cost wActual inspection time wa /sPlanned inspection time cost wActual inspection time wa /s
      Greedy-Greedy2641.7273.501906.0850.01
      Greedy-GA2496.5669.561774.7746.47
      GA-GA2197.0661.361697.1344.86
      GA2188.1161.021673.3644.01
      C-NSGA-Ⅱ2023.6055.931491.5339.89
    Tools

    Get Citation

    Copy Citation Text

    Haihua Cui, Longfei Tian, Jiarui Wang, Junxue Qu, Feng Yang, Jungang Guo. Multi-Objective Optimization-Based Planning Algorithm for Efficient Visual Inspection[J]. Acta Optica Sinica, 2024, 44(4): 0415001

    Download Citation

    EndNote(RIS)BibTexPlain Text
    Save article for my favorites
    Paper Information

    Category: Machine Vision

    Received: Oct. 7, 2023

    Accepted: Dec. 1, 2023

    Published Online: Feb. 29, 2024

    The Author Email: Cui Haihua (cuihh@nuaa.edu.cn), Tian Longfei (tlf15255927853@163.com)

    DOI:10.3788/AOS231620

    CSTR:32393.14.AOS231620

    Topics