Acta Optica Sinica, Volume. 38, Issue 8, 0815002(2018)

Review on Automated Optical (Visual) Inspection and Its Applications in Defect Detection

Rongsheng Lu1、*, Ang Wu1,2, Tengda Zhang1, and Yonghong Wang1
Author Affiliations
  • 1 School of Instrument Science and Opto-Electronics Engineering, Hefei University of Technology, Hefei, Anhui 230009, China
  • 2 College of Mechanical and Electrical Engineering, Henan Agricultural University, Zhengzhou, Henan 450002, China
  • show less
    References(155)

    [6] Shi Y Q, Lu R S, Zhang T D. Defect inspection system design based on the automated optical inspection technique for LCD backlight modules[J]. Chinese Journal of Sensors and Actuators, 28, 768-773(2015).

    [7] Janoczki M, Becker A, Jakab L et al. Automatic optical inspection of soldering, materials science[M]. Yitzhak Mastai: IntechOpen(2013).

    [8] marking systems, methods: US09/941416[P]. -03-06. Smith A. Automated optical inspection(2003).

    [9] Lu R S. State of the art of automated optical inspection[J]. Infrared and Laser Engineering, 37, 120-123(2008).

    [12] Dong J T. Study on the 3D micro/nano measurement system and techniques based on Linnik polarization-sensitive white light interferometry[D]. Hefei: Hefei University of Technology(2012).

    [13] Li Q. Surface defects AOI inspection technology and system architecture[D]. Hefei: Hefei University of Technology(2012).

    [16] Tsang L, Kong J A, Ding K H. Scattering of electromagnetic waves, theories and applications[M]. New York: John Wisley & Sons Inc.(2000).

    [17] Collin R E. Electromagnetic scattering from perfectly conducting rough surfaces (a new full wave method)[J]. IEEE Transactions on Antennas and Propagation, 40, 1466-1477(1992).

    [19] Beckmann P, Spizzochino A. The scattering of electro-magnetic waves from rough surfaces[M]. New York: Pergamon(1963).

    [22] Muehlemann M. Standardizing defect detection for the surface inspection of large web steel[M]. New York: Illumination Technologies Inc, 1-9(2000).

    [24] Vriesenga M, Healey G, Peleg K et al. Controlling illumination color to enhance object discriminability. [C]∥Proceedings 1992 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, June 15-18, 1992, Champaign, IL, USA. New York: IEEE, 710-712(1992).

    [34] Infrared vision[EB/OL]∥Wikipedia, the free encyclopedia. -03-19)[2018-05-16]. https:∥en.wikipedia.org/w/index.php?title=Infrared_vision&oldid=831150773.(2018).

    [38] Ibarra-Castanedo C, Sfarra S, Genest M et al. Infrared vision: visual inspection beyond the visible spectrum[M]. ∥Liu Z, Ukida H, Ramuhalli P, et al. Integrated imaging and vision techniques for industrial inspection. London: Springer, 41-58(2015).

    [44] Kim G. Micro defect detection in solar cell wafer based on hybrid illumination and near-infrared optics. [C]∥2013 9th Asian Control Conference (ASCC), June 23-26, 2013, Istanbul, Turkey. New York: IEEE, 1-5(2013).

    [45] Hamdi A A, Fouad M M, Sayed M S. Patterned fabric defect detection system using near infrared imaging. [C]∥2017 Eighth International Conference on Intelligent Computing and Information Systems (ICICIS), December 05-07, 2017, Cairo, Egypt. New York: IEEE, 111-117(2017).

    [46] Zhang X W, Ding Y Q, Yan P. Vision inspection of metal surface defects based on infrared imaging[J]. Acta Optica Sinica, 31, 0312004(2011).

    [48] Chen D, Zhang X, Zhang G et al. Infrared thermography and its applications in aircraft non-destructive testing. [C]∥2016 International Conference on Identification, Information and Knowledge in the Internet of Things(IIKI), October 20-21, 2016, Beijing, China. New York: IEEE, 374-379(2016).

    [49] Tang C Q, Tian G Y, Chen X T et al. Infrared and visible images registration with adaptable local-global feature integration for rail inspection[J]. Infrared Physics & Technology, 87, 31-39(2017).

    [51] He Y Z, Du B L, Huang S D. Non-contact electromagnetic induction excited infrared thermography for photovoltaic cells and modules inspection[J]. IEEE Transactions on Industrial Informatics, 1(2018).

    [53] Andonova A, Angelov G, Chernev P. Diagnostics of packaged ICs by infrared thermography. [C]∥Proceedings of the 2014 37th International Spring Seminar on Electronics Technology, May 07-11, 2014, Dresden, Germany. New York: IEEE, 261-266(2014).

    [54] Vavilov V P. Modeling thermal NDT problems[J]. International Journal of Heat and Mass Transfer, 72, 75-86(2014).

    [55] Yang R Z, He Y Z. Corrigendum for “Optically and non-optically excited thermography for composites: A review”. [Infrared Phys. Technol. 75 (2016) 26-50][J]. Infrared Physics & Technology, 76, 259-260(2016).

    [57] Katila P. UV. -03-23)[2018-05-12]. http:∥www.ledsmagazine.com/articles/print/volume-12/issue-3/features/thermal/uv-and-industrial-led-applications-require-efficient-thermal-substrates.html.(2015).

    [63] Daloglu M U, Ray A, Gorocs Z et al. On-chip microscopy and nano-particle detection using ultraviolet light. [C]∥2017 Conference on Lasers and Electro-Optics (CLEO), May 14-19, 2017, San Jose, CA, USA. New York: IEEE, 1-2(2017).

    [68] Hecht E. Optics[M]. 4th ed. New Jersey: Addison Wesley(2002).

    [69] Liang S K[M]. Physical optics(1986).

    [71] Yu D Y, Tan H Y[M]. Engineering optics(1999).

    [72] Successful Light Polarization Techniques[EB/OL]. -03-11)[2018-05-12]. https:∥www.edmundoptics.com/resources/application-notes/illumination/successful-light-polarization-techniques/.(2014).

    [73] Tianjin University[M]. Teaching and Research Office of Material Mechanics, Photoelastic Group. Photoelastic principle and testing technology(1982).

    [75] Wei X H, Gao B, Li Q et al. Study of the stress birefringence measurement of optical glass[J]. Acta Optica Sinica, 35, s212002(2015).

    [76] Yoshizawa T[M]. Handbook of optical metrology, principles and applications(2009).

    [84] Meyer J, Gruna R, Längle T et al[J]. Simulation of an inverse schlieren image acquisition system for inspecting transparent objects Electronic Imaging, 2016, 1-9.

    [85] Batchelor B G. Machine vision handbook[M]. London, UK: Springer(2012).

    [86] Beyerer J, Leon F P, Frese C. Machine vision, automated vision inspection: theory, practice and application[M]. London, UK: Springer(2016).

    [87] Panigrahi P K, Muralidhar K. Schlieren and shadowgraph methods in heat and mass transfer[M]. Berlin: Springer(2012).

    [88] Settles G S. Schlieren and shadowgraph techniques[M]. Berlin: Springer(2001).

    [90] Osten W. Digital image processing for optical metrology[M]. ∥William Sharpe, Springer handbook of experimental solid mechanics. Boston: Springer, 481-564(2008).

    [91] Schnars U, Jueptner W. Digital holography, digital hologram recording, numerical reconstruction and related techniques[M]. Berlin: Springer(2005).

    [97] Kim M K. Digital holographic microscopy, principles, techniques, and applications[M]. New York: Springer(2011).

    [98] Inspection in Industry. Braunschweig, Germany[2018-05-12]. 2011 http:∥www.imeko.org/publications/tc14-2011/IMEKO-TC14-2011-10.pdf.(2011).

    [99] Yamaguchi I. Holography, speckle, and computers[J]. Optics and Lasers in Engineering, 39, 411-429(2003).

    [100] Jacquot P. Speckle interferometry: A review of the principal methods in use for experimental mechanics applications[J]. Strain, 44, 57-69(2008).

    [101] Yang L X, Siebert T. Digital speckle interferometry in engineering[J]. New Directions in Holography and Speckle, 405-440(2008).

    [102] Groves R M, Pradarutti B, Kouloumpi E et al. 2D and 3D non-destructive evaluation of a wooden panel painting using shearography and terahertz imaging[J]. NDT & E International, 42, 543-549(2009).

    [103] Rao M V, Samuel R, Ananthan A. Applications of electronic speckle interferometry (ESI) techniques for spacecraft structural components[J]. Optics and Lasers in Engineering, 40, 563-571(2003).

    [106] Feng J Y, Wang Y H, Wang X et al. Design of digital shearography with wide angle of view based on 4f system[J]. Journal of Applied Optics, 36, 188-193(2015).

    [108] Liu P, Wang Y H, Feng J Y et al. Phase detection technology in spatial carrier based on deflection angle[J]. Opto-Electronic Engineering, 42, 39-43(2015).

    [109] Steinchen W, Yang L X[M]. Digital shearography-theory and application of digital speckle pattern interferometry(2003).

    [111] Wang Y H, Lü Y B, Gao X Y et al. Research progress in shearography and its applications[J]. Chinese Journal of Optics, 10, 300-309(2017).

    [113] General Administration of Quality Supervision, Inspection, Quarantine of the People's Republic of China, . Geometrical Product Specification(GPS)-Surface imperfections-Terms,(2002).

    [114] Whitehouse D J[M]. Handbook of Surface and Nano-metrology(2010).

    [115] [2018-05-12]. Crack https:∥baike.baidu.com/item/%E8%A3%82%E7%BA%B9/10776905?fr=aladdin..

    [117] Tsai D M, Hung C Y. Automatic defect inspection of patterned thin film transistor-liquid crystal display (TFT-LCD) panels using one-dimensional Fourier reconstruction and wavelet decomposition[J]. International Journal of Production Research, 43, 4589-4607(2005).

    [118] Tsai D M, Chuang S T, Tseng Y H. One-dimensional-based automatic defect inspection of multiple patterned TFT-LCD panels using Fourier image reconstruction[J]. International Journal of Production Research, 45, 1297-1321(2007).

    [119] Zhang T D, Lu R S. Automatic period selection for DFT method in the application of TFT-LCD panel detection[J]. Journal of Electronic Measurement and Instrumentation, 30, 361-373(2016).

    [120] Zhang T D, Lu R S, Dang X M. Automatic neighbor r selection for one-dimensional DFT method in the surface defect inspection of TFT-LCD[J]. China Mechanical Engineering, 27, 2895-2901(2016).

    [122] Zhang T D, Lu R S, Zhang S Z. Surface defect inspection of TFT-LCD panels based on 2D DFT[J]. Opto-Electronic Engineering, 43, 7-15(2016).

    [130] Chen S H, Perng D B. Automatic surface inspection for directional textures using discrete cosine transform. [C]∥2009 Chinese Conference on Pattern Recognition, November 04-06, 2009, Nanjing, China. New York: IEEE, 1-5(2009).

    [132] Yao M H, Li J, Wang X B. Solar cells surface defects detection using RPCA method[J]. Chinese Journal of Computers, 36, 1943-1952(2013).

    [135] Lu C J, Tsai D M. Defect inspection of patterned thin film transistor-liquid crystal display panels using a fast sub-image-based singular value decomposition[J]. International Journal of Production Research, 42, 4331-4351(2004).

    [136] Wang X B, Li J, Yao M H et al. Solar cells surface defects detection based on deep learning[J]. Pattern Recognition and Artificial Intelligence, 27, 517-523(2014).

    [137] Liu Z F, Yan L, Li C L et al. Fabric defect detection algorithm based on sparse optimization[J]. Journal of Textile Research, 37, 56-61, 74(2016).

    [138] Gong F, Zhang X W, Sun H. Detection system for solar module surface defects based on constrained ICA model and PSO method[J]. Acta Optica Sinica, 32, 0415002(2012).

    [140] Connected component labeling[EB/OL]. -06-13)[2018-05-10]. https:∥blogs.math works.com/steve/category/connected-components/.(2007).

    [141] GC image user’s guide[EB/OL]. -07-18)[2018-05-10]. http:∥cse.unl.edu/~reich/ gcimage/V1.3/analysis.html.(2007).

    [142] Wang C S, Lu R S, Li Q et al. Mark defects based on hotelling transform and CUDA architecture[J]. Science Technology and Engineering, 12, 2556-2560(2012).

    [147] Vapnik V N. The nature of statistical learning theory[M]. Berlin: Springer(1999).

    [148] Vapnik V N. Estimation of dependences based on empirical data[M]. 2nd ed. Berlin: Springer(2006).

    [149] Jia H, Murphey Y L, Shi J et al. An intelligent real-time vision system for surface defect detection. [C]∥Proceedings of the 17th International Conference on Pattern Recognition, August 26, 2004, Cambridge, UK. New York: IEEE, 239-242(2004).

    [151] Tang B, Kong J Y, Wu S Q. Review of surface defect detection based on machine vision[J]. Journal of Image and Graphics, 22, 1640-1663(2017).

    [154] Islam S M S, Rahman S, Dey E K. Application of deep learning to computer vision: a comprehensive study. [C]∥2016 5th International Conference on Informatics, Electronics and Vision (ICIEV), May 13-14, 2016, Dhaka, Bangladesh, 592-597(2016).

    [155] Wang J J, Ma Y L, Zhang L B et al. 2018-05-12]. https:∥www.sciencedirect.com/science/article/pii/S0278612518300037.(2018).

    [156] Kamilaris A. Prenafeta-Boldú F X. Deep learning in agriculture: a survey[J]. Computers and Electronics in Agriculture, 147, 70-90(2018).

    [158] Nguyen V N, Jenssen R J, Roverso D. Automatic autonomous vision-based power line inspection: a review of current status and the potential role of deep learning[J]. International Journal of Electrical Power & Energy Systems, 99, 107-120(2018).

    [161] Krig S. Computer vision metrics, survey, taxonomy and analysis[M]. Berlin: Springer(2016).

    [166] Król D, Nguyen N T, Shirai K. Advanced topics in intelligent information and database systems[M]. Berlin: Springer, 235-247(2017).

    [168] Atha D J, Jahanshahi M R. Evaluation of deep learning approaches based on convolutional neural networks for corrosion detection[J]. Structural Health Monitoring: An International Journal, 1475921717737051(2017).

    [169] Yu Z, Wu X, Gu X. Fully convolutional networks for surface defect inspection in industrial environment. [C]∥Liu M, Chen H, Vincze M. Computer Vision Systems. Lecture Notes in Computer Science. Cham: Springer, 10528, 417-426(2017).

    CLP Journals

    [1] Tingting Liu, Peiguang Wang, Na Zhang. Subpixel Defect Detection in Highly Reflective Workpieces Based on Zernike Moments[J]. Laser & Optoelectronics Progress, 2019, 56(12): 121203

    Tools

    Get Citation

    Copy Citation Text

    Rongsheng Lu, Ang Wu, Tengda Zhang, Yonghong Wang. Review on Automated Optical (Visual) Inspection and Its Applications in Defect Detection[J]. Acta Optica Sinica, 2018, 38(8): 0815002

    Download Citation

    EndNote(RIS)BibTexPlain Text
    Save article for my favorites
    Paper Information

    Category: Machine Vision

    Received: May. 14, 2018

    Accepted: Jun. 11, 2018

    Published Online: Sep. 6, 2018

    The Author Email:

    DOI:10.3788/AOS201838.0815002

    Topics