Laser & Infrared, Volume. 54, Issue 10, 1642(2024)

Research on unsupervised anomaly detection algorithm for point cloud and image fusion

XIE Hong-xing1,2, LIN Shan-ling1,2, LIN Zhi-xian1,2、*, GUO Tai-liang2, LIN Jian-pu1,2, and LV Shan-hong1,2
Author Affiliations
  • 1School of Advanced Manufacturing, Fuzhou University, Quanzhou 362251, China
  • 2Fujian Science and Technology Innovation Laboratory for Photoelectric Information, Fuzhou 350116, China
  • show less

    A multimodal industrial anomaly detection method based on normalizing flow is proposed to address the issue of interference between high-dimensional features in multimodal industrial detection, resulting in unsatisfactory detection rates. Firstly, the depth information of the 3D point cloud of the image is extracted and added to the RGB image as the fourth channel to generate the fused RGBD image. Then, the fused image features are extracted using a pre-trained feature extraction network. Finally, a normalizing flow model for anomaly detection is obtained using feature training. The experimental results show that the anomaly detection model achieves an average Pixel AUROC of 95.8% and an average AUPRO of 86.2% on the MVTec 3D-AD dataset, which is an improvement of 2.6% and 9.1%, respectively, compared to other models.

    Tools

    Get Citation

    Copy Citation Text

    XIE Hong-xing, LIN Shan-ling, LIN Zhi-xian, GUO Tai-liang, LIN Jian-pu, LV Shan-hong. Research on unsupervised anomaly detection algorithm for point cloud and image fusion[J]. Laser & Infrared, 2024, 54(10): 1642

    Download Citation

    EndNote(RIS)BibTexPlain Text
    Save article for my favorites
    Paper Information

    Category:

    Received: Dec. 11, 2023

    Accepted: Apr. 23, 2025

    Published Online: Apr. 23, 2025

    The Author Email: LIN Zhi-xian (lzx2005000@163.com)

    DOI:10.3969/j.issn.1001-5078.2024.10.020

    Topics