Laser & Optoelectronics Progress, Volume. 62, Issue 12, 1215001(2025)

Mask-Based and Multi-Modal Bird's Eye View Feature-Guided Point Cloud Panoptic Segmentation

Jiaming Zhang, Yuhui Peng*, Gan Zhang, Baozhe Sun, and Shenyang Lin
Author Affiliations
  • School of Mechanical Engineering and Automation, Fuzhou University, Fuzhou 350108, Fujian , China
  • show less
    Figures & Tables(12)
    Architecture of BEVGuide-PS network
    Architecture of conventional masked attention mechanism network
    Architecture of BEV feature-guided network module
    Architecture of attention mask predictor module
    Comparison of multi-class panoptic segmentation accuracy
    Comparative visualization of point cloud panoptic segmentation of different models. (a) BEVGuide-PS(L+C); (b) BEVGuide-PS(L); (c) MaskPLS; (d) EfficientLPS
    Comparative visualization of ‘Thing’ attention mask. (a) BEVGuide-PS(L+C); (b) BEVGuide-PS(L); (c) MaskPLS
    Comparative visualization of ‘Stuff’ attention mask. (a) BEVGuide-PS(L+C); (b) BEVGuide-PS(L); (c) MaskPLS
    Camera projection view of point cloud panoptic segmentation
    Detailed view of BEVGuide-PS panoptic segmentation
    • Table 1. Comparison of point cloud panoptic segmentation accuracy on nuScenes dataset

      View table

      Table 1. Comparison of point cloud panoptic segmentation accuracy on nuScenes dataset

      ModelPQPQRQSQPQThRQThSQThPQStRQStSQStmIoU
      EfficientLPS62.065.673.983.456.868.083.270.683.683.865.6
      Panoptic-PolarNet63.467.275.383.959.270.384.170.483.583.666.9
      SCAN2665.168.975.385.760.670.285.772.583.885.777.4
      DS-Net542.551.050.383.632.538.383.159.270.384.470.7
      MaskPLS(Baseline)57.760.266.071.864.473.384.852.260.762.462.5
      BEVGuide-PS(L)66.169.176.885.965.276.585.772.984.185.977.8
      BEVGuide-PS(L+C)67.970.478.186.866.877.386.373.184.386.578.9
    • Table 2. Comparison of ablation experiment results

      View table

      Table 2. Comparison of ablation experiment results

      ModelBEV object queries fusionBEV feature-guidedCamera imagesPQ /%PQ /%RQ /%SQ /%Inference time /ms
      MaskPLS(Baseline)57.760.266.071.8315
      Model A52.356.161.269.1106
      Model B56.759.264.570.6130
      BEVGuide-PS(L)66.169.176.885.9131
      BEVGuide-PS(L+C)67.970.478.186.8163
    Tools

    Get Citation

    Copy Citation Text

    Jiaming Zhang, Yuhui Peng, Gan Zhang, Baozhe Sun, Shenyang Lin. Mask-Based and Multi-Modal Bird's Eye View Feature-Guided Point Cloud Panoptic Segmentation[J]. Laser & Optoelectronics Progress, 2025, 62(12): 1215001

    Download Citation

    EndNote(RIS)BibTexPlain Text
    Save article for my favorites
    Paper Information

    Category: Machine Vision

    Received: Nov. 13, 2024

    Accepted: Dec. 12, 2024

    Published Online: Jun. 12, 2025

    The Author Email: Yuhui Peng (pengyuhui@fzu.edu.cn)

    DOI:10.3788/LOP242258

    CSTR:32186.14.LOP242258

    Topics