Instance Segmentation Algorithm Based on Semantic Alignment and Graph Node Interaction

$M e t h o d$	$B a c k b o n e$	$A P$	$A P_{50}$	$A P_{75}$	$A P_{S}$	$A P_{M}$	$A P_{L}$
Mask R-CNN^［26］	R-50-FPN	37.5	59.3	40.2	21.1	39.6	48.3
YOLACT++^［27］	R-50-FPN	34.1	53.3	36.2	11.7	36.1	53.6
BlendMask^［16］	R-50-FPN	37.0	58.9	39.7	17.3	39.4	52.5
SipMask V2^［17］	R-50-FPN	33.1	52.5	35.2	12.3	35.5	50.7
CondInst^［15］	R-50-FPN	37.7	58.9	40.3	20.4	40.2	48.9
SparseInst^［28］	R-50-d	36.1	57.0	38.2	15.0	37.7	53.1
OrienMask^［29］	D-53-FPN	34.8	56.7	36.4	16.0	38.2	47.8
SAGinst（ours）	R-50-FPN	38.3	59.7	41.1	20.5	40.6	51.7

Table 2. Module validity ablation experiment
View table
Table 2. Module validity ablation experiment
Baseline SAM GNIM AP $A P_{50}$ $A P_{75}$ $A P_{S}$ $A P_{M}$ $A P_{L}$
√ 36.2 57.3 38.5 17.0 39.6 51.4
√ √ 36.5 57.6 38.9 17.5 40.0 51.6
√ √ 36.4 57.3 38.7 17.5 40.1 51.4
√ √ √ 36.7 57.7 39.2 17.9 40.5 52.4

Table 3. Semantic alignment module branch ablation experiment
View table
Table 3. Semantic alignment module branch ablation experiment
Baseline Global Local AP $A P_{50}$ $A P_{75}$ $A P_{S}$ $A P_{M}$ $A P_{L}$
√ 36.2 57.3 38.5 17.0 39.6 51.4
√ √ 36.4 57.2 38.8 17.4 39.8 51.6
√ √ 36.1 56.9 38.5 17.4 39.6 51.2
√ √ √ 36.5 57.6 38.9 17.5 40.0 51.6

Table 4. Node aggregation ratio ablation experiment of graph node interaction module
View table
Table 4. Node aggregation ratio ablation experiment of graph node interaction module
Ratio FLOPs/10⁶ AP $A P_{50}$ $A P_{75}$ $A P_{S}$ $A P_{M}$ $A P_{L}$
4× 880 36.4 57.3 38.7 17.3 40.0 51.6
8× 101 36.4 57.3 38.7 17.5 40.1 51.4
16× 46 36.3 57.0 38.7 17.6 40.0 51.3

Table 5. Depth ablation experiment of graph node interaction module
View table
Table 5. Depth ablation experiment of graph node interaction module
Depth AP $A P_{50}$ $A P_{75}$ $A P_{S}$ $A P_{M}$ $A P_{L}$
1 36.4 57.3 38.7 17.5 40.1 51.4
2 36.3 57.1 38.5 17.6 39.8 51.5
3 36.1 57.1 38.5 17.0 39.7 51.7

Tools

Get Citation

Copy Citation Text

Min Zhang, Yangyang Deng, Yajun Li, Miaohui Zhang. Instance Segmentation Algorithm Based on Semantic Alignment and Graph Node Interaction[J]. Laser & Optoelectronics Progress, 2023, 60(22): 2210008

Download Citation

EndNote(RIS)BibTex Plain Text

Set citation alerts for article

Save article for my favorites