Optoelectronics Letters, Volume. 21, Issue 3, 188(2025)

ICA-Net: improving class activation for weakly supervised semantic segmentation via joint contrastive and simulation learning

Zhuang YE, Ruyu LIU, and Bo SUN
References(23)

[1] [1] ZHANG J H, GUI M P, WANG Q C, et al. Hierarchical topic model based object association for semantic SLAM[J]. IEEE transactions on visualization and computer graphics, 2019, 25(11): 3052-3062.

[2] [2] ZHANG J H, LIU J L, CHEN K Q, et al. Map recovery and fusion for collaborative augment reality of multiple mobile devices[J]. IEEE transactions on industrial informatics, 2020, 17(3): 2081-2089.

[3] [3] JIANG P T, YANG Y Q. A simple local-to-global knowledge transfer framework for weakly supervised semantic segmentation[C]//Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, June 19-24, 2022, New Orleans, LA, USA. New York: IEEE, 2022: 16886-16896.

[4] [4] KIM B Y, HAN S, et al. Discriminative region suppression for weakly-supervised semantic segmentation[C]//Proceedings of the AAAI Conference on Artificial Intelligence, February 2-9, 2021, Virtual. Washington: AAAI Press, 2021: 1754-1761.

[5] [5] LEE J B, KIM E J. Anti adversarially manipulated attributions for weakly and semisupervised semantic segmentation[C]//Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, June 19-25, 2021, Virtual. New York: IEEE, 2021: 4071-4080.

[6] [6] KIM D, LEE S, CHOE J, et al. Weakly supervised semantic segmentation for driving scenes[C]//Proceedings of the AAAI Conference on Artificial Intelligence, February 20-27, 2024, Vancouver, Canada. New York: IEEE, 2024: 2741-2749.

[7] [7] ZHANG D, ZHANG H W. Causal intervention for weakly supervised semantic segmentation[C]//Advances in Neural Information Processing Systems, December 6-12, 2020, Virtual. Cambridge: MIT Press, 2020: 655-666.

[8] [8] JO S, YU I J, KIM K S. MARS: model-agnostic biased object removal without additional supervision for weakly-supervised semantic segmentation[C]//Proceedings of the IEEE/CVF International Conference on Computer Vision, October 2-6, 2023, Paris, France. New York: IEEE, 2023: 00063.

[9] [9] ZHANG Z, REN Z, TAO C, et al. GRASS: contrastive learning with gradient-guided sampling strategy for remote sensing image semantic segmentation[J]. IEEE transactions on geoscience and remote sensing, 2023, 61: 1-14.

[10] [10] KRISHNA C, ERTUNC E, NEERAV K, et al. Contrastive learning of global and local features for medical image segmentation with limited annotations[C]//Advances in Neural Information Processing Systems, December 6-12, 2020, Virtual. Cambridge: MIT Press, 2020: 12546-12558.

[11] [11] SUN G L, WANG W G. Mining cross-image semantics for weakly supervised semantic segmentation[C]//European Conference on Computer Vision, August 23-28, 2020, Virtual. Heidelberg: Springer, 2020: 347-365.

[12] [12] XU L, OUYANG W L, MOHAMMED B, et al. Leveraging auxiliary tasks with affinity learning for weakly supervised semantic segmentation[C]//Proceedings of the IEEE/CVF International Conference on Computer Vision, October 11-17, 2021, Virtual. New York: IEEE, 2021: 6984-6993.

[13] [13] YAO Y Z, CHEN T, XIE G S, et al. Nonsalient region object mining for weakly supervised semantic segmentation[C]//Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, June 19-25, 2021, Virtual. New York: IEEE, 2021: 2623-2632.

[14] [14] WU T, HUANG J S, GAO G Y, et al. Embedded discriminative attention mechanism for weakly supervised semantic segmentation[C]//Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, June 19-25, 2021, Virtual. New York: IEEE, 2021: 16765-16774.

[15] [15] XIE J H, HOU X X, YE K, et al. CLIMS: cross language image matching for weakly supervised semantic segmentation[C]//Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, June 19-24, 2022, New Orleans, LA, USA. New York: IEEE, 2022: 4483-4492.

[16] [16] CHEN Q, YANG L X, LAI J H, et al. Self-supervised image-specific prototype exploration for weakly supervised semantic segmentation[C]//Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, June 19-24, 2022, New Orleans, LA, USA. New York: IEEE, 2022: 4288-4298.

[17] [17] LI YI, DUAN Y Q, KUANG Z H, et al. Uncertainty estimation via response scaling for pseudo-mask noise mitigation in weakly supervised semantic segmentation[C]//Proceedings of the AAAI Conference on Artificial Intelligence, February 21-28, 2022, Virtual. Washington: AAAI Press, 2022: 1447-1455.

[18] [18] QIN J, WU J, XIAO X F, et al. Activation modulation and recalibration scheme for weakly supervised semantic segmentation[C]//Proceedings of the AAAI Conference on Artificial Intelligence, February 21-28, 2022, Virtual. Washington: AAAI Press, 2022: 2117-2125.

[19] [19] LEE M H, KIM D S, SHIM H J. Threshold matters in WSSS: manipulating the activation for the robust and accurate segmentation model against thresholds[C]//Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, June 19-24, 2022, New Orleans, LA, USA. New York: IEEE, 2022: 4330-4339.

[20] [20] HE K M, ZHANG X Y, REN S Q, et al. Deep residual learning for image recognition[C]//Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, June 27-30, 2016, Las Vegas, NV, USA. New York: IEEE, 2016: 770-778.

[21] [21] JIWOON A, SUNGHYUN C, SUHA K. Weakly supervised learning of instance segmentation with inter-pixel relations[C]//Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, June 16-20, 2019, Los Angeles, California, USA. New York: IEEE, 2019: 2209-2218.

[22] [22] WANG Y D, ZHANG J, KAN M N, et al. Self-supervised equivariant attention mechanism for weakly supervised semantic segmentation[C]//Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, June 16-18, 2020, Virtual. New York: IEEE, 2020: 12275-12284.

[23] [23] CHANG Y T, WANG Q S, HUNG W C, et al. Weakly supervised semantic segmentation via sub-category exploration[C]//Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, June 14-19, 2020, Virtual. New York: IEEE, 2020: 8991-9000.

Tools

Get Citation

Copy Citation Text

YE Zhuang, LIU Ruyu, SUN Bo. ICA-Net: improving class activation for weakly supervised semantic segmentation via joint contrastive and simulation learning[J]. Optoelectronics Letters, 2025, 21(3): 188

Download Citation

EndNote(RIS)BibTexPlain Text
Save article for my favorites
Paper Information

Received: Mar. 6, 2024

Accepted: Jan. 24, 2025

Published Online: Jan. 24, 2025

The Author Email:

DOI:10.1007/s11801-025-4056-2

Topics