Self-Supervised Pre-Training for Intravascular Ultrasound Image Segmentation Method Based on Diffusion Model

Wenyue Hao; Huaiyu Cai; Tingtao Zuo; Zhongwei Jia; Yi Wang; Xiaodong Chen

doi:10.3788/LOP232774

Laser & Optoelectronics Progress, Volume. 61, Issue 18, 1837005(2024)

Self-Supervised Pre-Training for Intravascular Ultrasound Image Segmentation Method Based on Diffusion Model

Wenyue Hao¹, Huaiyu Cai^1、*, Tingtao Zuo², Zhongwei Jia³, Yi Wang¹, and Xiaodong Chen¹

¹Key Laboratory of Optoelectronics Information Technology, Ministry of Education, School of Precision Instrument and Opto-Electronics Engineering, Tianjin University, Tianjin 300072, China

²Lepu Medical Technology (Beijing) Co., Ltd., Beijing 102200, China

³Southwestern Lu Hospital, Liaocheng 252325, Shandong, China

show less

Abstract Get PDF(in Chinese)

References(30)

[1] Arora P, Singh P, Girdhar A et al. CADNet: an advanced architecture for automatic detection of coronary artery calcification and shadow border in intravascular ultrasound (IVUS) images[J]. Physical and Engineering Sciences in Medicine, 46, 773-786(2023).

[2] Xia M H, Yang H B, Huang Y et al. 3D pyramidal densely connected network with cross-frame uncertainty guidance for intravascular ultrasound sequence segmentation[J]. Physics in Medicine & Biology, 68, 055001(2023).

[3] Liu J Y, Hao W Y, Jia Z W et al. An intravascular ultrasound segmentation network based on multi-task learning[J]. Proceedings of SPIE, 12277, 122770D(2022).

[4] Dosovitskiy A, Beyer L, Kolesnikov A et al. An image is worth 16 × 16 words: transformers for image recognition at scale[EB/OL]. https://arxiv.org/abs/2010.11929

[5] Bargsten L, Riedl K A, Wissel T et al. Attention via scattering transforms for segmentation of small intravascular ultrasound data setst[J]. Proceedings of Machine Learning Research, 143, 34-47(2021).

[6] Bargsten L, Raschka S, Schlaefer A. Capsule networks for segmentation of small intravascular ultrasound image datasets[J]. International Journal of Computer Assisted Radiology and Surgery, 16, 1243-1254(2021).

[7] Tajbakhsh N, Shin J Y, Gurudu S R et al. Convolutional neural networks for medical image analysis: full training or fine tuning?[J]. IEEE Transactions on Medical Imaging, 35, 1299-1312(2016).

[8] Wu L Y, Xin Y, Li S L et al. Cascaded fully convolutional networks for automatic prenatal ultrasound image segmentation[C], 663-666(2017).

[9] Krishnan R, Rajpurkar P, Topol E J. Self-supervised learning in medicine and healthcare[J]. Nature Biomedical Engineering, 6, 1346-1352(2022).

[10] Tang Y C, Yang D, Li W Q et al. Self-supervised pre-training of swin transformers for 3D medical image analysis[C], 20698-20708(2022).

[11] Goncharov M, Soboleva V, Kurmukov A, Greenspan H, Madabhushi A, Mousavi P et al. Vox2vec: a framework for self-supervised contrastive learning of voxel-level representations in medical images[M]. Medical image computing and computer-assisted intervention- MICCAI 2023.Lecture notes in computer science, 14220, 605-614(2023).

[12] You C Y, Zhou Y, Zhao R H et al. SimCVD: simple contrastive voxel-wise representation distillation for semi-supervised medical image segmentation[J]. IEEE Transactions on Medical Imaging, 41, 2228-2237(2022).

[13] Devlin J, Chang M W, Lee K et al. BERT: pre-training of deep bidirectional transformers for language understanding[C], 4171-4186(2019).

[14] He K M, Chen X L, Xie S N et al. Masked autoencoders are scalable vision learners[C], 15979-15988(2022).

[15] Zhou L, Liu H D, Bae J et al. Self pre-training with masked autoencoders for medical image classification and segmentation[C](2023).

[16] Feichtenhofer C, Fan H Q, He Y L K. Masked autoencoders as spatiotemporal learners[C], 35946-35958(2022).

[17] Zhou Z X, Liu X J. Masked autoencoders in computer vision: a comprehensive survey[J]. IEEE Access, 11, 113560-113579(2023).

[18] Vincent P, Larochelle H, Bengio Y et al. Extracting and composing robust features with denoising autoencoders[C], 1096-1103(2008).

[19] Brempong E A, Kornblith S, Chen T et al. Decoder denoising pretraining for semantic segmentation[EB/OL]. https://arxiv.org/abs/2205.11423

[20] Brempong E A, Kornblith S, Chen T et al. Denoising pretraining for semantic segmentation[C], 4174-4185(2022).

[21] Baranchuk D, Rubachev I, Voynov A et al. Label-efficient semantic segmentation with diffusion models[EB/OL]. http://arxiv.org/abs/2112.03126v3

[22] Xiang W L, Yang H Y, Huang D et al. Denoising diffusion autoencoders are unified self-supervised learners[C], 15756-15766(2023).

[23] Yang X Y, Wang X C. Diffusion model as representation learner[C], 18892-18903(2023).

[24] Rousseau J, Alaka C, Covili E, Mukhopadhyay A, Oksuz I, Engelhardt S et al. Pre-training with diffusion models for dental radiography segmentation[M]. Deep generative models.Lecture notes in computer science, 14533, 174-182(2024).

[25] Purma V, Srinath S, Srirangarajan S et al. GenSelfDiff-HIS: generative self-supervision using diffusion for histopathological image segmentation[EB/OL]. https://arxiv.org/abs/2309.01487

[26] Hao W Y, Cai H Y, Zuo T T et al. Intravascular ultrasound image segmentation fusing transformer branch and topology enforcement[J]. Laser & Optoelectronics Progress, 61, 1237008(2024).

[27] Ho J, Jain A, Abbeel P. Denoising diffusion probabilistic models[EB/OL]. http://arxiv.org/abs/2006.11239v2

[28] Wang Z, Bovik A C, Sheikh H R et al. Image quality assessment: from error visibility to structural similarity[J]. IEEE Transactions on Image Processing, 13, 600-612(2004).

[29] Balocco S, Gatta C, Ciompi F et al. Standardized evaluation methodology and reference database for evaluating IVUS image segmentation[J]. Computerized Medical Imaging and Graphics, 38, 70-90(2014).

[30] Reed C J, Yue X Y, Nrusimha A et al. Self-supervised pretraining improves self-supervised pretraining[C], 1050-1060(2022).

Tools

Get Citation

Copy Citation Text

Wenyue Hao, Huaiyu Cai, Tingtao Zuo, Zhongwei Jia, Yi Wang, Xiaodong Chen. Self-Supervised Pre-Training for Intravascular Ultrasound Image Segmentation Method Based on Diffusion Model[J]. Laser & Optoelectronics Progress, 2024, 61(18): 1837005

Download Citation

EndNote(RIS)BibTex Plain Text

Set citation alerts for article

Save article for my favorites

Paper Information

Category: Digital Image Processing

Received: Dec. 28, 2023

Accepted: Feb. 5, 2024

Published Online: Sep. 14, 2024

The Author Email: Huaiyu Cai (hycai@tju.edu.cn)

DOI:10.3788/LOP232774

CSTR:32186.14.LOP232774

Topics

laser devices and laser physics

Lasers and Laser Optics

Laser physics

laser manufacturing

Instrumentation, Measurement and Metrology