Laser & Optoelectronics Progress, Volume. 60, Issue 14, 1412004(2023)

Channel-Wise Attention Mechanism Relevant UNet-Based Diffraction-Limited Fluorescence Spot Detection and Localization

Yongjian Yu1, Yue Wang2、*, Huan Li2, Wenchao Zhou2, Fengfeng Shu2, Ming Gao2,3, and Yihui Wu1,2、**
Author Affiliations
  • 1School of Ophthalmology & Optometry, Wenzhou Medical University, Wenzhou 325035, Zhejiang, China
  • 2Key Laboratory of Optical System Advanced Manufacturing Technology, Changchun Institute of Optics, Fine Mechanics and Physics, Chinese Academy of Sciences, Changchun 130033, Jilin, China
  • 3University of Chinese Academy of Sciences, Beijing 100049, China
  • show less
    References(41)

    [1] Zhang Y D, Schroeder L K, Lessard M D et al. Nanoscale subcellular architecture revealed by multicolor three-dimensional salvaged fluorescence imaging[J]. Nature Methods, 17, 225-231(2020).

    [2] Chen J, Dalal R V, Petrov A N et al. High-throughput platform for real-time monitoring of biological processes by multicolor single-molecule fluorescence[J]. Proceedings of the National Academy of Sciences of the United States of America, 111, 664-669(2014).

    [3] Kwon S. Single-molecule fluorescence in situ hybridization: quantitative imaging of single RNA molecules[J]. BMB Reports, 46, 65-72(2013).

    [4] Smal I, Loog M, Niessen W et al. Quantitative comparison of spot detection methods in fluorescence microscopy[J]. IEEE Transactions on Medical Imaging, 29, 282-301(2010).

    [5] Sage D, Neumann F R, Hediger F et al. Automatic tracking of individual fluorescence particles: application to the study of chromosome dynamics[J]. IEEE Transactions on Image Processing, 14, 1372-1383(2005).

    [6] Smal I, Niessen W, Meijering E. A new detection scheme for multiple object tracking in fluorescence microscopy by joint probabilistic data association filtering[C], 264-267(2008).

    [7] Basset A, Boulanger J, Salamero J et al. Adaptive spot detection with optimal scale selection in fluorescence microscopy images[J]. IEEE Transactions on Image Processing, 24, 4512-4527(2015).

    [8] Ruusuvuori P, Manninen T, Huttunen H. Image segmentation using sparse logistic regression with spatial prior[C], 2253-2257(2012).

    [9] Spilger R, Lee J Y, Chagin V O et al. Deep probabilistic tracking of particles in fluorescence microscopy images[J]. Medical Image Analysis, 72, 102128(2021).

    [10] Peng Y Y, Chen Z Y, Zhu W F et al. ADS-Net: attention-awareness and deep supervision based network for automatic detection of retinopathy of prematurity[J]. Biomedical Optics Express, 13, 4087-4101(2022).

    [11] O’Connor T, Anand A, Andemariam B et al. Deep learning-based cell identification and disease diagnosis using spatio-temporal cellular dynamics in compact digital holographic microscopy[J]. Biomedical Optics Express, 11, 4491-4508(2020).

    [12] Lin J P, Haberstroh F, Karsch S et al. Applications of object detection networks in high-power laser systems and experiments[J]. High Power Laser Science and Engineering, 11, e7(2023).

    [13] Gao H, Yan X D, Zhang H et al. Multi-scale sea-land segmentation method for remote sensing images based on Res2Net[J]. Acta Optica Sinica, 42, 1828004(2022).

    [14] Yuan Y, Chen M H, Ke S T et al. Fundus image classification research based on ensemble convolutional neural network and vision transformer[J]. Chinese Journal of Lasers, 49, 2007205(2022).

    [15] Lin T Y, Dollár P, Girshick R et al. Feature pyramid networks for object detection[C], 936-944(2017).

    [16] Ronneberger O, Fischer P, Brox T. U-Net: convolutional networks for biomedical image segmentation[M]. Navab N, Hornegger J, Wells W M, et al. Medical image computing and computer-assisted intervention-MICCAI 2015. Lecture notes in computer science, 9351, 234-241(2015).

    [17] Danial J S H, Shalaby R, Cosentino K et al. DeepSinse: deep learning-based detection of single molecules[J]. Bioinformatics, 37, 3998-4000(2021).

    [18] Newby J M, Schaefer A M, Lee P T et al. Convolutional neural networks automate detection for tracking of submicron-scale particles in 2D and 3D[J]. Proceedings of the National Academy of Sciences of the United States of America, 115, 9026-9031(2018).

    [19] Zakrzewski F, de Back W, Weigert M et al. Automated detection of the HER2 gene amplification status in Fluorescence in situ hybridization images for the diagnostics of cancer tissues[J]. Scientific Reports, 9, 8231(2019).

    [20] Wollmann T, Rohr K. Deep Consensus Network: aggregating predictions to improve object detection in microscopy images[J]. Medical Image Analysis, 70, 102019(2021).

    [21] Spilger R, Chagin V O, Bold C S et al. Deep neural network for 3D particle detection in 3D fluorescence microscopy images via density map regression[C](2022).

    [22] Speiser A, Müller L R, Hoess P et al. Deep learning enables fast and dense single-molecule localization with high accuracy[J]. Nature Methods, 18, 1082-1090(2021).

    [23] Okumura N, Yamada S, Nishikawa T et al. U-net convolutional neural network for segmenting the corneal endothelium in a mouse model of fuchs endothelial corneal dystrophy[J]. Cornea, 41, 901-907(2022).

    [24] Gudla P R, Nakayama K, Pegoraro G et al. SpotLearn: convolutional neural network for detection of fluorescence in situ hybridization (FISH) signals in high-throughput imaging approaches[J]. Cold Spring Harbor Symposia on Quantitative Biology, 82, 57-70(2017).

    [25] Wollmann T, Ritter C, Dohrke J N et al. Detnet: deep neural network for particle detection in fluorescence microscopy images[C], 517-520(2019).

    [26] Bouilhol E, Savulescu A F, Lefevre E et al. DeepSpot: a deep neural network for RNA spot enhancement in single-molecule fluorescence in situ hybridization microscopy images[J]. Biological Imaging, 2, e4(2022).

    [27] Eichenberger B T, Zhan Y X, Rempfler M et al. deepBlink: threshold-independent detection and localization of diffraction-limited spots[J]. Nucleic Acids Research, 49, 7292-7297(2021).

    [28] Li B N, Gao J C, Chen S P et al. POI detection of high-rise buildings using remote sensing images: a semantic segmentation method based on multitask attention res-U-net[J]. IEEE Transactions on Geoscience and Remote Sensing, 60, 1-16(2022).

    [29] Wang J K, Zhang X Y, Lü P Q et al. Automatic liver segmentation using EfficientNet and attention-based residual U-net in CT[J]. Journal of Digital Imaging, 35, 1479-1493(2022).

    [30] Ashkani Chenarlogh V, Shabanzadeh A, Ghelich Oghli M et al. Clinical target segmentation using a novel deep neural network: double attention Res-U-Net[J]. Scientific Reports, 12, 4706916(2022).

    [31] He K M, Zhang X Y, Ren S Q et al. Deep residual learning for image recognition[C], 770-778(2016).

    [32] Liang S W, Huang Z Z, Liang M F et al. Instance enhancement batch normalization: an adaptive regulator of batch noise[J]. Proceedings of the AAAI Conference on Artificial Intelligence, 34, 4819-4827(2020).

    [33] Imbert A, Ouyang W, Safieddine A et al. FISH-quant v2: a scalable and modular tool for smFISH image analysis[J]. RNA, 28, 786-795(2022).

    [34] Mateju D, Eichenberger B, Voigt F et al. Single-molecule imaging reveals translation of mRNAs localized to stress granules[J]. Cell, 183, 1801-1812(2020).

    [35] Chenouard N, Smal I, de Chaumont F et al. Objective comparison of particle tracking methods[J]. Nature Methods, 11, 281-289(2014).

    [36] Ioffe S, Szegedy C. Batch normalization: accelerating deep network training by reducing internal covariate shift[C], 448-456(2015).

    [37] Tajbakhsh N, Shin J Y, Gurudu S R et al. Convolutional neural networks for medical image analysis: full training or fine tuning?[J]. IEEE Transactions on Medical Imaging, 35, 1299-1312(2016).

    [38] Cremer M, Grasser F, Lanctôt C et al. Multicolor 3D fluorescence in situ hybridization for imaging interphase chromosomes[J]. Methods in Molecular Biology, 463, 205-239(2008).

    [39] Solovei I, Cavallo A, Schermelleh L et al. Spatial preservation of nuclear chromatin architecture during three-dimensional fluorescence in situ hybridization (3D-FISH)[J]. Experimental Cell Research, 276, 10-23(2002).

    [40] Liu S L, Wang Z G, Xie H Y et al. Single-virus tracking: from imaging methodologies to virological applications[J]. Chemical Reviews, 120, 1936-1979(2020).

    [41] Lelek M, Gyparaki M T, Beliu G et al. Single molecule localization microscopy[J]. Nature Reviews Methods Primers, 1, 39(2021).

    Tools

    Get Citation

    Copy Citation Text

    Yongjian Yu, Yue Wang, Huan Li, Wenchao Zhou, Fengfeng Shu, Ming Gao, Yihui Wu. Channel-Wise Attention Mechanism Relevant UNet-Based Diffraction-Limited Fluorescence Spot Detection and Localization[J]. Laser & Optoelectronics Progress, 2023, 60(14): 1412004

    Download Citation

    EndNote(RIS)BibTexPlain Text
    Save article for my favorites
    Paper Information

    Category: Instrumentation, Measurement and Metrology

    Received: Feb. 27, 2023

    Accepted: Apr. 17, 2023

    Published Online: Jul. 14, 2023

    The Author Email: Wang Yue (yihuiwu@ciomp.ac.cn), Wu Yihui (wangyue@ciomp.ac.cn)

    DOI:10.3788/LOP230718

    Topics