Journal of Innovative Optical Health Sciences, Volume. 15, Issue 2, 2250009(2022)

Computer-aided diagnosis of retinopathy based on vision transformer

[in Chinese]1, [in Chinese]1, [in Chinese]1, [in Chinese]2, [in Chinese]2, [in Chinese]1、*, and [in Chinese]1
Author Affiliations
  • 1Shanghai Institute of Technology, 100 Haiquan Road, Shanghai 201418, China
  • 2School of Ophthalmology and Optometry, Wenzhou Medical University, Xueyuan Road 270, Wenzhou, Zhejiang 325027, China
  • show less
    References(35)

    [1] [1] J. Z. Nowak, "Age-related macular degeneration (AMD): Pathogenesis and therapy," Pharmacol. Rep. 58(3), 353 (2006).

    [2] [2] K. L. Pennington, M. M. DeAngelis, "Epidemiology of age-related macular degeneration (AMD): Associations with cardiovascular disease phenotypes and lipid factors," Eye Vis. 3(1), 1–20 (2016).

    [3] [3] K. Kaarniranta, A. Salminen, A. Haapasalo et al., "Age-related macular degeneration (AMD): Alzheimer's disease in the eye?" J. Alzheimer's Dis. 24(4), 615–631 (2011).

    [4] [4] N. Bhagat, R. A. Grigorian, A. Tutela et al., "Diabetic macular edema: Pathogenesis and treatment," Surv. Ophthalmol. 54(1), 1–32 (2009).

    [5] [5] J. Ding, T. Y. Wong, "Current epidemiology of diabetic retinopathy and diabetic macular edema," Curr. Diabetes Rep. 12(4), 346–354 (2012).

    [6] [6] Y. Lin et al., "A measurement of epidermal thickness of fingertip skin from OCT images using convolutional neural network," J. Innov. Opt. Health Sci. 14(1), 2140005 (2021).

    [7] [7] H. Li et al., "ID-OCTA: OCT angiography based on inverse SNR and decorrelation features," J. Innov. Opt. Health Sci. 14(1), 2130001 (2021).

    [8] [8] Y. Yu et al., "Monitoring of edema progression in permanent and transient MCAO model using SS-OCT," J. Innov. Opt. Health Sci. 14(1), 2140006 (2021).

    [9] [9] N. Qin et al., "Research on optical properties of cardiovascular tissues based on OCT data," J. Innov. Opt. Health Sci. 14(1), 2140007 (2021).

    [10] [10] F. Du, L. Gao, L. Li et al., "In vivo evaluation of laser-induced choroidal neovascularization in rats simultaneously using optical coherence tomography and photoacoustic microscopy," J. Innov. Opt. Health Sci. 14(3), 2140012 (2021).

    [11] [11] M. R. Ibrahim, K. M. Fathalla, S. M. Youssef, "HyCAD-OCT: A hybrid computer-aided diagnosis of retinopathy by optical coherence tomography integrating machine learning and feature maps localization," Appl. Sci. 10(14), 4716 (2020).

    [12] [12] D. S. Kermany, M. Goldbaum, W. Cai et al., "Identifying medical diagnoses and treatable diseases by image-based deep learning," Cell 172(5), 1122–1131 (2018).

    [13] [13] F. Y. Shih, H. Patel, "Deep learning classification on optical coherence tomography retina images," Int. J. Pattern Recognit. Artif. Intell. 34(8), 2052002 (2020).

    [14] [14] Q. Zhang, Z. Liu, J. Li et al., "Identifying diabetic macular edema and other retinal diseases by optical coherence tomography image and multiscale deep learning," Diabetes Metab. Syndr. Obes. Targets Ther. 13, 4787 (2020).

    [15] [15] C. L. Saratxaga, J. Bote, J. F. Ortega-Moran et al., "Characterization of optical coherence tomography images for colon lesion differentiation under deep learning," Appl. Sci. 11(7), 3119 (2021).

    [16] [16] Y. Luo, X. Wang, X. Yu et al., "Imaging sebaceous gland using optical coherence tomography with deep learning assisted automatic identification," J. Biophoton. 14(6), e202100015 (2021).

    [17] [17] I. Potapenko, M. Kristensen, B. Thiesson et al., "Detection of oedema on optical coherence tomography images using deep learning model trained on noisy clinical data," Acta Ophthalmol. (2021).

    [18] [18] A. Dosovitskiy, L. Beyer, A. Kolesnikov et al., "An image is worth 16x16 words: Transformers for image recognition at scale," arXiv:2010.11929 (2020).

    [19] [19] Y. Bazi, L. Bashmal, M. M. A. Rahhal et al., "Vision transformers for remote sensing image classification," Remote Sens. 13(3), 516 (2021).

    [20] [20] P. P. Srinivasan, L. A. Kim, P. S. Mettu et al., "Fully automated detection of diabetic macular edema and dry age-related macular degeneration from optical coherence tomography images," Biomed. Opt. Exp. 5(10), 3568 (2014).

    [21] [21] Z. Jiang et al., "Recognition of rice leaf diseases and wheat leaf diseases based on multi-task deep transfer learning," Comput. Electron. Agric. 186, 106184 (2021).

    [22] [22] J. Zhen-Cun, W. E. N. Xiao-Jing, D. Zheng-Xin et al., "Research on fire detection of improved VGG16 image recognition based on deep learning," Fire Sci. Technol. 40(3), 375 (2021).

    [23] [23] J. Wen-Ping, J. Zhen-Cun, "Research on early fire detection of Yolo V5 based on multiple transfer learning," Fire Sci. Technol. 40(1), 109 (2021).

    [24] [24] Y. Wang, X. Ma, Z. Chen et al., Symmetric cross entropy for robust learning with noisy labels, Proc. IEEE/CVF Int. Conf. Computer Vision, pp. 322–330, Seoul, Korea (2019).

    [25] [25] A. Paszke, S. Gross, F. Massa et al., "Pytorch: An imperative style, high-performance deep learning library," arXiv:1912.01703 (2019).

    [26] [26] K. Simonyan, A. Zisserman, "Very deep convolutional networks for large-scale image recognition" arXiv:1409.1556 (2014).

    [27] [27] K. He, X. Zhang, S. Ren et al., Deep residual learning for image recognition, Proc. IEEE Conf. Computer Vision and Pattern Recognition, pp. 770–778, Las Vegas, NV, USA, 2016.

    [28] [28] G. Huang, Z. Liu, L. Van Der Maaten et al., Densely connected convolutional networks, Proc. IEEE Conf. Computer Vision and Pattern Recognition, pp. 4700–4708, Honolulu, HI, USA, 2017.

    [29] [29] M. Tan, Q. Le, E±cientnet: Rethinking model scaling for convolutional neural networks, Int. Conf. Machine Learning, pp. 6105–6114 (PMLR, 2019).

    [30] [30] M. Zhu, K. Han, Y. Tang et al., Visual transformer pruning, arXiv:2104.08500 (2021).

    [31] [31] E. Mousavi, R. Kafieh, H. Rabbani, "Classification of dry age-related macular degeneration and diabetic macular oedema from optical coherence tomography images using dictionary learning," IET Image Process. 14(8), 1571–1579 (2020).

    [32] [32] S. P. K. Karri, D. Chakraborty, J. Chatterjee, "Transfer learning based classification of optical coherence tomography images with diabetic macular edema and dry age-related macular degeneration," Biomed. Opt. Exp. 8(2), 579–592 (2017).

    [33] [33] A. Thomas, P. M. Harikrishnan, R. Ramachandran et al., "A novel multiscale and multipath convolutional neural network based age-related macular degeneration detection using OCT images," Comput. Meth. Prog. Biomed. 209, 106294 (2021).

    [34] [34] Y. Luo, Q. Xu, R. Jin et al., "Automatic detection of retinopathy with optical coherence tomography images via a semi-supervised deep learning method," Biomed. Opt. Exp. 12(5), 2684–2702 (2021).

    [35] [35] Z. Wang, W. Zhang, Y. Sun et al., "Detection of diabetic macular edema in optical coherence tomography image using an improved level set algorithm," BioMed Res. Int. 2020, 6974215 (2020).

    Tools

    Get Citation

    Copy Citation Text

    [in Chinese], [in Chinese], [in Chinese], [in Chinese], [in Chinese], [in Chinese], [in Chinese]. Computer-aided diagnosis of retinopathy based on vision transformer[J]. Journal of Innovative Optical Health Sciences, 2022, 15(2): 2250009

    Download Citation

    EndNote(RIS)BibTexPlain Text
    Save article for my favorites
    Paper Information

    Received: Aug. 10, 2021

    Accepted: Nov. 22, 2021

    Published Online: Feb. 28, 2022

    The Author Email: (jiangwenping@sit.edu.cn)

    DOI:10.1142/s1793545822500092

    Topics