Journals Articles Conferences News About CLP
Submit a paper Email Alert
Search
Search
Articles
Journals
News
Advanced Search
Top Searches
2D MaterialsTransformation opticsQuantum PhotonicsSmall lasersSemiconductor UV PhotonicsSupersymmetric microring laser arrays

Acta Optica Sinica (Online), Volume. 2, Issue 17, 1711001(2025)

Structured Illumination Super-Resolution Microscopy Driven by Deep Learning (Invited)

Xinyi Huang1, Yunhua Yao1、**, Bozhang Cheng1, Yu He1, Mengdi Guo1, Juntong Cao1, Dalong Qi1, Yuecheng Shen1, Lianzhong Deng1, Hongmei Ma1, Zhenrong Sun1, and Shian Zhang1,2,3、*
Author Affiliations
  • 1State Key Laboratory of Precision Spectroscopy, School of Physics and Electronic Science, East China Normal University, Shanghai 200241, China
  • 2Collaborative Innovation Center of Extreme Optics, Shanxi University, Taiyuan 030006, Shanxi , China
  • 3Joint Research Center of Light Manipulation Science and Photonic Integrated Chip of East China Normal University and Shandong Normal University, Shanghai 200241, China
    • show less
    AbstractGet PDF(in Chinese)
    Figures&Tables (6)
    Equations (0)
    References (88)
    Tools
    Paper Information
    Topics
    References(88)

    [1] Pawley J[M]. Handbook of biological confocal microscopy(2006).

    [2] Lancaster C. A focus on the history of light microscopy for cell culture[J]. Kaleidoscope, 6, 24-47(2014).

    [3] Mertz J[M]. Introduction to optical microscopy(2019).

    [4] Oheim M. Advances and challenges in high-throughput microscopy for live-cell subcellular imaging[J]. Expert Opinion on Drug Discovery, 6, 1299-1315(2011).

    [5] Zhu Y, Akkaya K C, Ruta J et al. Cross-link assisted spatial proteomics to map sub-organelle proteomes and membrane protein topologies[J]. Nature Communications, 15, 3290(2024).

    [6] Sheppard C J R. The development of microscopy for super-resolution: confocal microscopy, and image scanning microscopy[J]. Applied Sciences, 11, 8981(2021).

    [7] Ruska E. The development of the electron microscope and of electron microscopy[J]. Bioscience Reports, 7, 607-629(1987).

    [8] Oikonomou C M, Jensen G J. Cellular electron cryotomography: toward structural biology in situ[J]. Annual Review of Biochemistry, 86, 873-896(2017).

    [9] Ross F M. Opportunities and challenges in liquid cell electron microscopy[J]. Science, 350, aaa9886(2015).

    [10] Hell S W, Wichmann J. Breaking the diffraction resolution limit by stimulated emission: stimulated-emission-depletion fluorescence microscopy[J]. Optics Letters, 19, 780-782(1994).

    [11] Vicidomini G, Bianchini P, Diaspro A. STED super-resolved microscopy[J]. Nature Methods, 15, 173-182(2018).

    [12] Wang J L, Yan W, Zhang J et al. New advances in the research of stimulated emission depletion super-resolution microscopy[J]. Acta Physica Sinica, 69, 108702(2020).

    [13] Hess S T, Girirajan T P K, Mason M D. Ultra-high resolution imaging by fluorescence photoactivation localization microscopy[J]. Biophysical Journal, 91, 4258-4272(2006).

    [14] Rust M J, Bates M, Zhuang X W. Sub-diffraction-limit imaging by stochastic optical reconstruction microscopy (STORM)[J]. Nature Methods, 3, 793-796(2006).

    [15] Xu J Q, Ma H Q, Liu Y. Stochastic optical reconstruction microscopy (STORM)[J]. Current Protocols in Cytometry, 81, 1-7(2017).

    [16] Gustafsson M G. Surpassing the lateral resolution limit by a factor of two using structured illumination microscopy[J]. Journal of Microscopy, 198, 82-87(2000).

    [17] Shao L, Kner P, Rego E H et al. Super-resolution 3D microscopy of live whole cells using structured illumination[J]. Nature Methods, 8, 1044-1046(2011).

    [18] Samanta K, Joseph J. An overview of structured illumination microscopy: recent advances and perspectives[J]. Journal of Optics, 23, 123002(2021).

    [19] Guo Y T, Li D, Zhang S W et al. Visualizing intracellular organelle and cytoskeletal interactions at nanoscale resolution on millisecond timescales[J]. Cell, 175, 1430-1442(2018).

    [20] Li D, Shao L, Chen B C et al. Extended-resolution structured illumination imaging of endocytic and cytoskeletal dynamics[J]. Science, 349, aab3500(2015).

    [21] Xu J Q, Sun X J, Chen Z G et al. Super-resolution imaging of T lymphocyte activation reveals chromatin decondensation and disrupted nuclear envelope[J]. Communications Biology, 7, 717(2024).

    [22] Ströhl F, Kaminski C F. Frontiers in structured illumination microscopy[J]. Optica, 3, 667-677(2016).

    [23] Schaefer L H, Schuster D, Schaffer J. Structured illumination microscopy: artefact analysis and reduction utilizing a parameter optimization approach[J]. Journal of Microscopy, 216, 165-174(2004).

    [24] Deng L, Liu Y[M]. Deep learning in natural language processing(2018).

    [25] Otter D W, Medina J R, Kalita J K. A survey of the usages of deep learning for natural language processing[J]. IEEE Transactions on Neural Networks and Learning Systems, 32, 604-624(2021).

    [26] Voulodimos A, Doulamis N, Doulamis A et al. Deep learning for computer vision: a brief review[J]. Computational Intelligence and Neuroscience, 2018, 7068349(2018).

    [27] Chai J Y, Zeng H, Li A M et al. Deep learning in computer vision: a critical review of emerging techniques and application scenarios[J]. Machine Learning with Applications, 6, 100134(2021).

    [28] Grigorescu S, Trasnea B, Cocias T et al. A survey of deep learning techniques for autonomous driving[J]. Journal of Field Robotics, 37, 362-386(2020).

    [29] Muhammad K, Ullah A, Lloret J et al. Deep learning for safe autonomous driving: current challenges and future directions[J]. IEEE Transactions on Intelligent Transportation Systems, 22, 4316-4336(2021).

    [30] Ker J, Wang L P, Rao J et al. Deep learning applications in medical image analysis[J]. IEEE Access, 6, 9375-9389(2017).

    [31] Litjens G, Kooi T, Bejnordi B E et al. A survey on deep learning in medical image analysis[J]. Medical Image Analysis, 42, 60-88(2017).

    [32] Wang G, Ye J C, De Man B. Deep learning for tomographic image reconstruction[J]. Nature Machine Intelligence, 2, 737-748(2020).

    [33] Koetzier L R, Mastrodicasa D, Szczykutowicz T P et al. Deep learning image reconstruction for CT: technical principles and clinical prospects[J]. Radiology, 306, e221257(2023).

    [34] Kim K, Ye J C. Noise2score: tweedie’s approach to self-supervised image denoising without clean images[EB/OL]. https://arxiv.org/abs/2106.07009

    [35] Tian C W, Fei L K, Zheng W X et al. Deep learning on image denoising: an overview[J]. Neural Networks, 131, 251-275(2020).

    [36] Chen Z L, Pawar K, Ekanayake M et al. Deep learning for image enhancement and correction in magnetic resonance imaging: state-of-the-art and challenges[J]. Journal of Digital Imaging, 36, 204-230(2023).

    [37] Kaur A, Kaur G. A review on image enhancement with deep learning approach[J]. ACCENTS Transactions on Image Processing and Computer Vision, 4, 16-20(2018).

    [38] Lu Q S, Jin L H, Xu Y K. Progress on applications of deep learning in super-resolution microscopy imaging[J]. Laser & Optoelectronics Progress, 58, 2400007(2021).

    [39] Lu X Y, Huang Y, Zhang Z T et al. Advances in deep learning for super-resolution microscopy (invited)[J]. Laser & Optoelectronics Progress, 61, 1611002(2024).

    [40] Li X R, Chen J J, Wang M T et al. Advancement in structured illumination microscopy based on deep learning[J]. Chinese Journal of Lasers, 51, 2107103(2024).

    [41] Heintzmann R, Huser T. Super-resolution structured illumination microscopy[J]. Chemical Reviews, 117, 13890-13908(2017).

    [42] Chen X, Zhong S Y, Hou Y W et al. Superresolution structured illumination microscopy reconstruction algorithms: a review[J]. Light: Science & Applications, 12, 172(2023).

    [43] Saxena M, Eluru G, Gorthi S S. Structured illumination microscopy[J]. Advances in Optics and Photonics, 7, 241-275(2015).

    [44] Jin L H, Liu B, Zhao F Q et al. Deep learning enables structured illumination microscopy with low light levels and enhanced speed[J]. Nature Communications, 11, 1934(2020).

    [45] Ronneberger O, Fischer P, Brox T. U-Net: convolutional networks for biomedical image segmentation[M]. Medical image computing and computer-assisted intervention-MICCAI 2015, 9351, 234-241(2015).

    [46] Wagner F H, Sanchez A, Tarabalka Y et al. Using the U-Net convolutional network to map forest types and disturbance in the Atlantic rainforest with very high resolution images[J]. Remote Sensing in Ecology and Conservation, 5, 360-375(2019).

    [47] Qiao C, Li D, Guo Y T et al. Evaluation and development of deep neural networks for image super-resolution in optical microscopy[J]. Nature Methods, 18, 194-202(2021).

    [48] Wang J Y, Fan J C, Zhou B et al. Hybrid reconstruction of the physical model with the deep learning that improves structured illumination microscopy[J]. Advanced Photonics Nexus, 2, 016012(2023).

    [49] Chen X Y, Qiao C, Jiang T et al. Self-supervised denoising for multimodal structured illumination microscopy enables long-term super-resolution live-cell imaging[J]. PhotoniX, 5, 4(2024).

    [50] Roth J, Mehl J, Rohrbach A. Fast TIRF-SIM imaging of dynamic, low-fluorescent biological samples[J]. Biomedical Optics Express, 11, 4008-4026(2020).

    [51] Ortkrass H, Wiebusch G, Linnenbrügger J et al. Grazing incidence to total internal reflection fluorescence structured illumination microscopy enabled by a prism telescope[J]. Optics Express, 31, 40210-40220(2023).

    [52] Schermelleh L, Carlton P M, Haase S et al. Subdiffraction multicolor imaging of the nuclear periphery with 3D structured illumination microscopy[J]. Science, 320, 1332-1336(2008).

    [53] Chang B J, Tang W C, Liu Y T et al. Two-beam interference lattice lightsheet for structured illumination microscopy[J]. Journal of Physics D, 53, 044005(2020).

    [54] Gustafsson M G L. Nonlinear structured-illumination microscopy: wide-field fluorescence imaging with theoretically unlimited resolution[J]. Proceedings of the National Academy of Sciences of the United States of America, 102, 13081-13086(2005).

    [55] Ling C, Zhang C L, Wang M Q et al. Fast structured illumination microscopy via deep learning[J]. Photonics Research, 8, 1350-1359(2020).

    [56] Cheng X, Li J, Dai Q et al. Fast and lightweight network for single frame structured illumination microscopy super-resolution[J]. IEEE Transactions on Instrumentation and Measurement, 71, 5007711(2022).

    [57] Wu H M, Li Y M, Sun Y L et al. Single-frame structured illumination microscopy for fast live-cell imaging[J]. APL Photonics, 9, 036102(2024).

    [58] Qian J M, Wang C Y, Wu H J et al. Ensemble deep learning-enabled single-shot composite structured illumination microscopy (eDL-cSIM)[J]. PhotoniX, 6, 13(2025).

    [59] Huang Z Q, Yao Y H, He Y L et al. Faster structured illumination microscopy using complementary encoding-based compressive imaging[J]. Photonics Research, 12, 740-749(2024).

    [60] Huang Z Q. Coded aperture compressive structured illumination super-resolution microscopy[D](2025).

    [61] He Y L, Yao Y H, Qi D L et al. High-speed super-resolution imaging with compressive imaging-based structured illumination microscopy[J]. Optics Express, 30, 14287-14299(2022).

    [62] He Y L. High-speed super-resolution microscopy based on compressed sensing[D](2023).

    [63] Cheng B Z, Yao Y H, He Y L et al. Research on differential compressed imaging-based structured illumination super-resolution microscopy technique (invited)[J]. Laser & Optoelectronics Progress, 61, 2011003(2024).

    [64] Lal A, Shan C Y, Xi P. Structured illumination microscopy image reconstruction algorithm[J]. IEEE Journal of Selected Topics in Quantum Electronics, 22, 6803414(2016).

    [65] Müller M, Mönkemöller V, Hennig S et al. Open-source image reconstruction of super-resolution structured illumination microscopy data in ImageJ[J]. Nature Communications, 7, 10980(2016).

    [66] Christensen C N, Ward E N, Lu M et al. ML-SIM: universal reconstruction of structured illumination microscopy images using transfer learning[J]. Biomedical Optics Express, 12, 2720-2733(2021).

    [67] Ye H C, Ye Z T, Chen Y B et al. Video-level and high-fidelity super-resolution SIM reconstruction enabled by deep learning[J]. Advanced Imaging, 1, 011001(2024).

    [68] Rego E H, Shao L, Macklin J J et al. Nonlinear structured-illumination microscopy with a photoswitchable protein reveals cellular structures at 50-nm resolution[J]. Proceedings of the National Academy of Sciences of the United States of America, 109, E135-E143(2012).

    [69] Boland M A, Cohen E A K, Flaxman S R et al. Improving axial resolution in structured illumination microscopy using deep learning[J]. Philosophical Transactions of the Royal Society A, 379, 20200298(2021).

    [70] He Y, Yao Y H, He Y L et al. Surpassing the resolution limitation of structured illumination microscopy by an untrained neural network[J]. Biomedical Optics Express, 14, 106-117(2022).

    [71] He Y, Yao Y H, He Y L et al. Untrained neural network enhances the resolution of structured illumination microscopy under strong background and noise levels[J]. Advanced Photonics Nexus, 2, 046005(2023).

    [72] Qiao C, Zeng Y M, Meng Q et al. Zero-shot learning enables instant denoising and super-resolution in optical fluorescence microscopy[J]. Nature Communications, 15, 4180(2024).

    [73] Zheng Y, Chen J J, Wu C X et al. Adaptive optics for structured illumination microscopy based on deep learning[J]. Cytometry: Part A, 99, 622-631(2021).

    [74] Hu Q, Hailstone M, Wang J Y et al. Universal adaptive optics for microscopy through embedded neural network control[J]. Light: Science & Applications, 12, 270(2023).

    [75] Huang Z Q, Yao Y H, He Y L et al. Spectral compressive structured illumination microscopy[J]. Optics and Lasers in Engineering, 190, 108985(2025).

    [76] He Y C, Xu W Z, Zhi Y et al. Rapid bacteria identification using structured illumination microscopy and machine learning[J]. Journal of Innovative Optical Health Sciences, 11, 1850007(2018).

    [77] Laine R F, Goodfellow G, Young L J et al. Structured illumination microscopy combined with machine learning enables the high throughput analysis and classification of virus structure[J]. eLife, 7, e40183(2018).

    [78] Touizer E, Sieben C, Henriques R et al. Application of super-resolution and advanced quantitative microscopy to the spatio-temporal analysis of influenza virus replication[J]. Viruses, 13, 233(2021).

    [79] Liu S Y, Thung K H, Lin W L et al. Real-time quality assessment of pediatric MRI via semi-supervised deep nonlocal residual neural networks[J]. IEEE Transactions on Image Processing, 29, 7697-7706(2020).

    [80] Zhou Y, Jin Z Y, Zhao Q H et al. Aberration modeling in deep learning for volumetric reconstruction of light-field microscopy[J]. Laser & Photonics Reviews, 17, 2300154(2023).

    [81] Gu S H, Guo S, Zuo W M et al. Learned dynamic guidance for depth image reconstruction[J]. IEEE Transactions on Pattern Analysis and Machine Intelligence, 42, 2437-2452(2019).

    [82] Mannam V, Zhang Y D, Yuan X T et al. Machine learning for faster and smarter fluorescence lifetime imaging microscopy[J]. Journal of Physics: Photonics, 2, 042005(2020).

    [83] Nguyen T D, Chen Y I, Chen L H et al. Recent advances in single-molecule tracking and imaging techniques[J]. Annual Review of Analytical Chemistry, 16, 253-284(2023).

    [84] Ward E N, Hecker L, Christensen C N et al. Machine learning assisted interferometric structured illumination microscopy for dynamic biological imaging[J]. Nature Communications, 13, 7836(2022).

    [85] Lu M, Hui E, Brockhoff M et al. Graphene microelectrode arrays, 4D structured illumination microscopy, and a machine learning spike sorting algorithm permit the analysis of ultrastructural neuronal changes during neuronal signaling in a model of Niemann-pick disease type C[J]. Advanced Science, 11, e2402967(2024).

    [86] Panayides A S, Amini A, Filipovic N D et al. AI in medical imaging informatics: current challenges and future directions[J]. IEEE Journal of Biomedical and Health Informatics, 24, 1837-1857(2020).

    [87] Wen B, Zeng W F, Liao Y X et al. Deep learning in proteomics[J]. Proteomics, 20, 1900335(2020).

    [88] Zhang H, Zhu Y Q, Jin L H et al. Recent advances in structured illumination microscopy: from fundamental principles to AI-enhanced imaging[J]. Small Methods, 9, e2401616(2025).

    Tools

    Get Citation

    Copy Citation Text

    Xinyi Huang, Yunhua Yao, Bozhang Cheng, Yu He, Mengdi Guo, Juntong Cao, Dalong Qi, Yuecheng Shen, Lianzhong Deng, Hongmei Ma, Zhenrong Sun, Shian Zhang. Structured Illumination Super-Resolution Microscopy Driven by Deep Learning (Invited)[J]. Acta Optica Sinica (Online), 2025, 2(17): 1711001

    Download Citation

    EndNote(RIS)BibTexPlain Text
    Set citation alerts for article
    Save article for my favorites
    Paper Information

    Category: Computational Optics

    Received: Jun. 28, 2025

    Accepted: Jul. 16, 2025

    Published Online: Sep. 3, 2025

    The Author Email: Yunhua Yao (yhyao@lps.ecnu.edu.cn), Shian Zhang (sazhang@phy.ecnu.edu.cn)

    DOI:10.3788/AOSOL250486

    CSTR:32394.14.AOSOL250486

    Topics

    laser devices and laser physics
    Lasers and Laser Optics
    Laser physics
    laser manufacturing
    Instrumentation, Measurement and Metrology