Journals Articles Conferences News About CLP
Submit a paper Email Alert
Search
Search
Articles
Journals
News
Advanced Search
Top Searches
2D MaterialsTransformation opticsQuantum PhotonicsSmall lasersSemiconductor UV PhotonicsSupersymmetric microring laser arrays

Photonics Research, Volume. 13, Issue 3, 743(2025)

High-speed image reconstruction for nonlinear structured illumination microscopy

Jingxiang Zhang1, Tianyu Zhao1, Xiangda Fu1, Manming Shu1, Jiajing Yan1, Mengrui Wang1, Yansheng Liang1, Shaowei Wang1, and Ming Lei1,2、*
Author Affiliations
  • 1MOE Key Laboratory for Nonequilibrium Synthesis and Modulation of Condensed Matter, School of Physics, Xi’an Jiaotong University, Xi’an 710049, China
  • 2State Key Laboratory of Electrical Insulation and Power Equipment, Xi’an Jiaotong University, Xi’an 710049, China
    • show less
    Full TextGet PDF
    Figures&Tables (12)
    Equations (50)
    References (44)
    Tools
    Paper Information
    Topics
    References(44)

    [1] S. J. Sahl, S. W. Hell, S. Jakobs. Fluorescence nanoscopy in cell biology. Nat. Rev. Mol. Cell Biol., 18, 685-701(2017).

    [2] M. G. Gustafsson, L. Shao, P. M. Carlton. Three-dimensional resolution doubling in wide-field fluorescence microscopy by structured illumination. Biophys. J., 94, 4957-4970(2008).

    [3] X. Chen, S. Zhong, Y. Hou. Superresolution structured illumination microscopy reconstruction algorithms: a review. Light Sci. Appl., 12, 172(2023).

    [4] X. Huang, J. Fan, L. Li. Fast, long-term, super-resolution imaging with Hessian structured illumination microscopy. Nat. Biotechnol., 36, 451-459(2018).

    [5] W. Zhao, S. Zhao, L. Li. Sparse deconvolution improves the resolution of live-cell super-resolution fluorescence microscopy. Nat. Biotechnol., 40, 606-617(2022).

    [6] G. Wen, S. Li, L. Wang. High-fidelity structured illumination microscopy by point-spread-function engineering. Light Sci. Appl., 10, 70(2021).

    [7] Y. Wu, H. Shroff. Faster, sharper, and deeper: structured illumination microscopy for biological imaging. Nat. Methods, 15, 1011-1019(2018).

    [8] E. Rittweger, K. Y. Han, S. E. Irvine. STED microscopy reveals crystal colour centres with nanometric resolution. Nat. Photonics, 3, 144-147(2009).

    [9] E. Betzig, G. H. Patterson, R. Sougrat. Imaging intracellular fluorescent proteins at nanometer resolution. Science, 313, 1642-1645(2006).

    [10] M. G. Gustafsson. Nonlinear structured-illumination microscopy: wide-field fluorescence imaging with theoretically unlimited resolution. Proc. Natl. Acad. Sci. USA, 102, 13081-13086(2005).

    [11] R. Heintzmann, T. M. Jovin, C. Cremer. Saturated patterned excitation microscopy—a concept for optical resolution improvement. J. Opt. Soc. Am. A, 19, 1599-1609(2002).

    [12] L. Hirvonen, O. Mandula, K. Wicker. Structured illumination microscopy using photoswitchable fluorescent proteins. Proc. SPIE, 6861(2008).

    [13] E. H. Rego, L. Shao, J. J. Macklin. Nonlinear structured-illumination microscopy with a photoswitchable protein reveals cellular structures at 50-nm resolution. Proc. Natl. Acad. Sci. USA, 109, E135-E143(2012).

    [14] H.-W. Lu-Walther, W. Hou, M. Kielhorn. Nonlinear structured illumination using a fluorescent protein activating at the readout wavelength. PLoS ONE, 11, e0165148(2016).

    [15] M. Hofmann, C. Eggeling, S. Jakobs. Breaking the diffraction barrier in fluorescence microscopy at low light intensities by using reversibly photoswitchable proteins. Proc. Natl. Acad. Sci. USA, 102, 17565-17569(2005).

    [16] D. Li, L. Shao, B.-C. Chen. Extended-resolution structured illumination imaging of endocytic and cytoskeletal dynamics. Science, 349, aab3500(2015).

    [17] Z. Wang, T. Zhao, H. Hao. High-speed image reconstruction for optically sectioned, super-resolution structured illumination microscopy. Adv. Photon., 4, 026003(2022).

    [18] A. Markwirth, M. Lachetta, V. Mönkemöller. Video-rate multi-color structured illumination microscopy with simultaneous real-time reconstruction. Nat. Commun., 10, 4315(2019).

    [19] H. Gong, W. Guo, M. A. Neil. GPU-accelerated real-time reconstruction in Python of three-dimensional datasets from structured illumination microscopy with hexagonal patterns. Philos. Trans. R. Soc. A, 379, 20200162(2021).

    [20] H. Zeng, G. Liu, R. Zhao. SIM reconstruction framework for high-speed multi-dimensional super-resolution imaging. Opt. Express, 30, 10877-10898(2022).

    [21] C. S. Smith, J. A. Slotman, L. Schermelleh. Structured illumination microscopy with noise-controlled image reconstructions. Nat. Methods, 18, 821-828(2021).

    [22] G. Ball, J. Demmerle, R. Kaufmann. SIMcheck: a toolbox for successful super-resolution structured illumination microscopy. Sci. Rep., 5, 15915(2015).

    [23] Z. Wang, T. Zhao, Y. Cai. Rapid, artifact-reduced, image reconstruction for super-resolution structured illumination microscopy. Innovation, 4, 100425(2023).

    [24] J. Demmerle, C. Innocent, A. J. North. Strategic and practical guidelines for successful structured illumination microscopy. Nat. Protoc., 12, 988-1010(2017).

    [25] C. Karras, M. Smedh, R. Förster. Successful optimization of reconstruction parameters in structured illumination microscopy: a practical guide. Opt. Commun., 436, 69-75(2019).

    [26] G. E. Cragg, P. T. So. Lateral resolution enhancement with standing evanescent waves. Opt. Lett., 25, 46-48(2000).

    [27] M. G. Gustafsson. Surpassing the lateral resolution limit by a factor of two using structured illumination microscopy. J. Microsc., 198, 82-87(2000).

    [28] F. Wei, Z. Liu. Plasmonic structured illumination microscopy. Nano Lett., 10, 2531-2536(2010).

    [29] Y. Xue, P. T. So. Three-dimensional super-resolution high-throughput imaging by structured illumination STED microscopy. Opt. Express, 26, 20920-20928(2018).

    [30] K. O’Holleran, M. Shaw. Optimized approaches for optical sectioning and resolution enhancement in 2D structured illumination microscopy. Biomed. Opt. Express, 5, 2580-2590(2014).

    [31] J. Fan, X. Huang, L. Li. A protocol for structured illumination microscopy with minimal reconstruction artifacts. Biophys. Rep., 5, 80-90(2019).

    [32] K. Chu, P. J. McMillan, Z. J. Smith. Image reconstruction for structured-illumination microscopy with low signal level. Opt. Express, 22, 8687-8702(2014).

    [33] M. Guizar-Sicairos, S. T. Thurman, J. R. Fienup. Efficient subpixel image registration algorithms. Opt. Lett., 33, 156-158(2008).

    [34] S. Labouesse. Imagerie à éclairements structurés inconnues(2017).

    [35] R. Cao, Y. Li, X. Chen. Open-3DSIM: an open-source three-dimensional structured illumination microscopy reconstruction platform. Nat. Methods, 20, 1183-1186(2023).

    [36] C. Qiao, D. Li, Y. Guo. Evaluation and development of deep neural networks for image super-resolution in optical microscopy. Nat. Methods, 18, 194-202(2021).

    [37] G. Wen, L. Wang, X. Chen. Frequency–spatial domain joint optimization for improving super-resolution images of nonlinear structured illumination microscopy. Opt. Lett., 46, 5842-5845(2021).

    [38] A. Descloux, K. S. Grußmayer, A. Radenovic. Parameter-free image resolution estimation based on decorrelation analysis. Nat. Methods, 16, 918-924(2019).

    [39] S. Culley, D. Albrecht, C. Jacobs. Quantitative mapping and minimization of super-resolution optical imaging artifacts. Nat. Methods, 15, 263-266(2018).

    [40] C. Qiao, D. Li, Y. Liu. Rationalized deep learning super-resolution microscopy for sustained live imaging of rapid subcellular processes. Nat. Biotechnol., 41, 367-377(2022).

    [41] J. Wang, J. Fan, B. Zhou. Hybrid reconstruction of the physical model with the deep learning that improves structured illumination microscopy. Adv. Photon. Nexus, 2, 016012(2023).

    [42] L. Jin, B. Liu, F. Zhao. Deep learning enables structured illumination microscopy with low light levels and enhanced speed. Nat. Commun., 11, 1934(2020).

    [43] C. N. Christensen, E. N. Ward, M. Lu. ML-SIM: universal reconstruction of structured illumination microscopy images using transfer learning. Biomed. Opt. Express, 12, 2720-2733(2021).

    [44] https://github.com/Zhang-jingxiang/JSFR-NL-SIM. https://github.com/Zhang-jingxiang/JSFR-NL-SIM

    Tools

    Get Citation

    Copy Citation Text

    Jingxiang Zhang, Tianyu Zhao, Xiangda Fu, Manming Shu, Jiajing Yan, Mengrui Wang, Yansheng Liang, Shaowei Wang, Ming Lei, "High-speed image reconstruction for nonlinear structured illumination microscopy," Photonics Res. 13, 743 (2025)

    Download Citation

    EndNote(RIS)BibTexPlain Text
    Set citation alerts for article
    Save article for my favorites
    Paper Information

    Category: Imaging Systems, Microscopy, and Displays

    Received: Aug. 28, 2024

    Accepted: Dec. 20, 2024

    Published Online: Mar. 3, 2025

    The Author Email: Ming Lei (ming.lei@mail.xjtu.edu.cn)

    DOI:10.1364/PRJ.540671

    Topics

    laser devices and laser physics
    Lasers and Laser Optics
    Laser physics
    laser manufacturing
    Instrumentation, Measurement and Metrology