Journal of Innovative Optical Health Sciences, Volume. 16, Issue 2, 2230008(2023)

Single-cell volumetric imaging with light field microscopy: Advances in systems and algorithms

Beibei Gao*, Lu Gao**, and Fu Wang***
Author Affiliations
  • School of Biomedical Engineering, Shanghai Jiao Tong University, Shanghai 200240, P. R. China
  • show less
    References(96)

    [1] Recent advances in the analysis of single cells. Anal. Chem., 89, 2-21(2017).

    [2] Single-cell systems biology by super-resolution imaging and combinatorial labeling. Nat. Methods, 9, 743-748(2012).

    [3] Wide-field imaging and flow cytometric analysis of cancer cells in blood by fluorescent nanodiamond labeling and time gating. Sci. Rep., 4, 1-7(2014).

    [4] Wide-field subdiffraction imaging by accumulated binding of diffusing probes. Proc. Natl. Acad. Sci., 103, 18911-18916(2006).

    [5] et alSingle cell optical imaging and spectroscopy. Chem. Rev., 113, 2469-2527(2013).

    [6] et alCellular in vivo 3D imaging of the cornea by confocal laser scanning microscopy. Biomed. Opt. Express, 9, 2511-2525(2018).

    [7] 3D resolved two-photon fluorescence microscopy of living cells using a modified confocal laser scanning microscope. Cell. Mol. Biol. (Noisy-le-grand), 42, 1181-1194(1996).

    [8] Recent progress in light sheet microscopy for biological applications. Appl. Spectrosc., 72, 1137-1169(2018).

    [9] Light sheet microscopy. Methods Cell Biol., 123, 193-215(2014).

    [10] Light field microscopy. ACM Trans. Graph., 25, 924-934(2006).

    [11] Recording and controlling the 4D light field in a microscope using microlens arrays. J. Microsc., 235, 144-162(2009).

    [12] A single-shot 2D/3D simultaneous imaging microscope based on light field microscopy. Fifth Asia-Pacific Optical Sensors Conf., 96551O(2015).

    [13] Fourier lightfield microscopy: A practical design guide. Appl. Optics, 61, 2558-2564(2022).

    [14] The plenoptic function and the elements of early vision. Computational Models of Visual Processing, 1, 8(1991).

    [15] Light field rendering. Proc. 23rd Annual Conf. Computer Graphics and Interactive Techniques, 31-42(1996).

    [16] Enhancing the performance of the light field microscope using wavefront coding. Opt. Express, 22, 24817-24839(2014).

    [17] Camera array based light field microscopy. Biomed. Opt. Express, 6, 3179-3189(2015).

    [18] Focused plenoptic camera and rendering. J. Electron. Imag., 19, 021106(2010).

    [19] Protocol for the design and assembly of a light sheet light field microscope. Methods Protoc., 2, 56(2019).

    [20] Wave optics theory and 3-D deconvolution for the light field microscope. Opt. Express, 21, 25418-25439(2013).

    [21] Resolution improvements in integral microscopy with Fourier plane recording. Opt. Express, 24, 20792-20798(2016).

    [22] Fourier light-field microscopy. Opt. Express, 27, 25573-25594(2019).

    [23] Imaging volumetric dynamics at high speed in mouse and zebrafish brain with confocal light field microscopy. Nat. Biotechnol., 39, 74-83(2021).

    [24] Brain-wide 3D light-field imaging of neuronal activity with speckle-enhanced resolution. Optica, 5, 345-353(2018).

    [25] The multifocus plenoptic camera. Digital Photography VIII, 829908(2012).

    [26] Rapid whole brain imaging of neural activity in freely behaving larval zebrafish (Danio rerio). Elife, 6, e28158(2017).

    [27] Artifact-free deconvolution in light field microscopy. Opt. Express, 27, 31644-31666(2019).

    [28] Three-dimensional light field microscope based on a lenslet array. Opt. Commun., 403, 133-142(2017).

    [29] [29] T. Georgiev, A. Lumsdaine, Superresolution with plenoptic camera 2.0, Adobe Systems Incorporated, Technical Report (2009).

    [30] [30] H. Li, C. Guo, S. Jia, High-resolution light-field microscopy, in Frontiers in Optics 2017 (Optica Publishing Group, 2017), p. FW6D.3.

    [31] et alFast, volumetric live-cell imaging using high-resolution light-field microscopy. Biomed. Opt. Express, 10, 29-49(2019).

    [32] Fast and accurate sCMOS noise correction for fluorescence microscopy. Nat. Commun., 11, 1-12(2020).

    [33] Design of a high-resolution light field miniscope for volumetric imaging in scattering tissue. Biomed. Opt. Express, 11, 1662-1678(2020).

    [34] wFLFM: enhancing the resolution of fourier light-field microscopy using a hybrid wide-field image. Appl. Phys. Express, 14, 012007(2021).

    [35] High-resolution Fourier light-field microscopy for volumetric multi-color live-cell imaging. Optica, 8, 614-620(2021).

    [36] Organoids in cancer research. Nat. Rev. Cancer, 18, 407-418(2018).

    [37] Fourier light-field imaging of human organoids with a hybrid point-spread function. Biosens. Bioelectron., 208, 114201(2022).

    [38] et alIterative tomography with digital adaptive optics permits hour-long intravital observation of 3D subcellular dynamics at millisecond scale. Cell, 184, 3318-3332(2021).

    [39] Pupil-segmentation-based adaptive optical microscopy with full-pupil illumination. Opt. Lett., 36, 4206-4208(2011).

    [40] Discovery of the migrasome, an organelle mediating release of cytoplasmic contents during cell migration. Cell Res., 25, 24-38(2015).

    [41] et alMirror-enhanced scanning light-field microscopy for long-term high-speed 3D imaging with isotropic resolution. Light Sci. Appl., 10, 1-11(2021).

    [42] Instantaneous isotropic volumetric imaging of fast biological processes. Nat. Methods, 16, 497-500(2019).

    [43] Confocal multiview light-sheet microscopy. Nat. Commun., 6, 1-8(2015).

    [44] Light-sheet enhanced resolution of light field microscopy for rapid imaging of large volumes. Three-dimensional and Multidimensional Microscopy: Image Acquisition and Processing XXV, 104991U(2018).

    [45] Hybrid light-sheet and light-field microscope for high resolution and large volume neuroimaging. Biomed. Opt. Express, 10, 6595-6610(2019).

    [46] Hemodynamic measurements from individual blood cells in early mammalian embryos with Doppler swept source OCT. Opt. Lett., 34, 986-988(2009).

    [47] Two-photon imaging of cerebral hemodynamics and neural activity in awake and anesthetized marmosets. J. Neurosci. Methods, 271, 55-64(2016).

    [48] High-contrast, synchronous volumetric imaging with selective volume illumination microscopy. Commun. Biol., 3, 1-8(2020).

    [49] Single-objective selective-volume illumination microscopy enables high-contrast light-field imaging. Opt. Lett., 46, 2860-2863(2021).

    [50] Real-time optical gating for three-dimensional beating heart imaging. J. Biomed. Opt., 16, 116021(2011).

    [51] A hybrid of light-field and light-sheet imaging to study myocardial function and intracardiac blood flow during zebrafish development. PLOS Comput. Biol., 17, e1009175(2021).

    [52] Visualizing and discovering cellular structures with super-resolution microscopy. Science, 361, 880-887(2018).

    [53] Super-resolution microscopy approaches for live cell imaging. Biophys. J., 107, 1777-1784(2014).

    [54] Super-resolution fluorescence microscopy for single cell imaging. Adv. Exp. Med. Biol., 1068, 59-71(2018).

    [55] Structured illumination microscopy. Adv. Opt. Photon., 7, 241-275(2015).

    [56] High-resolution light-field microscopy with patterned illumination. Biomed. Opt. Express, 12, 3887-3901(2021).

    [57] Light field microscopy based on structured light illumination. Opt. Lett., 46, 3424-3427(2021).

    [58] et alSingle molecule light field microscopy. Optica, 7, 1065-1072(2020).

    [59] Live-cell imaging in the era of too many microscopes. Curr. Opin. Cell Biol., 66, 34-42(2020).

    [60] Light fields and computational imaging. Computer, 39, 46-55(2006).

    [61] Light field imaging: models, calibrations, reconstructions, and applications. Front. Inform. Tech. El., 18, 1236-1249(2017).

    [62] Light-field depth estimation via epipolar plane image analysis and locally linear embedding. IEEE Trans. Circuits Syst. Video Technol., 27, 739-747(2016).

    [63] Depth from combining defocus and correspondence using light-field cameras. Proc. IEEE Int. Conf. Computer Vision, 673-680(2013).

    [64] Light-sheet light-field fluorescence microscopy. Opt. Laser Eng., 153, 107015(2022).

    [65] Three-dimensional behavioural phenotyping of freely moving C. elegans using quantitative light field microscopy. PLOS ONE, 13, e0200108(2018).

    [66] Deconvolution methods for 3-D fluorescence microscopy images. IEEE Signal Process Mag., 23, 32-45(2006).

    [67] DeconvolutionLab2: An open-source software for deconvolution microscopy. Methods, 115, 28-41(2017).

    [68] et alSimultaneous whole-animal 3D imaging of neuronal activity using light-field microscopy. Nat. Methods, 11, 727-730(2014).

    [69] Subcellular resolution three-dimensional light-field imaging with genetically encoded voltage indicators. Neurophotonics, 7, 035006(2020).

    [70] Snapshot projection optical tomography. Phys. Rev. Appl., 13, 054048(2020).

    [71] Design of a light field microscope with uniform spatial resolution across an extended 3D volume. Optical Design and Testing XI, 99-111(2021).

    [72] Snapshot hyperspectral volumetric microscopy. Sci. Rep., 6, 1-10(2016).

    [73] Maximum likelihood reconstruction for emission tomography. IEEE Trans. Med. Imag., 1, 113-122(1982).

    [74] EM+ TV based reconstruction for cone-beam CT with reduced radiation. Int. Symp. Visual Computing, 1-10(2011).

    [75] 3d deconvolution in fourier integral microscopy. Computational Imaging V, 113960I(2020).

    [76] On use of the EM algorithm for penalized likelihood estimation. J. R. Stat. Soc. B, 52, 443-452(1990).

    [77] Volume reconstruction for light field microscopy. ICASSP 2020-2020 IEEE Int. Conf. Acoustics, Speech and Signal Processing (ICASSP), 1459-1463(2020).

    [78] Inner-loop-free admm for cryo-em. 2019 IEEE 16th Int. Symp. Biomedical Imaging (ISBI 2019), 307-311(2019).

    [79] Mixed poisson gaussian noise reduction in fluorescence microscopy images using modified structure of wavelet transform. IET Image Proc., 15, 1383-1398(2021).

    [80] Compressive light-field microscopy for 3D neural activity recording. Optica, 3, 517-524(2016).

    [81] Video rate volumetric Ca2+ imaging across cortex using seeded iterative demixing (SID) microscopy. Nat. Methods, 14, 811-818(2017).

    [82] et alSparse decomposition light-field microscopy for high speed imaging of neuronal activity. Optica, 7, 1457-1468(2020).

    [83] Phase-space deconvolution for light field microscopy. Opt. Express, 27, 18131-18145(2019).

    [84] Light field from micro-baseline image pair. Proc. IEEE Conf. Computer Vision and Pattern Recognition, 3800-3809(2015).

    [85] Cubic convolution interpolation for digital image processing. IEEE Trans. Acoust. Speech Signal Process., 29, 1153-1160(1981).

    [86] Weighted nuclear norm minimization with application to image denoising. Proc. IEEE Conf. Computer Vision and Pattern Recognition, 2862-2869(2014).

    [87] Spatial-temporal low-rank prior for low-light volumetric fluorescence imaging. Opt. Express, 29, 40721-40733(2021).

    [88] 3D imaging in volumetric scattering media using phase-space measurements. Opt. Express, 23, 14461-14471(2015).

    [89] et alComputational optical sectioning with an incoherent multiscale scattering model for light-field microscopy. Nat. Commun., 12, 1-11(2021).

    [90] Deep-learning based dual-view light-field microscopy enabling high-resolution 3D imaging of dense signals. Bio-Optics: Design and Application, DTh2A–3(2021).

    [91] Model-inspired deep learning for light-field microscopy with application to neuron localization. ICASSP 2021-2021 IEEE Int. Conf. Acoustics, Speech and Signal Processing (ICASSP), 8087-8091(2021).

    [92] DeepLFM: Deep learning-based 3D reconstruction for light field microscopy. Novel Techniques in Microscopy, NM3C–2(2019).

    [93] 3D U-Net: learning dense volumetric segmentation from sparse annotation. Int. Conf. Medical Image Computing and Computer-assisted Intervention, 424-432(2016).

    [94] et alReal-time volumetric reconstruction of biological dynamics with light-field microscopy and deep learning. Nat. Methods, 18, 551-556(2021).

    [95] Learning to reconstruct confocal microscopy stacks from single light field images. IEEE Trans. Comput. Imag., 7, 775-788(2021).

    [96] DiLFM: An artifact-suppressed and noise-robust light-field microscopy through dictionary learning. Light Sci. Appl., 10, 1-12(2021).

    Tools

    Get Citation

    Copy Citation Text

    Beibei Gao, Lu Gao, Fu Wang. Single-cell volumetric imaging with light field microscopy: Advances in systems and algorithms[J]. Journal of Innovative Optical Health Sciences, 2023, 16(2): 2230008

    Download Citation

    EndNote(RIS)BibTexPlain Text
    Save article for my favorites
    Paper Information

    Category: Research Articles

    Received: Apr. 27, 2022

    Accepted: Jun. 10, 2022

    Published Online: Mar. 31, 2023

    The Author Email: Gao Beibei (gaobeibei919@sjtu.edu.cn), Gao Lu (lucy_gao@sjtu.edu.cn), Wang Fu (wangfu@sjtu.edu.cn)

    DOI:10.1142/S1793545822300087

    Topics