Optical Technique, Volume. 51, Issue 1, 25(2025)
Application of light field microscopy in the field of neuro-optical imaging
[1] [1] Yuste R. Breaking the neural code of a cnidarian: Learning principles of neuroscience from the“vulgar”hydra[J]. Current Opinion in Neurobiology,2024,86:102869.
[2] [2] Xia F, Rimoli C V, Akemann W, et al. Neurophotonics beyond the surface: unmasking the brain’s complexity exploiting optical scattering[J]. Neurophotonics,2024,11(S1):S11510—S11510.
[3] [3] Day-Cooney J, Dalangin R, Zhong H, et al. Genetically encoded fluorescent sensors for imaging neuronal dynamics in vivo[J]. Journal of Neurochemistry,2023,164(3):284—308.
[4] [4] Wen J, Pilger C, Wang W, et al. Watt-level all polarization-maintaining femtosecond fiber laser source at 1100 nm[J]. Optics Express,2024,32(6):9625—9633.
[5] [5] Levoy M, Ng R, Adams A, et al. Light field microscopy[M]. Acm Siggraph 2006 Papers,2006:924—934.
[6] [6] Lippmann G. Epreuves reversibles, photographies integrales[J]. Comptes-Rendus Academie des Sciences,1908,146(3):446—451.
[7] [7] Ng R, Levoy M, Brdif M, et al. Light field photography with a hand-held plenoptic camera[D]. Stanford University,2005.
[8] [8] Suhail M, Esteves C, Sigal L, et al. Light field neural rendering[C]∥Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, New Orleans,USA:CVPR,2022:8269—8279.
[9] [9] Wang T, Sheng H, Chen R, et al. Light field depth estimation: A comprehensive survey from principles to future[J]. High-Confidence Computing,2023:100187.
[10] [10] Yi C, Zhu L, Li D, et al. Light field microscopy in biological imaging[J]. Journal of Innovative Optical Health Sciences,2023,16(01):2230017.
[11] [11] Li H, Guo C, Kim-Holzapfel D, et al. Fast, volumetric live-cell imaging using high-resolution light-field microscopy[J]. Biomedical Optics Express,2019,10(1):29—49.
[12] [12] Prevedel R, Yoon Y G, Hoffmann M, et al. Simultaneous whole-animal 3d imaging of neuronal activity using light-field microscopy[J]. Nature Methods,2014,11(7):727—730.
[13] [13] Cong L, Wang Z, Chai Y, et al. Rapid whole brain imaging of neural activity in freely behaving larval zebrafish (danio rerio)[J]. Elife,2017,6:e28158.
[14] [14] Wagner N, Norlin N, Gierten J, et al. Instantaneous isotropic volumetric imaging of fast biological processes[J]. Nature Methods,2019,16(6):497—500.
[15] [15] Wang X, Liu J, Wei G, et al. Fast light field camera calibration for industrial inspection[J]. Journal of Electronics and Information,2022,44(5):1530—1538.
[16] [16] Zhao M, Sheng H, Yang D, et al. A survey for light field super-resolution[J]. High-Confidence Computing,2024:100206.
[17] [17] Stefanoiu A, Page J, Symvoulidis P, et al. Artifact-free deconvolution in light field microscopy[J]. Optics Express,2019,27(22):31644—31666.
[18] [18] Broxton M, Grosenick L, Yang S, et al. Wave optics theory and 3-d deconvolution for the light field microscope[J]. Optics Express,2013,21(21):25418—25439.
[19] [19] Quicke P, Howe C L, Song P, et al. Subcellular resolution three-dimensional light-field imaging with genetically encoded voltage indicators[J]. Neurophotonics,2020,7(3):035006—035006.
[20] [20] Song P, Verinaz-Jadan H, Howe C L, et al. Light-field microscopy for the optical imaging of neuronal activity: When model-based methods meet data-driven approaches[J]. IEEE Signal Processing Magazine,2022,39(2):58—72.
[21] [21] Guo C, Liu W, Hua X, et al. Fourier light-field microscopy[J]. Optics Express,2019,27(18):25573—25594.
[22] [22] Nbauer T, Skocek O, Pernia-Andrade A J, et al. Video rate volumetric ca2+ imaging across cortex using seeded iterative demixing (sid) microscopy[J]. Nature Methods,2017,14(8):811—818.
[23] [23] Zhang Z, Bai L, Cong L, et al. Imaging volumetric dynamics at high speed in mouse and zebrafish brain with confocal light field microscopy[J]. Nature Biotechnology,2021,39(1):74—83.
[24] [24] Balasubramanian H, Hobson C M, Chew T L, et al. Imagining the future of optical microscopy: everything, everywhere, all at once[J]. Communications Biology,2023,6(1):1096.
[25] [25] Cohen N, Yang S, Andalman A, et al. Enhancing the performance of the light field microscope using wavefront coding[J]. Optics Express,2014,22(20):24817—24839.
[26] [26] Yanny K, Antipa N, Liberti W, et al. Miniscope3d: optimized single-shot miniature 3d fluorescence microscopy[J]. Light: Science & Applications,2020,9(1):171.
[27] [27] He K, Wang X, Wang Z W, et al. Snapshot multifocal light field microscopy[J]. Optics Express,2020,28(8):12108—12120.
[29] [29] Zhai J, Jin C, Kong L. Compact, hybrid light-sheet and fourier light-field microscopy with a single objective for high-speed volumetric imaging in vivo[J]. The Journal of Physical Chemistry A,2023,127(12):2873—2879.
[30] [30] Wang D, Xu S, Pant P, et al. Hybrid light-sheet and light-field microscope for high resolution and large volume neuroimaging[J]. Biomedical Optics Express,2019,10(12):6595—6610.
[31] [31] Huisken J, Swoger J, Del Bene F, et al. Optical sectioning deep inside live embryos by selective plane illumination microscopy[J]. Science,2004,305(5686):1007—1009.
[32] [32] Lelek M, Gyparaki M T, Beliu G, et al. Single-molecule localization microscopy[J]. Nature Reviews Methods Primers,2021,1(1):39.
[33] [33] Daetwyler S, Fiolka R P. Light-sheets and smart microscopy, an exciting future is dawning[J]. Communications Biology,2023,6(1):502.
[34] [34] Fu Z, Geng Q, Chen J, et al. Light field microscopy based on structured light illumination[J]. Optics Letters,2021,46(14):3424—3427.
[35] [35] Lim D, Ford T N, Chu K K, et al. Optically sectioned in vivo imaging with speckle illumination hilo microscopy[J]. Journal of Biomedical Optics,2011,16(1):016014—016014.
[36] [36] Zhai J, Shi R, Kong L. Improving signal-to-background ratio by orders of magnitude in high-speed volumetric imaging in vivo by robust fourier light field microscopy[J]. Photonics Research,2022,10(5):1255—1263.
[37] [37] Zhai J, Shi R, Fan K, et al. Background inhibited and speed-loss-free volumetric imaging in vivo based on structured-illumination fourier light field microscopy[J]. Frontiers in Neuroscience,2022,16:1004228.
[38] [38] Waller L, Situ G, Fleischer J W. Phase-space measurement and coherence synthesis of optical beams[J]. Nature Photonics,2012,6(7):474—479.
[39] [39] Verinaz-Jadan H, Song P, Howe C L, et al. Volume reconstruction for light field microscopy[C]∥ICASSP 2020-2020 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP). Virtual Conference:IEEE,2020:1459—1463.
[40] [40] Yoon Y G, Wang Z, Pak N, et al. Sparse decomposition light-field microscopy for high speed imaging of neuronal activity[J]. Optica,2020,7(10):1457—1468.
[41] [41] Lu Z, Wu J, Qiao H, et al. Phase-space deconvolution for light field microscopy[J]. Optics Express,2019,27(13):18131—18145.
[42] [42] Liu H Y, Jonas E, Tian L, et al. 3d imaging in volumetric scattering media using phase-space measurements[J]. Optics Express,2015,23(11):14461—14471.
[43] [43] Pgard N C, Liu H Y, Antipa N, et al. Compressive light-field microscopy for 3d neural activity recording[J]. Optica,2016,3(5):517—524.
[44] [44] Song P, Jadan H V, Howe C L, et al. 3d localization for light-field microscopy via convolutional sparse coding on epipolar images[J]. IEEE Transactions on Computational Imaging,2020,6:1017—1032.
[45] [45] Li X, Qiao H, Wu J, et al. Deeplfm: Deep learning-based 3d reconstruction for light field microscopy[C]∥Biophotonics Congress: Optics in the Life Sciences Congress 2019,San Jose,USA:SPIE,2019:123—130.
[46] [46] Wang Z, Zhu L, Zhang H, et al. Real-time volumetric reconstruction of biological dynamics with light-field microscopy and deep learning[J]. Nature Methods,2021,18(5):551—556.
[47] [47] Wagner N, Beuttenmueller F, Norlin N, et al. Deep learning-enhanced light-field imaging with continuous validation[J]. Nature Methods,2021,18(5):557—563.
[48] [48] Verinaz-Jadan H, Song P, Howe C L, et al. Deep learning for light field microscopy using physics-based models[C]∥2021 IEEE 18th International Symposium on Biomedical Imaging (ISBI). Nice, France:IEEE,2021:1091—1094.
[49] [49] Song P, Jadan H V, Howe C L, et al. Model-inspired deep learning for light-field microscopy with application to neuron localization[C]∥ICASSP 2021-2021 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP). Toronto, Canada:IEEE,2021:8087—8091.
[50] [50] Hua X, Liu W, Jia S. High-resolution fourier light-field microscopy for volumetric multi-color live-cell imaging[J]. Optica,2021,8(5):614—620.
[51] [51] Liu W, Kim G A R, Takayama S, et al. Fourier light-field imaging of human organoids with a hybrid point-spread function[J]. Biosensors and Bioelectronics,2022,208:114201.
[52] [52] Skocek O, Nbauer T, Weilguny L, et al. High-speed volumetric imaging of neuronal activity in freely moving rodents[J]. Nature Methods,2018,15(6):429—432.
[53] [53] Nbauer T, Zhang Y, Kim H, et al. Mesoscale volumetric light-field (mesolf) imaging of neuroactivity across cortical areas at 18 hz[J]. Nature Methods,2023,20(4):600—609.
[54] [54] Bolles R C, Baker H H, Marimont D H. Epipolar-plane image analysis: An approach to determining structure from motion[J]. International Journal of Computer Vision,1987,1(1):7—55.
[55] [55] Wu J, Lu Z, Jiang D, et al. Iterative tomography with digital adaptive optics permits hour-long intravital observation of 3d subcellular dynamics at millisecond scale[J].Cell,2021,184(12):3318—3332.
[56] [56] Wang R, Bashyam V, Yang Z, et al. Applications of generative adversarial networks in neuroimaging and clinical neuroscience[J]. Neuroimage,2023,269:119898.
[57] [57] Liu S, Abdellaoui A, Verweij K J, et al. Replicable brain–phenotype associations require large-scale neuroimaging data[J]. Nature Human Behaviour,2023,7(8):1344—1356.
[58] [58] Gao J, Liu J, Xu Y, et al. Brain age prediction using the graph neural network based on resting-state functional mri in alzheimer’s disease[J]. Frontiers in Neuroscience,2023,17:1222751.
[59] [59] Guan H, Li D, Park H c, et al. Deep-learning two-photon fiberscopy for video-rate brain imaging in freely-behaving mice[J]. Nature Communications,2022,13(1):1534.
[60] [60] Chen R, Liu M, Chen W, et al. Deep learning in mesoscale brain microscopy image analysis: A review[J]. Computers in Biology and Medicine,2023:107617.
[61] [61] Wang H, Fu T, Du Y, et al. Scientific discovery in the age of artificial intelligence[J]. Nature,2023,620(7972):47—60.
[62] [62] Chen X, Zhong S, Hou Y, et al. Superresolution structured illumination microscopy reconstruction algorithms: a review[J]. Light: Science & Applications,2023,12(1):172.
[63] [63] Siu D M, Lee K C, Chung B M, et al. Optofluidic imaging meets deep learning: from merging to emerging[J]. Lab on a Chip,2023,23(5):1011—1033.
[64] [64] Vizcaino J P, Saltarin F, Belyaev Y, et al. Learning to reconstruct confocal microscopy stacks from single light field images[J]. IEEE transactions on Computational Imaging,2021,7:775—788.
[65] [65] LeCun Y, Bengio Y, Hinton G. Deep learning[J]. Nature,2015,521(7553):436—444.
[66] [66] Shamshad F, Khan S, Zamir S W, et al. Transformers in medical imaging: A survey[J]. Medical Image Analysis,2023,88:102802.
[67] [67] Gregor K, LeCun Y. Learning fast approximations of sparse coding[C]∥Proceedings of The 27th International Conference On International Conference On Machine Learning,2010:399—406.
[68] [68] Shlezinger N, Whang J, Eldar Y C, et al. Model-based deep learning[J]. Proceedings of The IEEE,2023,111(5): 465—499.
[69] [69] Qu J, Dong W, Li Y, et al. An interpretable unsupervised unrolling network for hyperspectral pansharpening[J]. IEEE Transactions on Cybernetics,2023,53(12):7943—7956.
[70] [70] Zhao Z, Zhang J, Bai H, et al. Deep convolutional sparse coding networks for interpretable image fusion[C]∥2023 IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW). Vancouver,Canada:CVPR,2023:2369—2377.
[71] [71] Verinaz-Jadan H, Howe C L, Song P, et al. Physics-based deep learning for imaging neuronal activity via two-photon and light field microscopy[J]. IEEE Transactions on Computational Imaging,2023,9:565—580.
[72] [72] Li W H, Liu X, Bilen H. Universal representations: A unified look at multiple task and domain learning[J]. International Journal of Computer Vision,2023:1—25.
[73] [73] Dou B, Zhu Z, Merkurjev E, et al. Machine learning methods for small data challenges in molecular science[J]. Chemical Reviews,2023,123(13):8736—8780.
[74] [74] Ma Y, Chen S, Ermon S, et al. Transfer learning in environmental remote sensing[J]. Remote Sensing of Environment,2024,301:113924.
[75] [75] Wu X, Zhang S, Zhou Q, et al. Entropy minimization versus diversity maximization for domain adaptation[J]. IEEE Transactions on Neural Networks and Learning Systems,2023,34(6):2896—2907.
Get Citation
Copy Citation Text
WANG Changle, CHEN Shixue, WANG Jinjia. Application of light field microscopy in the field of neuro-optical imaging[J]. Optical Technique, 2025, 51(1): 25