Acta Optica Sinica, Volume. 44, Issue 10, 1026017(2024)
Spatiotemporal Light Field Measurement and Imaging Applications Based on Multimode Fibers (Invited)
[1] Mannath J, Ragunath K. Role of endoscopy in early oesophageal cancer[J]. Nature Reviews Gastroenterology & Hepatology, 13, 720-730(2016).
[2] Goetz M, Malek N P, Kiesslich R. Microscopic imaging in endoscopy: endomicroscopy and endocytoscopy[J]. Nature Reviews Gastroenterology & Hepatology, 11, 11-18(2014).
[3] Bajbouj M, Vieth M, Rösch T et al. Probe-based confocal laser endomicroscopy compared with standard four-quadrant biopsy for evaluation of neoplasia in Barrett’s esophagus[J]. Endoscopy, 42, 435-440(2010).
[4] Cao H, Čižmár T, Turtaev S et al. Controlling light propagation in multimode fibers for imaging, spectroscopy, and beyond[J]. Advances in Optics and Photonics, 15, 524-612(2023).
[5] Papadopoulos I N, Farahi S, Moser C et al. High-resolution, lensless endoscope based on digital scanning through a multimode optical fiber[J]. Biomedical Optics Express, 4, 260-270(2013).
[6] Turtaev S, Leite I T, Altwegg-Boussac T et al. High-fidelity multimode fibre-based endoscopy for deep brain in vivo imaging[J]. Light, Science & Applications, 7, 92(2018).
[7] Vasquez-Lopez S A, Turcotte R, Koren V et al. Subcellular spatial resolution achieved for deep-brain imaging in vivo using a minimally invasive multimode fiber[J]. Light, Science & Applications, 7, 110(2018).
[8] Wen Z, Wang L Q, Zhang X H et al. Fast volumetric fluorescence imaging with multimode fibers[J]. Optics Letters, 45, 4931-4934(2020).
[9] Silveira B M, Pikálek T, Stibůrek M et al. Side-view holographic endomicroscopy via a custom-terminated multimode fibre[J]. Optics Express, 29, 23083-23095(2021).
[10] Stibůrek M, Ondráčková P, Tučková T et al. 110 μm thin endo-microscope for deep-brain in vivo observations of neuronal connectivity, activity and blood flow dynamics[J]. Nature Communications, 14, 1897(2023).
[11] Mahalati R N, Gu R Y, Kahn J M. Resolution limits for imaging through multi-mode fiber[J]. Optics Express, 21, 1656-1668(2013).
[12] Amitonova L V, de Boer J F. Compressive imaging through a multimode fiber[J]. Optics Letters, 43, 5427-5430(2018).
[13] Amitonova L V, de Boer J F. Endo-microscopy beyond the Abbe and Nyquist limits[J]. Light, Science & Applications, 9, 81(2020).
[14] Dong Z Y, Wen Z, Pang C L et al. A modulated sparse random matrix for high-resolution and high-speed 3D compressive imaging through a multimode fiber[J]. Science Bulletin, 67, 1224-1228(2022).
[15] Choi Y, Yoon C, Kim M et al. Scanner-free and wide-field endoscopic imaging by using a single multimode optical fiber[J]. Physical Review Letters, 109, 203901(2012).
[16] Morales-Delgado E E, Farahi S, Papadopoulos I N et al. Delivery of focused short pulses through a multimode fiber[J]. Optics Express, 23, 9109-9120(2015).
[17] Morales-Delgado E E, Psaltis D, Moser C. Two-photon imaging through a multimode fiber[J]. Optics Express, 23, 32158-32170(2015).
[18] Gusachenko I, Chen M Z, Dholakia K. Raman imaging through a single multimode fibre[J]. Optics Express, 25, 13782-13798(2017).
[19] Deng S N, Loterie D, Konstantinou G et al. Raman imaging through multimode sapphire fiber[J]. Optics Express, 27, 1090-1098(2019).
[20] Trägårdh J, Pikálek T, Šerý M et al. Label-free CARS microscopy through a multimode fiber endoscope[J]. Optics Express, 27, 30055-30066(2019).
[21] Pikálek T, Stibůrek M, Simpson S et al. Suppression of the non-linear background in a multimode fibre CARS endoscope[J]. Biomedical Optics Express, 13, 862-874(2022).
[22] Cifuentes A, Pikálek T, Ondráčková P et al. Polarization-resolved second-harmonic generation imaging through a multimode fiber[J]. Optica, 8, 1065-1074(2021).
[23] Mezil S, Caravaca-Aguirre A M, Zhang E Z et al. Single-shot hybrid photoacoustic-fluorescent microendoscopy through a multimode fiber with wavefront shaping[J]. Biomedical Optics Express, 11, 5717-5727(2020).
[24] Caravaca-Aguirre A M, Singh S, Labouesse S et al. Hybrid photoacoustic-fluorescence microendoscopy through a multimode fiber using speckle illumination[J]. APL Photonics, 4, 096103(2019).
[25] Čižmár T, Dholakia K. Exploiting multimode waveguides for pure fibre-based imaging[J]. Nature Communications, 3, 1027(2012).
[26] Leite I T, Turtaev S, Boonzajer Flaes D E et al. Observing distant objects with a multimode fiber-based holographic endoscope[J]. APL Photonics, 6, 036112(2021).
[27] Stellinga D, Phillips D B, Mekhail S P et al. Time-of-flight 3D imaging through multimode optical fibers[J]. Science, 374, 1395-1399(2021).
[28] Rahmani B, Loterie D, Konstantinou G et al. Multimode optical fiber transmission with a deep learning network[J]. Light, Science & Applications, 7, 69(2018).
[29] Caramazza P, Moran O, Murray-Smith R et al. Transmission of natural scene images through a multimode fibre[J]. Nature Communications, 10, 2029(2019).
[30] Borhani N, Kakkava E, Moser C et al. Learning to see through multimode fibers[J]. Optica, 5, 960-966(2018).
[31] Xu R C, Zhang L H, Chen Z Y et al. High accuracy transmission and recognition of complex images through multimode fibers using deep learning[J]. Laser & Photonics Reviews, 17, 2200339(2023).
[32] Meng L, Hu H F, Hu J Z et al. Image reconstruction of multimode fiber scattering media based on deep learning[J]. Chinese Journal of Lasers, 47, 1206005(2020).
[33] Song B B, Jin C, Wu J X et al. Deep learning image transmission through a multimode fiber based on a small training dataset[J]. Optics Express, 30, 5657-5672(2022).
[34] Liu Z T, Wang L L, Meng Y et al. All-fiber high-speed image detection enabled by deep learning[J]. Nature Communications, 13, 1433(2022).
[35] Xiong W, Hsu C W, Cao H. Long-range spatio-temporal correlations in multimode fibers for pulse delivery[J]. Nature Communications, 10, 2973(2019).
[36] Mounaix M, Carpenter J. Control of the temporal and polarization response of a multimode fiber[J]. Nature Communications, 10, 5085(2019).
[37] Zhu R Z, Xu F. Multimode fiber imaging based on temporal-spatial information extraction[J]. Laser & Optoelectronics Progress, 60, 1106011(2023).
[38] Oguz I, Hsieh J L, Dinc N U et al. Programming nonlinear propagation for efficient optical learning machines[J]. Advanced Photonics, 6, 016002(2024).
[39] Wen Z, Liu X, Yang Q. Multimode fiber imaging: a novel and fast-developing field[J]. Science Bulletin, 67, 1399-1401(2022).
[40] Gloge D. Weakly guiding fibers[J]. Applied Optics, 10, 2252-2258(1971).
[41] Spitz E, Werts A. Transmission des images à travers une fibre optique[J]. Comptes Rendus Hebdomadaires Des Seances De L Academie Des Sciences Serie B, 264, 1015(1967).
[42] Popoff S M, Lerosey G, Carminati R et al. Measuring the transmission matrix in optics: an approach to the study and control of light propagation in disordered media[J]. Physical Review Letters, 104, 100601(2010).
[43] Popoff S M, Lerosey G, Fink M et al. Controlling light through optical disordered media: transmission matrix approach[J]. New Journal of Physics, 13, 123021(2011).
[44] Choi Y, Yang T D, Fang-Yen C et al. Overcoming the diffraction limit using multiple light scattering in a highly disordered medium[J]. Physical Review Letters, 107, 023902(2011).
[45] Tripathi S, Paxman R, Bifano T et al. Vector transmission matrix for the polarization behavior of light propagation in highly scattering media[J]. Optics Express, 20, 16067-16076(2012).
[46] Andreoli D, Volpe G, Popoff S et al. Deterministic control of broadband light through a multiply scattering medium via the multispectral transmission matrix[J]. Scientific Reports, 5, 10347(2015).
[47] Li S H, Saunders C, Lum D J et al. Compressively sampling the optical transmission matrix of a multimode fibre[J]. Light, Science & Applications, 10, 916-930(2021).
[48] Li S H, Horsley S A R, Tyc T et al. Memory effect assisted imaging through multimode optical fibres[J]. Nature Communications, 12, 3751(2021).
[49] Mounaix M, Andreoli D, Defienne H et al. Spatiotemporal coherent control of light through a multiple scattering medium with the multispectral transmission matrix[J]. Physical Review Letters, 116, 253901(2016).
[50] Lee S Y, Parot V J, Bouma B E et al. Reciprocity-induced symmetry in the round-trip transmission through complex systems[J]. APL Photonics, 5, 106104(2020).
[51] Yoon J, Lee K, Park J et al. Measuring optical transmission matrices by wavefront shaping[J]. Optics Express, 23, 10158-10167(2015).
[52] Drémeau A, Liutkus A, Martina D et al. Reference-less measurement of the transmission matrix of a highly scattering material using a DMD and phase retrieval techniques[J]. Optics Express, 23, 11898-11911(2015).
[53] Deng L, Yan J D, Elson D S et al. Characterization of an imaging multimode optical fiber using a digital micro-mirror device based single-beam system[J]. Optics Express, 26, 18436-18447(2018).
[54] Huang G Q, Wu D X, Luo J W et al. Generalizing the Gerchberg-Saxton algorithm for retrieving complex optical transmission matrices[J]. Photonics Research, 9, 34-42(2020).
[55] N’Gom M, Lien M B, Estakhri N M et al. Controlling light transmission through highly scattering media using semi-definite programming as a phase retrieval computation method[J]. Scientific Reports, 7, 2518(2017).
[56] Huang G Q, Wu D X, Luo J W et al. Retrieving the optical transmission matrix of a multimode fiber using the extended Kalman filter[J]. Optics Express, 28, 9487-9500(2020).
[57] Metzler C A, Sharma M K, Nagesh S et al. Coherent inverse scattering via transmission matrices: efficient phase retrieval algorithms and a public dataset[C], 1-16(2017).
[58] Cheng S F, Zhong T T, Lai P X. Non-convex optimization for retrieving the complex transmission matrix of a multimode fiber[J]. Advanced Photonics Nexus, 2, 066005(2023).
[59] Plöschner M, Kollárová V, Dostál Z et al. Multimode fibre: light-sheet microscopy at the tip of a needle[J]. Scientific Reports, 5, 18050(2015).
[60] Zhong J S, Wen Z, Li Q Z et al. Efficient reference-less transmission matrix retrieval for a multimode fiber using fast Fourier transform[J]. Advanced Photonics Nexus, 2, 056007(2023).
[61] Čižmár T, Dholakia K. Shaping the light transmission through a multimode optical fibre: complex transformation analysis and applications in biophotonics[J]. Optics Express, 19, 18871-18884(2011).
[62] Plöschner M, Tyc T, Čižmár T. Seeing through chaos in multimode fibres[J]. Nature Photonics, 9, 529-535(2015).
[63] Zhang X H, Wen Z, Ma Y G et al. High contrast multimode fiber imaging based on wavelength modulation[J]. Applied Optics, 59, 6677-6681(2020).
[64] Deng Q L, Wen Z, Dong Z Y et al. Spatially variant deblur and image enhancement in a single multimode fiber imaged by deep learning[J]. Optics Letters, 47, 5040-5043(2022).
[65] Wen Z, Dong Z Y, Deng Q L et al. Single multimode fibre for in vivo light-field-encoded endoscopic imaging[J]. Nature Photonics, 17, 679-687(2023).
[66] Farahi S, Ziegler D, Papadopoulos I N et al. Dynamic bending compensation while focusing through a multimode fiber[J]. Optics Express, 21, 22504-22514(2013).
[67] Gu R Y, Mahalati R N, Kahn J M. Design of flexible multi-mode fiber endoscope[J]. Optics Express, 23, 26905-26918(2015).
[68] Loterie D, Psaltis D, Moser C. Bend translation in multimode fiber imaging[J]. Optics Express, 25, 6263-6273(2017).
[69] Boonzajer F D E, Stopka J, Turtaev S et al. Robustness of light-transport processes to bending deformations in graded-index multimode waveguides[J]. Physical Review Letters, 120, 233901(2018).
[70] Gordon G S D, Gataric M, Ramos A G C P et al. Characterizing optical fiber transmission matrices using metasurface reflector stacks for lensless imaging without distal access[J]. Physical Review X, 9, 041050(2019).
[71] Fan P F, Zhao T R, Su L. Deep learning the high variability and randomness inside multimode fibers[J]. Optics Express, 27, 20241-20258(2019).
[72] Lan M Y, Xiang Y Y, Li J H et al. Averaging speckle patterns to improve the robustness of compressive multimode fiber imaging against fiber bend[J]. Optics Express, 28, 13662-13669(2020).
[73] Resisi S, Popoff S M, Bromberg Y. Image transmission through a dynamically perturbed multimode fiber by deep learning[J]. Laser & Photonics Reviews, 15, 2000553(2021).
[74] Yang D Y, Hao M, Wu G H et al. Single multimode fiber imaging based on low-rank recovery[J]. Optics and Lasers in Engineering, 149, 106827(2022).
[75] Fan P F, Wang Y F, Ruddlesden M et al. Deep learning enabled scalable calibration of a dynamically deformed multimode fiber[J]. Advanced Photonics Research, 3, 2100304(2022).
Get Citation
Copy Citation Text
Zhong Wen, Qing Yang, Xu Liu. Spatiotemporal Light Field Measurement and Imaging Applications Based on Multimode Fibers (Invited)[J]. Acta Optica Sinica, 2024, 44(10): 1026017
Category: Physical Optics
Received: Jan. 2, 2024
Accepted: Mar. 4, 2024
Published Online: May. 6, 2024
The Author Email: Liu Xu (liuxu@zju.edu.cn)
CSTR:32393.14.AOS240438