Multimode Fiber Imaging Technology and Application Based on Light Field Modulation (Invited)

Chiming Zhang; Ji Qi; Zhong Wen; Qing Yang; Xu Liu

doi:10.3788/LOP250501

Laser & Optoelectronics Progress, Volume. 62, Issue 12, 1200001(2025)

Multimode Fiber Imaging Technology and Application Based on Light Field Modulation (Invited)

Chiming Zhang^1,2, Ji Qi³, Zhong Wen^1,2、***, Qing Yang^1,2、*, and Xu Liu^1,2、**

¹State Key Laboratory of Extreme Photonics and Instrumentation, College of Optical Science and Engineering, International Research Center for Advanced Photonics, Zhejiang University, Hangzhou 310027, Zhejiang , China

²ZJU-Hangzhou Global Scientific and Technological Innovation Center, Hangzhou 311215, Zhejiang , China

³Research Center for Frontier Fundamental Studies, Zhejiang Lab , Hangzhou 311121, Zhejiang , China

show less

Abstract Get PDF(in Chinese)

References(74)

[1] Popoff S M, Lerosey G, Carminati R et al. Measuring the transmission matrix in optics: an approach to the study and control of light propagation in disordered media[J]. Physical Review Letters, 104, 100601(2010).

[2] Popoff S M, Lerosey G, Fink M et al. Controlling light through optical disordered media: transmission matrix approach[J]. New Journal of Physics, 13, 123021(2011).

[3] Papadopoulos I N, Farahi S, Moser C et al. Focusing and scanning light through a multimode optical fiber using digital phase conjugation[J]. Optics Express, 20, 10583-10590(2012).

[4] Papadopoulos I N, Farahi S, Moser C et al. High-resolution, lensless endoscope based on digital scanning through a multimode optical fiber[J]. Biomedical Optics Express, 4, 260-270(2013).

[5] Papadopoulos I N, Simandoux O, Farahi S et al. Optical-resolution photoacoustic microscopy by use of a multimode fiber[J]. Applied Physics Letters, 102, 211106(2013).

[6] Caravaca-Aguirre A M, Piestun R. Single multimode fiber endoscope[J]. Optics Express, 25, 1656-1665(2017).

[7] Turtaev S, Leite I T, Altwegg-Boussac T et al. High-fidelity multimode fibre-based endoscopy for deep brain in vivo imaging[J]. Light: Science & Applications, 7, 92(2018).

[8] Trägårdh J, Pikálek T, Šerý M et al. Label-free CARS microscopy through a multimode fiber endoscope[J]. Optics Express, 27, 30055-30066(2019).

[9] Leite I T, Turtaev S, Flaes D E B et al. Observing distant objects with a multimode fiber-based holographic endoscope[J]. APL Photonics, 6, 036112(2021).

[10] Silveira B M, Pikálek T, Stibůrek M et al. Side-view holographic endomicroscopy via a custom-terminated multimode fibre[J]. Optics Express, 29, 23083-23095(2021).

[11] Stibůrek M, Ondráčková P, Tučková T et al. 110 μm thin endo-microscope for deep-brain in vivo observations of neuronal connectivity, activity and blood flow dynamics[J]. Nature Communications, 14, 1897(2023).

[12] Wen Z, Dong Z Y, Deng Q L et al. Single multimode fibre for in vivo light-field-encoded endoscopic imaging[J]. Nature Photonics, 17, 679-687(2023).

[13] Farahi S, Ziegler D, Papadopoulos I N et al. Dynamic bending compensation while focusing through a multimode fiber[J]. Optics Express, 21, 22504-22514(2013).

[14] Gu R Y, Mahalati R N, Kahn J M. Design of flexible multi-mode fiber endoscope[J]. Optics Express, 23, 26905-26918(2015).

[15] Flaes D E B, Stopka J, Turtaev S et al. Robustness of light-transport processes to bending deformations in graded-index multimode waveguides[J]. Physical Review Letters, 120, 233901(2018).

[16] Gordon G S D, Gataric M, Ramos A G C P et al. Characterizing optical fiber transmission matrices using metasurface reflector stacks for lensless imaging without distal access[J]. Physical Review X, 9, 041050(2019).

[17] Li S H, Horsley S A R, Tyc T et al. Memory effect assisted imaging through multimode optical fibres[J]. Nature Communications, 12, 3751(2021).

[18] Fan P F, Zhao T R, Su L. Deep learning the high variability and randomness inside multimode fibers[J]. Optics Express, 27, 20241-20258(2019).

[19] Resisi S, Popoff S M, Bromberg Y. Image transmission through a dynamically perturbed multimode fiber by deep learning[J]. Laser & Photonics Reviews, 15, 2000553(2021).

[20] Fan P F, Wang Y F, Ruddlesden M et al. Deep learning enabled scalable calibration of a dynamically deformed multimode fiber[J]. Advanced Photonics Research, 3, 2100304(2022).

[21] Vellekoop I M, Mosk A P. Focusing coherent light through opaque strongly scattering media[J]. Optics Letters, 32, 2309-2311(2007).

[22] Turtaev S, Leite I T, Mitchell K J et al. Comparison of nematic liquid-crystal and DMD based spatial light modulation in complex photonics[J]. Optics Express, 25, 29874-29884(2017).

[23] Lee W H. Binary computer-generated holograms[J]. Applied Optics, 18, 3661-3669(1979).

[24] Goorden S A, Bertolotti J, Mosk A P. Superpixel-based spatial amplitude and phase modulation using a digital micromirror device[J]. Optics Express, 22, 17999-18009(2014).

[25] Plöschner M, Tyc T, Čižmár T. Seeing through chaos in multimode fibres[J]. Nature Photonics, 9, 529-535(2015).

[26] Loterie D, Farahi S, Psaltis D et al. Complex pattern projection through a multimode fiber[J]. Proceedings of SPIE, 9335, 93350I(2015).

[27] Li S H, Saunders C, Lum D J et al. Compressively sampling the optical transmission matrix of a multimode fibre[J]. Light: Science & Applications, 10, 88(2021).

[28] Choi Y, Yoon C, Kim M et al. Scanner-free and wide-field endoscopic imaging by using a single multimode optical fiber[J]. Physical Review Letters, 109, 203901(2012).

[29] Yoon J, Lee K, Park J et al. Measuring optical transmission matrices by wavefront shaping[J]. Optics Express, 23, 10158-10167(2015).

[30] Drémeau A, Liutkus A, Martina D et al. Reference-less measurement of the transmission matrix of a highly scattering material using a DMD and phase retrieval techniques[J]. Optics Express, 23, 11898-11911(2015).

[31] Huang G Q, Wu D X, Luo J W et al. Generalizing the Gerchberg–Saxton algorithm for retrieving complex optical transmission matrices[J]. Photonics Research, 9, 34-42(2020).

[32] N’Gom M, Lien M B, Estakhri N M et al. Controlling light transmission through highly scattering media using semi-definite programming as a phase retrieval computation method[J]. Scientific Reports, 7, 2518(2017).

[33] Huang G Q, Wu D X, Luo J W et al. Retrieving the optical transmission matrix of a multimode fiber using the extended Kalman filter[J]. Optics Express, 28, 9487-9500(2020).

[34] Metzler C A, Sharma M K, Nagesh S et al. Coherent inverse scattering via transmission matrices: efficient phase retrieval algorithms and a public dataset[C], 1-16(2017).

[35] Cheng S F, Zhong T T, Lai P X. Non-convex optimization for retrieving the complex transmission matrix of a multimode fiber[C], 1-5(2022).

[36] Zhong J S, Wen Z, Li Q Z et al. Efficient reference-less transmission matrix retrieval for a multimode fiber using fast Fourier transform[J]. Advanced Photonics Nexus, 2, 056007(2023).

[37] Cheng S F, Zhang X Y, Zhong T T et al. Nonconvex optimization for optimum retrieval of the transmission matrix of a multimode fiber[J]. Advanced Photonics Nexus, 2, 066005(2023).

[38] Choi Y, Yang T D, Fang-Yen C et al. Overcoming the diffraction limit using multiple light scattering in a highly disordered medium[J]. Physical Review Letters, 107, 023902(2011).

[39] Bianchi S, Di Leonardo R. A multi-mode fiber probe for holographic micromanipulation and microscopy[J]. Lab on a Chip, 12, 635-639(2012).

[40] Tripathi S, Paxman R, Bifano T et al. Vector transmission matrix for the polarization behavior of light propagation in highly scattering media[J]. Optics Express, 20, 16067-16076(2012).

[41] Andreoli D, Volpe G, Popoff S et al. Deterministic control of broadband light through a multiply scattering medium via the multispectral transmission matrix[J]. Scientific Reports, 5, 10347(2015).

[42] Mounaix M, Andreoli D, Defienne H et al. Spatiotemporal coherent control of light through a multiple scattering medium with the multispectral transmission matrix[J]. Physical Review Letters, 116, 253901(2016).

[43] Caravaca-Aguirre A M, Niv E, Conkey D B et al. Real-time resilient focusing through a bending multimode fiber[J]. Optics Express, 21, 12881-12887(2013).

[44] Candes E J, Tao T. Decoding by linear programming[J]. IEEE Transactions on Information Theory, 51, 4203-4215(2005).

[45] Candes E J, Wakin M B. An introduction to compressive sampling[J]. IEEE Signal Processing Magazine, 25, 21-30(2008).

[46] Mahalati R N, Gu R Y, Kahn J M. Resolution limits for imaging through multi-mode fiber[J]. Optics Express, 21, 1656-1668(2013).

[47] Amitonova L V, de Boer J F. Compressive imaging through a multimode fiber[J]. Optics Letters, 43, 5427-5430(2018).

[48] Amitonova L V, de Boer J F. Endo-microscopy beyond the abbe and Nyquist limits[J]. Light: Science & Applications, 9, 81(2020).

[49] Dong Z Y, Wen Z, Pang C L et al. A modulated sparse random matrix for high-resolution and high-speed 3D compressive imaging through a multimode fiber[J]. Science Bulletin, 67, 1224-1228(2022).

[50] Rahmani B, Loterie D, Konstantinou G et al. Multimode optical fiber transmission with a deep learning network[J]. Light: Science & Applications, 7, 69(2018).

[51] Caramazza P, Moran O, Murray-Smith R et al. Transmission of natural scene images through a multimode fibre[J]. Nature Communications, 10, 2029(2019).

[52] Zhu C Y, Chan E A, Wang Y et al. Image reconstruction through a multimode fiber with a simple neural network architecture[J]. Scientific Reports, 11, 896(2021).

[53] Yu Z M, Ju Z Y, Zhang X L et al. High-speed multimode fiber imaging system based on conditional generative adversarial network[J]. Chinese Optics Letters, 19, 081101(2021).

[54] Liu Z T, Wang L L, Meng Y et al. All-fiber high-speed image detection enabled by deep learning[J]. Nature Communications, 13, 1433(2022).

[55] Wang L L, Yang Y S, Liu Z T et al. High-speed all-fiber micro-imaging with large depth of field[J]. Laser & Photonics Reviews, 16, 2100724(2022).

[56] Zhu R Z, Feng H G, Xu F. Deep learning-based multimode fiber imaging in multispectral and multipolarimetric channels[J]. Optics and Lasers in Engineering, 161, 107386(2023).

[57] Loterie D, Farahi S, Papadopoulos I et al. Digital confocal microscopy through a multimode fiber[J]. Optics Express, 23, 23845-23858(2015).

[58] Ohayon S, Caravaca-Aguirre A, Piestun R et al. Minimally invasive multimode optical fiber microendoscope for deep brain fluorescence imaging[J]. Biomedical Optics Express, 9, 1492-1509(2018).

[59] Vasquez-Lopez S A, Turcotte R, Koren V et al. Subcellular spatial resolution achieved for deep-brain imaging in vivo using a minimally invasive multimode fiber[J]. Light: Science & Applications, 7, 110(2018).

[60] Stellinga D, Phillips D B, Mekhail S P et al. Time-of-flight 3D imaging through multimode optical fibers[J]. Science, 374, 1395-1399(2021).

[61] Morales-Delgado E E, Farahi S, Papadopoulos I N et al. Delivery of focused short pulses through a multimode fiber[J]. Optics Express, 23, 9109-9120(2015).

[62] Morales-Delgado E E, Psaltis D, Moser C. Two-photon imaging through a multimode fiber[J]. Optics Express, 23, 32158-32170(2015).

[63] Gusachenko I, Chen M Z, Dholakia K. Raman imaging through a single multimode fibre[J]. Optics Express, 25, 13782-13798(2017).

[64] Cifuentes A, Pikálek T, Ondráčková P et al. Polarization-resolved second-harmonic generation imaging through a multimode fiber[J]. Optica, 8, 1065-1074(2021).

[65] Caravaca-Aguirre A M, Singh S, Labouesse S et al. Hybrid photoacoustic-fluorescence microendoscopy through a multimode fiber using speckle illumination[J]. APL Photonics, 4, 096103(2019).

[66] Mezil S, Caravaca-Aguirre A M, Zhang E Z et al. Single-shot hybrid photoacoustic-fluorescent microendoscopy through a multimode fiber with wavefront shaping[J]. Biomedical Optics Express, 11, 5717-5727(2020).

[67] Zhao T R, Ma M T, Ourselin S et al. Video-rate dual-modal photoacoustic and fluorescence imaging through a multimode fibre towards forward-viewing endomicroscopy[J]. Photoacoustics, 25, 100323(2022).

[68] Li Q Z, Wen Z, Deng Q L et al. Phase imaging through a single multimode fiber[J]. Optics Letters, 49, 5823-5826(2024).

[69] Čižmár T, Dholakia K. Shaping the light transmission through a multimode optical fibre: complex transformation analysis and applications in biophotonics[J]. Optics Express, 19, 18871-18884(2011).

[70] Leite I T, Turtaev S, Jiang X et al. Three-dimensional holographic optical manipulation through a high-numerical-aperture soft-glass multimode fibre[J]. Nature Photonics, 12, 33-39(2018).

[71] Leedumrongwatthanakun S, Innocenti L, Defienne H et al. Programmable linear quantum networks with a multimode fibre[J]. Nature Photonics, 14, 139-142(2020).

[72] Teğin U, Yıldırım M, Oğuz İ et al. Scalable optical learning operator[J]. Nature Computational Science, 1, 542-549(2021).

[73] Yu Z P, Zhong T T, Li H H et al. Long distance all-optical logic operations through a single multimode fiber empowered by wavefront shaping[J]. Photonics Research, 12, 587-597(2024).

[74] Yu H Y, Huang Z H, Lamon S et al. All-optical image transportation through a multimode fibre using a miniaturized diffractive neural network on the distal facet[J/OL]. Nature Photonics, 1-8. https://www.nature.com/articles/s41566-025-01621-4

Tools

Get Citation

Copy Citation Text

Chiming Zhang, Ji Qi, Zhong Wen, Qing Yang, Xu Liu. Multimode Fiber Imaging Technology and Application Based on Light Field Modulation (Invited)[J]. Laser & Optoelectronics Progress, 2025, 62(12): 1200001

Download Citation

EndNote(RIS)BibTex Plain Text

Set citation alerts for article

Save article for my favorites

Paper Information

Category: Reviews

Received: Jan. 13, 2025

Accepted: Mar. 14, 2025

Published Online: Jun. 17, 2025

The Author Email: Zhong Wen (21730014@zju.edu.cn), Qing Yang (qingyang@zju.edu.cn), Xu Liu (liuxu@zju.edu.cn)

DOI:10.3788/LOP250501

CSTR:32186.14.LOP250501

Topics

laser devices and laser physics

Lasers and Laser Optics

Laser physics

laser manufacturing

Instrumentation, Measurement and Metrology