Laser & Optoelectronics Progress, Volume. 60, Issue 11, 1106011(2023)

Multimode Fiber Imaging Based on Temporal-Spatial Information Extraction

Runze Zhu1、† and Fei Xu†、*
Author Affiliations
  • College of Engineering and Applied Sciences, Nanjing University, Nanjing 210093, Jiangsu, China
  • show less
    References(90)

    [1] He Z Q, Ren L Y, Zhuang B et al. Single optical fiber imaging technology[J]. Laser & Optoelectronics Progress, 54, 030005(2017).

    [2] Shin J, Tran D N, Stroud J R et al. A minimally invasive lens-free computational microendoscope[J]. Science Advances, 5, eaaw5595(2019).

    [3] Mekhail S P, Abudukeyoumu N, Ward J et al. Fiber-bundle-basis sparse reconstruction for high resolution wide-field microendoscopy[J]. Biomedical Optics Express, 9, 1843-1851(2018).

    [4] Gan Y, Liu H L, Gao J J et al. Sampling scheme for far-end optical field reconstruction of multimode fiber (invited)[J]. Infrared and Laser Engineering, 51, 20220072(2022).

    [5] Lu S, Tan Z W, Liu Y et al. Realization of recognition for multi-mode optical fiber transmission speckle using neural network[J]. Acta Optica Sinica, 40, 1306001(2020).

    [6] Myaing M T, MacDonald D J, Li X D. Fiber-optic scanning two-photon fluorescence endoscope[J]. Optics Letters, 31, 1076-1078(2006).

    [7] Engelbrecht C J, Johnston R S, Seibel E J et al. Ultra-compact fiber-optic two-photon microscope for functional fluorescence imaging in vivo[J]. Optics Express, 16, 5556-5564(2008).

    [8] Li J W, Thiele S, Quirk B C et al. Ultrathin monolithic 3D printed optical coherence tomography endoscopy for preclinical and clinical use[J]. Light: Science & Applications, 9, 1-10(2020).

    [9] Jiao S L, Yu W R, Stoica G et al. Optical-fiber-based Mueller optical coherence tomography[J]. Optics Letters, 28, 1206-1208(2003).

    [10] Flusberg B A, Cocker E D, Piyawattanametha W et al. Fiber-optic fluorescence imaging[J]. Nature Methods, 2, 941-950(2005).

    [11] Huo L, Xi J F, Wu Y C et al. Forward-viewing resonant fiber-optic scanning endoscope of appropriate scanning speed for 3D OCT imaging[J]. Optics Express, 18, 14375-14384(2010).

    [12] Yariv A. On transmission and recovery of three-dimensional image information in optical waveguides[J]. Journal of the Optical Society of America A, 66, 301-306(1976).

    [13] Fischer B, Sternklar S. Image transmission and interferometry with multimode fibers using self‐pumped phase conjugation[J]. Applied Physics Letters, 46, 113-114(1985).

    [14] McMichael I, Yeh P, Beckwith P. Correction of polarization and modal scrambling in multimode fibers by phase conjugation[J]. Optics Letters, 12, 507-509(1987).

    [15] Yu Z P, Li H H, Zhong T T et al. Wavefront shaping: a versatile tool to conquer multiple scattering in multidisciplinary fields[J]. Innovation, 3, 100292(2022).

    [16] Mahalati R N, Gu R Y, Kahn J M. Resolution limits for imaging through multi-mode fiber[J]. Optics Express, 21, 1656-1668(2013).

    [17] Redding B, Popoff S M, Cao H. All-fiber spectrometer based on speckle pattern reconstruction[J]. Optics Express, 21, 6584-6600(2013).

    [18] Juarez A A, Krune E, Warm S et al. Modeling of mode coupling in multimode fibers with respect to bandwidth and loss[J]. Journal of Lightwave Technology, 32, 1549-1558(2014).

    [19] Lu C G, Cui Y P. Fiber Bragg grating spectra in multimode optical fibers[J]. Journal of Lightwave Technology, 24, 598-604(2006).

    [20] Snyder A, Love J[M]. Optical waveguide theory(2012).

    [21] Popoff S M, Lerosey G, Carminati R et al. Measuring the transmission matrix in optics: an approach to the study and control of light propagation in disordered media[J]. Physical Review Letters, 104, 100601(2010).

    [22] Bianchi S, Di Leonardo R. A multi-mode fiber probe for holographic micromanipulation and microscopy[J]. Lab on a Chip, 12, 635-639(2012).

    [23] Choi Y, Yoon C, Kim M et al. Scanner-free and wide-field endoscopic imaging by using a single multimode optical fiber[J]. Physical Review Letters, 109, 203901(2012).

    [24] Caravaca-Aguirre A M, Niv E, Conkey D B et al. Real-time resilient focusing through a bending multimode fiber[J]. Optics Express, 21, 12881-12887(2013).

    [25] Caravaca-Aguirre A M, Piestun R. Single multimode fiber endoscope[J]. Optics Express, 25, 1656-1665(2017).

    [26] Fan W R, Chen Z Y, Yakovlev V V et al. High-fidelity image reconstruction through multimode fiber via polarization-enhanced parametric speckle imaging[J]. Laser & Photonics Reviews, 15, 2000376(2021).

    [27] N’Gom M, Norris T B, Michielssen E et al. Mode control in a multimode fiber through acquiring its transmission matrix from a reference-less optical system[J]. Optics Letters, 43, 419-422(2018).

    [28] Deng L, Yan J D, Elson D S et al. Characterization of an imaging multimode optical fiber using a digital micro-mirror device based single-beam system[J]. Optics Express, 26, 18436-18447(2018).

    [29] Zhao T R, Ourselin S, Vercauteren T et al. Seeing through multimode fibers with real-valued intensity transmission matrices[J]. Optics Express, 28, 20978-20991(2020).

    [30] Vasquez-Lopez S A, Turcotte R, Koren V et al. Subcellular spatial resolution achieved for deep-brain imaging in vivo using a minimally invasive multimode fiber[J]. Light: Science & Applications, 7, 1-6(2018).

    [31] Turtaev S, Leite I T, Altwegg-Boussac T et al. High-fidelity multimode fibre-based endoscopy for deep brain in vivo imaging[J]. Light: Science & Applications, 7, 1-8(2018).

    [32] Loterie D, Farahi S, Papadopoulos I et al. Digital confocal microscopy through a multimode fiber[J]. Optics Express, 23, 23845-23858(2015).

    [33] Plöschner M, Kollárová V, Dostál Z et al. Multimode fibre: light-sheet microscopy at the tip of a needle[J]. Scientific Reports, 5, 1-7(2015).

    [34] Mezil S, Caravaca-Aguirre A M, Zhang E Z et al. Single-shot hybrid photoacoustic-fluorescent microendoscopy through a multimode fiber with wavefront shaping[J]. Biomedical Optics Express, 11, 5717-5727(2020).

    [35] Leite I T, Turtaev S, Boonzajer Flaes D E et al. Observing distant objects with a multimode fiber-based holographic endoscope[J]. APL Photonics, 6, 036112(2021).

    [36] Wen Z, Wang L Q, Zhang X H et al. Fast volumetric fluorescence imaging with multimode fibers[J]. Optics Letters, 45, 4931-4934(2020).

    [37] Stellinga D, Phillips D B, Mekhail S P et al. Time-of-flight 3D imaging through multimode optical fibers[J]. Science, 374, 1395-1399(2021).

    [38] Lee S Y, Parot V J, Bouma B E et al. Confocal 3D reflectance imaging through multimode fiber without wavefront shaping[J]. Optica, 9, 112-120(2022).

    [39] Papadopoulos I N, Farahi S, Moser C et al. Focusing and scanning light through a multimode optical fiber using digital phase conjugation[J]. Optics Express, 20, 10583-10590(2012).

    [40] Papadopoulos I N, Farahi S, Moser C et al. High-resolution, lensless endoscope based on digital scanning through a multimode optical fiber[J]. Biomedical Optics Express, 4, 260-270(2013).

    [41] Papadopoulos I N, Simandoux O, Farahi S et al. Optical-resolution photoacoustic microscopy by use of a multimode fiber[J]. Applied Physics Letters, 102, 211106(2013).

    [42] Morales-Delgado E E, Psaltis D, Moser C. Two-photon imaging through a multimode fiber[J]. Optics Express, 23, 32158-32170(2015).

    [43] Di Leonardo R, Bianchi S. Hologram transmission through multi-mode optical fibers[J]. Optics Express, 19, 247-254(2011).

    [44] Čižmár T, Dholakia K. Shaping the light transmission through a multimode optical fibre: complex transformation analysis and applications in biophotonics[J]. Optics Express, 19, 18871-18884(2011).

    [45] Yu H, Yao Z Y, Sui X B et al. Focusing through disturbed multimode optical fiber based on self-adaptive genetic algorithm[J]. Optik, 261, 169129(2022).

    [46] Cheng S F, Zhong T T, Woo C M et al. Long-distance pattern projection through an unfixed multimode fiber with natural evolution strategy-based wavefront shaping[J]. Optics Express, 30, 32565-32576(2022).

    [47] Yin Z, Liu G D, Chen F D et al. Fast-forming focused spots through a multimode fiber based on an adaptive parallel coordinate algorithm[J]. Chinese Optics Letters, 13, 071404(2015).

    [48] Chen H, Geng Y, Xu C F et al. Efficient light focusing through an MMF based on two-step phase shifting and parallel phase compensating[J]. Applied Optics, 58, 7552-7557(2019).

    [49] Geng Y, Chen H, Zhang Z K et al. High-speed focusing and scanning light through a multimode fiber based on binary phase-only spatial light modulation[J]. Applied Physics B, 127, 25(2021).

    [50] Amitonova L V, de Boer J F. Compressive imaging through a multimode fiber[J]. Optics Letters, 43, 5427-5430(2018).

    [51] Amitonova L V, de Boer J F. Endo-microscopy beyond the abbe and nyquist limits[J]. Light: Science & Applications, 9, 1-12(2020).

    [52] Abrashitova K, Amitonova L V. High-speed label-free multimode-fiber-based compressive imaging beyond the diffraction limit[J]. Optics Express, 30, 10456-10469(2022).

    [53] Fukui T, Kohno Y, Tang R et al. Single-pixel imaging using multimode fiber and silicon photonic phased array[J]. Journal of Lightwave Technology, 39, 839-844(2021).

    [54] Zhu R Z, Feng H G, Xiong Y F et al. All-fiber reflective single-pixel imaging with long working distance[J]. Optics & Laser Technology, 158, 108909(2023).

    [55] Dong Z Y, Wen Z, Pang C L et al. A modulated sparse random matrix for high-resolution and high-speed 3D compressive imaging through a multimode fiber[J]. Science Bulletin, 67, 1224-1228(2022).

    [56] Sun B, Edgar M P, Bowman R et al. 3D computational imaging with single-pixel detectors[J]. Science, 340, 844-847(2013).

    [57] Durán V, Clemente P, Fernández-Alonso M et al. Single-pixel polarimetric imaging[J]. Optics Letters, 37, 824-826(2012).

    [58] Jin S L, Hui W W, Wang Y L et al. Hyperspectral imaging using the single-pixel Fourier transform technique[J]. Scientific Reports, 7, 1-7(2017).

    [59] Liu Z T, Wang L L, Meng Y et al. All-fiber high-speed image detection enabled by deep learning[J]. Nature Communications, 13, 1-8(2022).

    [60] Caravaca-Aguirre A M, Singh S, Labouesse S et al. Hybrid photoacoustic-fluorescence microendoscopy through a multimode fiber using speckle illumination[J]. APL Photonics, 4, 096103(2019).

    [61] Jordan M I, Mitchell T M. Machine learning: trends, perspectives, and prospects[J]. Science, 349, 255-260(2015).

    [62] Meng L, Hu H F, Hu J Z et al. Image reconstruction of multimode fiber scattering media based on deep learning[J]. Chinese Journal of Lasers, 47, 1206005(2020).

    [63] Aisawa S, Noguchi K, Matsumoto T. Remote image classification through multimode optical fiber using a neural network[J]. Optics Letters, 16, 645-647(1991).

    [64] Marusarz R K, Sayeh M R. Neural network-based multimode fiber-optic information transmission[J]. Applied Optics, 40, 219-227(2001).

    [65] Rahmani B, Loterie D, Konstantinou G et al. Multimode optical fiber transmission with a deep learning network[J]. Light: Science & Applications, 7, 1-11(2018).

    [66] Borhani N, Kakkava E, Moser C et al. Learning to see through multimode fibers[J]. Optica, 5, 960-966(2018).

    [67] Yu Z M, Ju Z Y, Zhang X L et al. High-speed multimode fiber imaging system based on conditional generative adversarial network[J]. Chinese Optics Letters, 19, 081101(2021).

    [68] Song B B, Jin C, Wu J X et al. Deep learning image transmission through a multimode fiber based on a small training dataset[J]. Optics Express, 30, 5657-5672(2022).

    [69] Caramazza P, Moran O, Murray-Smith R et al. Transmission of natural scene images through a multimode fibre[J]. Nature Communications, 10, 2029(2019).

    [70] Zhu C Y, Chan E A, Wang Y et al. Image reconstruction through a multimode fiber with a simple neural network architecture[J]. Scientific Reports, 11, 1-10(2021).

    [71] Wang L L, Yang Y S, Liu Z T et al. High-speed all-fiber micro-imaging with large depth of field[J]. Laser & Photonics Reviews, 16, 2100724(2022).

    [72] Zhu R Z, Feng H G, Xu F. Deep learning-based multimode fiber imaging in multispectral and multipolarimetric channels[J]. Optics and Lasers in Engineering, 161, 107386(2023).

    [73] Farahi S, Ziegler D, Papadopoulos I N et al. Dynamic bending compensation while focusing through a multimode fiber[J]. Optics Express, 21, 22504-22514(2013).

    [74] Gu R Y, Mahalati R N, Kahn J M. Design of flexible multi-mode fiber endoscope[J]. Optics Express, 23, 26905-26918(2015).

    [75] Gordon G S, Gataric M, Ramos A G C et al. Characterizing optical fiber transmission matrices using metasurface reflector stacks for lensless imaging without distal access[J]. Physical Review X, 9, 041050(2019).

    [76] Li S H, Horsley S A R, Tyc T et al. Memory effect assisted imaging through multimode optical fibres[J]. Nature Communications, 12, 1-13(2021).

    [77] Plöschner M, Tyc T, Čižmár T. Seeing through chaos in multimode fibres[J]. Nature Photonics, 9, 529-535(2015).

    [78] Loterie D, Psaltis D, Moser C. Bend translation in multimode fiber imaging[J]. Optics Express, 25, 6263-6273(2017).

    [79] Lan M Y, Xiang Y Y, Li J H et al. Averaging speckle patterns to improve the robustness of compressive multimode fiber imaging against fiber bend[J]. Optics Express, 28, 13662-13669(2020).

    [80] Yang D Y, Hao M, Wu G H et al. Single multimode fiber imaging based on low-rank recovery[J]. Optics and Lasers in Engineering, 149, 106827(2022).

    [81] Fan P F, Zhao T R, Su L. Deep learning the high variability and randomness inside multimode fibers[J]. Optics Express, 27, 20241-20258(2019).

    [82] Resisi S, Popoff S M, Bromberg Y. Image transmission through a dynamically perturbed multimode fiber by deep learning[J]. Laser & Photonics Reviews, 15, 2000553(2021).

    [83] Bagley N, Kremp T, Lamb E S et al. Transfer learning and generalization of a neural-network-based multimode fiber position and imaging sensor under thermal perturbations[J]. Optical Fiber Technology, 70, 102855(2022).

    [84] Fan P F, Wang Y F, Ruddlesden M et al. Deep learning enabled scalable calibration of a dynamically deformed multimode fiber[J]. Advanced Photonics Research, 3, 2100304(2022).

    [85] Liu Y F, Yu P P, Wu Y J et al. Single-shot wide-field imaging in reflection by using a single multimode fiber[J]. Applied Physics Letters, 122, 063701(2023).

    [86] Zhang X H, Wen Z, Ma Y G et al. High contrast multimode fiber imaging based on wavelength modulation[J]. Applied Optics, 59, 6677-6681(2020).

    [87] Loterie D, Goorden S A, Psaltis D et al. Confocal microscopy through a multimode fiber using optical correlation[J]. Optics Letters, 40, 5754-5757(2015).

    [88] Desroches J, Pagnoux D, Louradour F et al. Fiber-optic device for endoscopic polarization imaging[J]. Optics Letters, 34, 3409-3411(2009).

    [89] Huang L Q, Luo R C, Liu X et al. Spectral imaging with deep learning[J]. Light: Science & Applications, 11, 1-19(2022).

    [90] Buckley C, Fabert M, Kinet D et al. Design of an endomicroscope including a resonant fiber-based microprobe dedicated to endoscopic polarimetric imaging for medical diagnosis[J]. Biomedical Optics Express, 11, 7032-7052(2020).

    Tools

    Get Citation

    Copy Citation Text

    Runze Zhu, Fei Xu. Multimode Fiber Imaging Based on Temporal-Spatial Information Extraction[J]. Laser & Optoelectronics Progress, 2023, 60(11): 1106011

    Download Citation

    EndNote(RIS)BibTexPlain Text
    Save article for my favorites
    Paper Information

    Category: Fiber Optics and Optical Communications

    Received: Feb. 27, 2023

    Accepted: Apr. 10, 2023

    Published Online: Jun. 7, 2023

    The Author Email: Xu Fei (feixu@nju.edu.cn)

    DOI:10.3788/LOP230726

    Topics