Deep Neural Network-Based High-Throughput Information Transmission Technology Using Multimode Fibers (Invited)

Tuqiang Pan; Zihao Ma; Wenwen Li; Yuwen Xiong; Wuping Xie; Yi Xu; Yuwen Qin

doi:10.3788/LOP251013

Laser & Optoelectronics Progress, Volume. 62, Issue 17, 1739015(2025)

Deep Neural Network-Based High-Throughput Information Transmission Technology Using Multimode Fibers (Invited)

Tuqiang Pan^1,2,3, Zihao Ma^1,2,3, Wenwen Li^1,2,3, Yuwen Xiong^1,2,3, Wuping Xie^1,2,3, Yi Xu^1,2,3、*, and Yuwen Qin^1,2,3、**

Author Affiliations

¹Institute of Advanced Photonic Technology, School of Information Engineering, Guangdong University of Technology, Guangzhou 510006, Guangdong , China

²Key Laboratory of Photonic Technology for Integrated Sensing and Communication, Ministry of Education, Guangdong University of Technology, Guangzhou 510006, Guangdong , China

³Guangdong Provincial Key Laboratory of Information Photonics Technology, Guangdong University of Technology, Guangzhou 510006, Guangdong , China

show less

Abstract Get PDF(in Chinese)

References(60)

[1] Zhao Q, Yu P P, Liu Y F et al. Light field imaging through a single multimode fiber for OAM-multiplexed data transmission[J]. Applied Physics Letters, 116, 181101(2020).

[2] Liu Y F, Zhang Z S, Yu P P et al. Learning-enabled recovering scattered data from twisted light transmitted through a long standard multimode fiber[J]. Applied Physics Letters, 120, 131101(2022).

[3] Luo J W, Liang J J, Wu D X et al. Simultaneous dual-channel data transmission through a multimode fiber via wavefront shaping[J]. Applied Physics Letters, 123, 151106(2023).

[4] Liu Y F, Yu P P, Wu Y J et al. Single-shot wide-field imaging in reflection by using a single multimode fiber[J]. Applied Physics Letters, 122, 063701(2023).

[5] Wen Z, Dong Z Y, Deng Q L et al. Single multimode fibre for in vivo light-field-encoded endoscopic imaging[J]. Nature Photonics, 17, 679-687(2023).

[6] Gong L, Zhao Q, Zhang H et al. Optical orbital-angular-momentum-multiplexed data transmission under high scattering[J]. Light: Science & Applications, 8, 27(2019).

[7] Yu Z P, Li H H, Zhong T T et al. Enhancing spatiotemporal focusing of light deep inside scattering media with Time-Gated Reflection Matrix[J]. Light: Science & Applications, 11, 167(2022).

[8] Cheng S F, Zhang X Y, Zhong T T et al. Nonconvex optimization for optimum retrieval of the transmission matrix of a multimode fiber[J]. Advanced Photonics Nexus, 2, 066005(2023).

[9] Zhong J S, Wen Z, Li Q Z et al. Efficient reference-less transmission matrix retrieval for a multimode fiber using fast Fourier transform[J]. Advanced Photonics Nexus, 2, 056007(2023).

[10] He Q, Shao R J, Qu Y et al. Complex transmission matrix retrieval for a highly scattering medium via regional phase differentiation[J]. Photonics Research, 12, 876-883(2024).

[11] Zeng J Y, Zhao W J, Zhai A P et al. Tight focusing through scattering media via a Bessel-basis transmission matrix[J]. Optics Letters, 49, 698-701(2024).

[12] Yu Z P, Li H H, Zhong T T et al. Wavefront shaping: a versatile tool to conquer multiple scattering in multidisciplinary fields[J]. The Innovation, 3, 100292(2022).

[13] Pak M, Kim S. A review of deep learning in image recognition[C], 1-3(2017).

[14] Hassan D, Domínguez J, Midtvedt B et al. Cross-modality transformations in biological microscopy enabled by deep learning[J]. Advanced Photonics, 6, 064001(2024).

[15] Nassif A B, Shahin I, Attili I et al. Speech recognition using deep neural networks: a systematic review[J]. IEEE Access, 7, 19143-19165(2019).

[16] Otter D W, Medina J R, Kalita J K. A survey of the usages of deep learning for natural language processing[J]. IEEE Transactions on Neural Networks and Learning Systems, 32, 604-624(2021).

[17] Zhou S K, Greenspan H, Davatzikos C et al. A review of deep learning in medical imaging: Imaging traits, technology trends, case studies with progress highlights, and future promises[J]. Proceedings of the IEEE, 109, 820-838(2021).

[18] Henrique B M, Sobreiro V A, Kimura H. Literature review: Machine learning techniques applied to financial market prediction[J]. Expert Systems with Applications, 124, 226-251(2019).

[19] Carleo G, Troyer M. Solving the quantum many-body problem with artificial neural networks[J]. Science, 355, 602-606(2017).

[20] Christiansen E M, Yang S J, Ando D M et al. In silico labeling: predicting fluorescent labels in unlabeled images[J]. Cell, 173, 792-803(2018).

[21] Carleo G, Cirac I, Cranmer K et al. Machine learning and the physical sciences[J]. Reviews of Modern Physics, 91, 045002(2019).

[22] Barbastathis G, Ozcan A, Situ G H. On the use of deep learning for computational imaging[J]. Optica, 6, 921-943(2019).

[23] Zuo C, Qian J M, Feng S J et al. Deep learning in optical metrology: a review[J]. Light: Science & Applications, 11, 39(2022).

[24] Huang Z Z, Cao L C. Deep learning sheds new light on non-orthogonal optical multiplexing[J]. Light: Science & Applications, 13, 105(2024).

[25] Li Y Z, Xue Y J, Tian L. Deep speckle correlation: a deep learning approach toward scalable imaging through scattering media[J]. Optica, 5, 1181-1190(2018).

[26] Zhu S, Guo E L, Gu J et al. Imaging through unknown scattering media based on physics-informed learning[J]. Photonics Research, 9, B210-B219(2021).

[27] Loterie D, Farahi S, Papadopoulos I et al. Digital confocal microscopy through a multimode fiber[J]. Optics Express, 23, 23845-23858(2015).

[28] Yang J M, Li L S, He Q Z et al. An ultrahigh-fidelity 3D holographic display using scattering to homogenize the angular spectrum[J]. Science Advances, 9, eadi9987(2023).

[29] Liu H T, Ye J W, Xu P B et al. Vectorial holography over a multimode fiber[J]. Optics Letters, 49, 1798-1801(2024).

[30] Yu L Y, You S X. High-fidelity and high-speed wavefront shaping by leveraging complex media[J]. Science Advances, 10, eadn2846(2024).

[31] Zhuang J H, Yu P P, Liu Y F et al. Dynamic 3D holographic projection of vectorial images with a multimode fiber[J]. Photonics Research, 12, 1344-1350(2024).

[32] Yu P P, Liu Y F, Wu Y J et al. Large-FOV scattering-assisted holographic projection by enhanced sampling of transmission matrix[J]. Applied Physics Letters, 122, 061104(2023).

[33] Tong X, Xu R J, Xu P F et al. Harnessing the magic of light: spatial coherence instructed swin transformer for universal holographic imaging[J]. Advanced Photonics, 5, 066003(2023).

[34] Rahmani B, Loterie D, Kakkava E et al. Actor neural networks for the robust control of partially measured nonlinear systems showcased for image propagation through diffuse media[J]. Nature Machine Intelligence, 2, 403-410(2020).

[35] Wang J, Zhong G C, Wu D X et al. Multimode fiber-based greyscale image projector enabled by neural networks with high generalization ability[J]. Optics Express, 31, 4839-4850(2023).

[36] Gover A, Lee C P, Yariv A. Direct transmission of pictorial information in multimode optical fibers[J]. Journal of the Optical Society of America, 66, 306-311(1976).

[37] Ye J W, Pan T Q, Zheng K P et al. Light field information transmission through scattering media with high fidelity[J]. Chinese Optics Letters, 21, 121101(2023).

[38] Borhani N, Kakkava E, Moser C et al. Learning to see through multimode fibers[J]. Optica, 5, 960-966(2018).

[39] Rahmani B, Loterie D, Konstantinou G et al. Multimode optical fiber transmission with a deep learning network[J]. Light: Science & Applications, 7, 69(2018).

[40] Zhang L H, Xu R C, Ye H L et al. High definition images transmission through single multimode fiber using deep learning and simulation speckles[J]. Optics and Lasers in Engineering, 140, 106531(2021).

[41] Tang P S, Zheng K P, Yuan W M et al. Learning to transmit images through optical speckle of a multimode fiber with high fidelity[J]. Applied Physics Letters, 121, 081107(2022).

[42] Xu R C, Zhang L H, Chen Z Y et al. High accuracy transmission and recognition of complex images through multimode fibers using deep learning[J]. Laser & Photonics Reviews, 17, 2200339(2023).

[43] Mitton J, Mekhail S P, Padgett M et al. Bessel equivariant networks for inversion of transmission effects in multi-mode optical fibres[EB/OL]. https://arxiv.org/abs/2207.12849v2

[44] Caramazza P, Moran O, Murray-Smith R et al. Transmission of natural scene images through a multimode fibre[J]. Nature Communications, 10, 2029(2019).

[45] Liu Z T, Wang L L, Meng Y et al. All-fiber high-speed image detection enabled by deep learning[J]. Nature Communications, 13, 1433(2022).

[46] Wang L L, Yang Y S, Liu Z T et al. High-speed all-fiber micro-imaging with large depth of field[J]. Laser & Photonics Reviews, 16, 2100724(2022).

[47] Resisi S, Popoff S M, Bromberg Y. Image transmission through a dynamically perturbed multimode fiber by deep learning[J]. Laser & Photonics Reviews, 15, 2000553(2021).

[48] Fan P F, Ruddlesden M, Wang Y F et al. Learning enabled continuous transmission of spatially distributed information through multimode fibers[J]. Laser & Photonics Reviews, 15, 2000348(2021).

[49] Zhang S Q, Wang Q H, Zhou W et al. Spatial pilot-aided fast-adapted framework for stable image transmission over long multi-mode fiber[J]. Optics Express, 31, 37968-37979(2023).

[50] Li Z W, Zhou W, Zhou Z H et al. Self-supervised dynamic learning for long-term high-fidelity image transmission through unstabilized diffusive media[J]. Nature Communications, 15, 1498(2024).

[51] Zhu R Z, Luo J X, Zhou X X et al. Anti-perturbation multimode fiber imaging based on the active measurement of the fiber configuration[J]. ACS Photonics, 10, 3476-3483(2023).

[52] Fan W R, Chen T R, Xu X Q et al. Single-shot recognition of 3D phase images with deep learning[J]. Laser & Photonics Reviews, 16, 2100719(2022).

[53] Zhu R Z, Feng H G, Xu F. Deep learning-based multimode fiber imaging in multispectral and multipolarimetric channels[J]. Optics and Lasers in Engineering, 161, 107386(2023).

[54] Pan T Q, Ye J W, Liu H T et al. Non-orthogonal optical multiplexing empowered by deep learning[J]. Nature Communications, 15, 1580(2024).

[55] Tu H S, Liu H T, Pan T Q et al. Deep empirical neural network for optical phase retrieval over a scattering medium[J]. Nature Communications, 16, 1369(2025).

[56] Wang L L, Qi T C, Liu Z T et al. Complex pattern transmission through multimode fiber under diverse light sources[J]. APL Photonics, 7, 106104(2022).

[57] Chen Y C, Song B B, Wu J X et al. Deep learning for efficiently imaging through the localized speckle field of a multimode fiber[J]. Applied Optics, 62, 266-274(2023).

[58] Zhang Y, Gong Z B, Wei Y et al. Image transmission through a multimode fiber based on transfer learning[J]. Optical Fiber Technology, 79, 103362(2023).

[59] Feng Z F, Yue Z Q, Zhou W et al. Optimizing anti-perturbation capability in single-shot wide-field multimode fiber imaging systems[J]. Applied Physics Letters, 124, 101112(2024).

[60] Yu H Y, Huang Z H, Lamon S et al. All-optical image transportation through a multimode fibre using a miniaturized diffractive neural network on the distal facet[J]. Nature Photonics, 19, 486-493(2025).

Tools

Get Citation

Copy Citation Text

Tuqiang Pan, Zihao Ma, Wenwen Li, Yuwen Xiong, Wuping Xie, Yi Xu, Yuwen Qin. Deep Neural Network-Based High-Throughput Information Transmission Technology Using Multimode Fibers (Invited)[J]. Laser & Optoelectronics Progress, 2025, 62(17): 1739015

Download Citation

EndNote(RIS)BibTex Plain Text

Set citation alerts for article

Save article for my favorites

Paper Information

Category: AI for Optics

Received: Apr. 16, 2025

Accepted: May. 22, 2025

Published Online: Sep. 12, 2025

The Author Email: Yi Xu (yixu@gdut.edu.cn), Yuwen Qin (qinyw@gdut.edu.cn)

DOI:10.3788/LOP251013

CSTR:32186.14.LOP251013

Topics

laser devices and laser physics

Lasers and Laser Optics

Laser physics

laser manufacturing

Instrumentation, Measurement and Metrology