Journals Articles Conferences News About CLP
Submit a paper Email Alert
Search
Search
Articles
Journals
News
Advanced Search
Top Searches
2D MaterialsTransformation opticsQuantum PhotonicsSmall lasersSemiconductor UV PhotonicsSupersymmetric microring laser arrays

Acta Optica Sinica, Volume. 45, Issue 17, 1720012(2025)

Progress of Optical Neural Networks (Invited)

Bojie Dong1, Xiaoyu Li1, Yichi Zhang1,2, Bohao Zhang1,3, Zixuan Wang4, Wenya Gao1, Yanyu Gao1, Qi Jia1, Xiaoxin Li1, Bojian Shi1, Yanxia Zhang1, Rui Feng1, Yongyin Cao1, Fangkui Sun1, and Weiqiang Ding1,5、*
Author Affiliations
  • 1Institute of Advanced Photonics, School of Physics, Harbin Institute of Technology, Harbin 150001, Heilongjiang , China
  • 2Department of Optical Science and Engineering, School of Information Science and Technology, Fudan University, Shanghai 200433, China
  • 3Department of Optica and Optical Engineering, School of Physical Sciences, University of Science and Technology of China, Hefei 230026, Anhui , China
  • 4Faculty of Computing, Harbin Institute of Technology, Harbin 150001, Heilongjiang , China
  • 5Collaborative Innovation Center of Extreme Optics, Shanxi University, Taiyuan 030006, Shanxi , China
    • show less
    AbstractGet PDF(in Chinese)
    Figures&Tables (13)
    Equations (0)
    References (123)
    Tools
    Paper Information
    Topics
    References(123)

    [1] LeCun Y, Bengio Y, Hinton G. Deep learning[J]. Nature, 521, 436-444(2015).

    [2] Duan Z P, Yang Y, Zhou R Q et al. Ultra-robust imaging restoration of intrinsic deterioration in graded-index imaging systems enabled by classified-cascaded convolutional neural networks[J]. Advanced Imaging, 1, 021003(2024).

    [3] Lu H T, Zhang Q C. Applications of deep convolutional neural network in computer vision[J]. Journal of Data Acquisition and Processing, 31, 1-17(2018).

    [4] Chen S. Research of deep learning neural networks applications in speech recognition[D](2013).

    [5] Li Z J, Fan Y, Wu X J. Survey of natural language processing pre-training techniques[J]. Computer Science, 47, 162-173(2020).

    [6] Li C L, Liu D J, Dai D X. Multimode silicon photonics[J]. Nanophotonics, 8, 227-247(2019).

    [7] Abbe E. Beiträge zur theorie des mikroskops und der mikroskopischen wahrnehmung[J]. Archiv Für Mikroskopische Anatomie, 9, 413-468(1873).

    [8] Goodman J W, Dias A R, Woody L M. Fully parallel, high-speed incoherent optical method for performing discrete Fourier transforms[J]. Optics Letters, 2, 1-3(1978).

    [9] Psaltis D, Farhat N. Optical information processing based on an associative-memory model of neural nets with thresholding and feedback[J]. Optics Letters, 10, 98-100(1985).

    [10] Jenkins B K, Sawchuk A A, Strand T C et al. Sequential optical logic implementation[J]. Applied Optics, 23, 3455-3464(1984).

    [11] Xu Z H, Zhou T K, Ma M Z et al. Large-scale photonic chiplet Taichi empowers 160-TOPS/W artificial general intelligence[J]. Science, 384, 202-209(2024).

    [12] Ahmed S R, Baghdadi R, Bernadskiy M et al. Universal photonic artificial intelligence acceleration[J]. Nature, 640, 368-374(2025).

    [13] Lin X, Rivenson Y, Yardimci N T et al. All-optical machine learning using diffractive deep neural networks[J]. Science, 361, 1004-1008(2018).

    [14] Li J X, Mengu D, Luo Y et al. Class-specific differential detection in diffractive optical neural networks improves inference accuracy[J]. Advanced Photonics, 1, 046001(2019).

    [15] Yan T, Wu J M, Zhou T K et al. Fourier-space diffractive deep neural network[J]. Physical Review Letters, 123, 023901(2019).

    [16] Mengu D, Zhao Y F, Yardimci N T et al. Misalignment resilient diffractive optical networks[J]. Nanophotonics, 9, 4207-4219(2020).

    [17] Rahman M S S, Li J X, Mengu D et al. Ensemble learning of diffractive optical networks[J]. Light: Science & Applications, 10, 14(2021).

    [18] Luo X H, Hu Y Q, Ou X N et al. Metasurface-enabled on-chip multiplexed diffractive neural networks in the visible[J]. Light: Science & Applications, 11, 158(2022).

    [19] He C, Zhao D, Fan F et al. Pluggable multitask diffractive neural networks based on cascaded metasurfaces[J]. Opto-Electronic Advances, 7, 230005(2024).

    [20] Fang X Y, Hu X N, Li B L et al. Orbital angular momentum-mediated machine learning for high-accuracy mode-feature encoding[J]. Light: Science & Applications, 13, 49(2024).

    [21] Spall J, Guo X X, Lvovsky A I. Training neural networks with end-to-end optical backpropagation[J]. Advanced Photonics, 7, 016004(2025).

    [22] Shen Y C, Harris N C, Skirlo S et al. Deep learning with coherent nanophotonic circuits[J]. Nature Photonics, 11, 441-446(2017).

    [23] Feldmann J, Youngblood N, Wright C D et al. All-optical spiking neurosynaptic networks with self-learning capabilities[J]. Nature, 569, 208-214(2019).

    [24] Bangari V, Marquez B A, Miller H et al. Digital electronics and analog photonics for convolutional neural networks (DEAP-CNNs)[J]. IEEE Journal of Selected Topics in Quantum Electronics, 26, 7701213(2020).

    [25] Feldmann J, Youngblood N, Karpov M et al. Parallel convolutional processing using an integrated photonic tensor core[J]. Nature, 589, 52-58(2021).

    [26] Ashtiani F, Geers A J, Aflatouni F. An on-chip photonic deep neural network for image classification[J]. Nature, 606, 501-506(2022).

    [27] Dong B W, Aggarwal S, Zhou W et al. Higher-dimensional processing using a photonic tensor core with continuous-time data[J]. Nature Photonics, 17, 1080-1088(2023).

    [28] Wu W, Zhou T K, Fang L. Parallel photonic chip for nanosecond end-to-end image processing, transmission, and reconstruction[J]. Optica, 11, 831-837(2024).

    [29] Meng X Y, Shi N N, Zhang G J et al. High-integrated photonic tensor core utilizing high-dimensional lightwave and microwave multidomain multiplexing[J]. Light: Science & Applications, 14, 27(2025).

    [30] Fu T Z, Sun R, Huang Y Y et al. Review of on‑chip integrated optical neural networks (invited)[J]. Chinese Journal of Lasers, 51, 0119002(2024).

    [31] Chang J L, Sitzmann V, Dun X et al. Hybrid optical-electronic convolutional neural networks with optimized diffractive optics for image classification[J]. Scientific Reports, 8, 12324(2018).

    [32] Song A, Murty Kottapalli S N, Goyal R et al. Low-power scalable multilayer optoelectronic neural networks enabled with incoherent light[J]. Nature Communications, 15, 10692(2024).

    [33] Zhu Y, Xu L, Hua X et al. Silicon photonics convolution accelerator based on coherent chips with sub-1 pJ/MAC power consumption[J]. Photonics Research, 13, 497-510(2025).

    [34] Qiu J M, Lu G Q, Liu T T et al. Optoelectronic generative adversarial networks[J]. Communications Physics, 8, 162(2025).

    [35] Reck M, Zeilinger A, Bernstein H J et al. Experimental realization of any discrete unitary operator[J]. Physical Review Letters, 73, 58-61(1994).

    [36] Ji R Q, Zhang L, Tian Y H et al. On-chip CMOS-compatible optical signal processor[C], 1-3(2012).

    [37] Du Z C, Liao K, Dai T X et al. Ultracompact and multifunctional integrated photonic platform[J]. Science Advances, 10, eadm7569(2024).

    [38] Wang Y Z, Yu A X, Cheng Y Y et al. Matrix diffractive deep neural networks merging polarization into meta-devices[J]. Laser & Photonics Reviews, 18, 2300903(2024).

    [39] Jia Q, Shi B J, Zhang Y X et al. Partially coherent diffractive optical neural network[J]. Optica, 11, 1742-1749(2024).

    [40] Dong B W, Brückerhoff-Plückelmann F, Meyer L et al. Partial coherence enhances parallelized photonic computing[J]. Nature, 632, 55-62(2024).

    [41] Wang J, Chen J, Yu F L et al. Unlocking ultra-high holographic information capacity through nonorthogonal polarization multiplexing[J]. Nature Communications, 15, 6284(2024).

    [42] Xu X Y, Han W W, Tan M X et al. Neuromorphic computing based on wavelength-division multiplexing[J]. IEEE Journal of Selected Topics in Quantum Electronics, 29, 7400112(2023).

    [43] Flower C J, Mehrabad M J, Xu L D et al. Observation of topological frequency combs[J]. Science, 384, 1356-1361(2024).

    [44] Chen B, Zhou Y G, Liu Y et al. Integrated optical vortex microcomb[J]. Nature Photonics, 18, 625-631(2024).

    [45] Augustin L M, Santos R, den Haan E et al. InP-based generic foundry platform for photonic integrated circuits[J]. IEEE Journal of Selected Topics in Quantum Electronics, 24, 6100210(2018).

    [46] Vissers E, Poelman S, de Beeck C O et al. Hybrid integrated mode-locked laser diodes with a silicon nitride extended cavity[J]. Optics Express, 29, 15013-15022(2021).

    [47] Zhang M, Buscaino B, Wang C et al. Broadband electro-optic frequency comb generation in a lithium niobate microring resonator[J]. Nature, 568, 373-377(2019).

    [48] Wang C G, Xu W Y, Li C et al. Integrated and DC-powered superconducting microcomb[J]. Nature Communications, 15, 4009(2024).

    [49] Chen G X, Ruan Z L, Wang Z et al. Four-channel CWDM device on a thin-film lithium niobate platform using an angled multimode interferometer structure[J]. Photonics Research, 10, 8-13(2022).

    [50] Liu Y, Huang X R, Guan H et al. C-band four-channel CWDM (de-) multiplexers on a thin film lithium niobate‒silicon rich nitride hybrid platform[J]. Optics Letters, 46, 4726-4729(2021).

    [51] Yu Y, Yu Z J, Zhang Z Y et al. Wavelength-division multiplexing on an etchless lithium niobate integrated platform[J]. ACS Photonics, 9, 3253-3259(2022).

    [52] Sun R, Fu T Z, Huang Y Y et al. Multimode diffractive optical neural network[J]. Advanced Photonics Nexus, 3, 026007(2024).

    [53] Wu C M, Yu H S, Lee S et al. Programmable phase-change metasurfaces on waveguides for multimode photonic convolutional neural network[J]. Nature Communications, 12, 96(2021).

    [54] Meng W J, Fröch J E, Cheng K et al. Ultranarrow-linewidth wavelength-vortex metasurface holography[J]. Science Advances, 11, eadt9159(2025).

    [55] Ma Z Y, Tian T, Liao Y X et al. Electrically switchable 2N-channel wave-front control for certain functionalities with N cascaded polarization-dependent metasurfaces[J]. Nature Communications, 15, 8370(2024).

    [56] Li X X, Feng R, Sun F K et al. Simultaneous sorting of arbitrary vector structured beams with spin-multiplexed diffractive metasurfaces[J]. Advanced Photonics Nexus, 3, 036010(2024).

    [57] Zhou S Y, Li L, Wang Y et al. Intelligent tailoring of a broadband orbital angular momentum comb towards efficient optical convolution[J]. Photonics Research, 13, 1148-1157(2025).

    [58] Savory S J, Gavioli G, Killey R I et al. Transmission of 42.8Gbit/s polarization multiplexed NRZ-QPSK over 6400 km of standard fiber with no optical dispersion compensation[C], 1-3(2007).

    [59] Khorasaninejad M, Zhu A Y, Roques-Carmes C et al. Polarization-insensitive metalenses at visible wavelengths[J]. Nano Letters, 16, 7229-7234(2016).

    [60] Feng R, Wang H, Cao Y Y et al. A modular design of continuously tunable full color plasmonic pixels with broken rotational symmetry[J]. Advanced Functional Materials, 32, 2108437(2022).

    [61] Balthasar Mueller J P, Rubin N A, Devlin R C et al. Metasurface polarization optics: independent phase control of arbitrary orthogonal states of polarization[J]. Physical Review Letters, 118, 113901(2017).

    [62] Li X X, Shi B J, Jia Q et al. Diffractive metasurface-enabled single-shot characterization of hybrid-order poincaré beams[J]. Advanced Optical Materials, 13, 2403405(2025).

    [63] Miscuglio M, Sorger V J. Photonic tensor cores for machine learning[J]. Applied Physics Reviews, 7, 031404(2020).

    [64] Picco E, Antonik P, Massar S. High speed human action recognition using a photonic reservoir computer[J]. Neural Networks, 165, 662-675(2023).

    [65] Du S Y, Zhang J, Ouyang H et al. Scalable parallel photonic processing unit for various neural network accelerations[J]. Photonics Research, 12, 2691-2702(2024).

    [66] Xu X Y, Tan M X, Corcoran B et al. 11 TOPS photonic convolutional accelerator for optical neural networks[J]. Nature, 589, 44-51(2021).

    [67] Chen Z J, Sludds A, Davis R et al. Deep learning with coherent VCSEL neural networks[J]. Nature Photonics, 17, 723-730(2023).

    [68] Wang D L, Nie Y K, Hu G L et al. Ultrafast silicon photonic reservoir computing engine delivering over 200 TOPS[J]. Nature Communications, 15, 10841(2024).

    [69] He G L, Zheng Y Q, Zhou C D et al. Multiplexed manipulation of orbital angular momentum and wavelength in metasurfaces based on arbitrary complex-amplitude control[J]. Light: Science & Applications, 13, 98(2024).

    [70] Chi H B, Hu Y Q, Ou X N et al. Neural network-assisted end-to-end design for full light field control of meta-optics[J]. Advanced Materials, 37, e2419621(2025).

    [71] Feng R, Tian Y K, Liu Y L et al. Polarization-multiplexed optical differentiation using topological metasurfaces[J]. Opto-Electronic Engineering, 50, 230172(2023).

    [72] Liu Y L, Li X X, Shi B J et al. Polarization-independent, high-NA edge detection with nonlocal metasurfaces[J]. Optics Letters, 50, 3517-3520(2025).

    [73] Hu J T, Mengu D, Tzarouchis D C et al. Diffractive optical computing in free space[J]. Nature Communications, 15, 1525(2024).

    [74] Cui T J, Qi M Q, Wan X et al. Coding metamaterials, digital metamaterials and programmable metamaterials[J]. Light: Science & Applications, 3, e218(2014).

    [75] Bogaerts W, De Heyn P, Van Vaerenbergh T et al. Silicon microring resonators[J]. Laser & Photonics Reviews, 6, 47-73(2012).

    [76] Miller D A B. Self-configuring universal linear optical component[J]. Photonics Research, 1, 1-15(2013).

    [77] Ríos C, Youngblood N, Cheng Z G et al. In-memory computing on a photonic platform[J]. Science Advances, 5, eaau5759(2019).

    [78] Qu Y R, Zhu H Z, Shen Y C et al. Inverse design of an integrated-nanophotonics optical neural network[J]. Science Bulletin, 65, 1177-1183(2020).

    [79] Chi H X, Zang X F, Zhang T et al. Metasurface enabled multi-target and multi-wavelength diffraction neural networks[J]. Laser & Photonics Reviews, 19, 2401178(2025).

    [80] Fu T Z, Zang Y B, Huang Y Y et al. Photonic machine learning with on-chip diffractive optics[J]. Nature Communications, 14, 70(2023).

    [81] Zhu H H, Zou J, Zhang H et al. Space-efficient optical computing with an integrated chip diffractive neural network[J]. Nature Communications, 13, 1044(2022).

    [82] Bai B W, Yang Q P, Shu H W et al. Microcomb-based integrated photonic processing unit[J]. Nature Communications, 14, 66(2023).

    [83] Wang H, Hu Z X, Deng J H et al. All-optical ultrafast polarization switching with nonlinear plasmonic metasurfaces[J]. Science Advances, 10, eadk3882(2024).

    [84] Wang H, Hu J Q, Morandi A et al. Large-scale photonic computing with nonlinear disordered media[J]. Nature Computational Science, 4, 429-439(2024).

    [85] Zuo Y, Li B H, Zhao Y J et al. All-optical neural network with nonlinear activation functions[EB/OL]. https:∥arxiv.org/abs/1904.10819

    [86] Huang Z, Shi W X, Wu S K et al. Pre-sensor computing with compact multilayer optical neural network[J]. Science Advances, 10, eado8516(2024).

    [87] Wu T W, Li Y K, Ge L et al. Field-programmable photonic nonlinearity[J]. Nature Photonics, 19, 725-732(2025).

    [88] Zhou J X, Zhao J X, Wu Q Y et al. Nonlinear computational edge detection metalens[J]. Advanced Functional Materials, 32, 2204734(2022).

    [89] Yildirim M, Dinc N U, Oguz I et al. Nonlinear processing with linear optics[J]. Nature Photonics, 18, 1076-1082(2024).

    [90] Xia F, Kim K, Eliezer Y et al. Nonlinear optical encoding enabled by recurrent linear scattering[J]. Nature Photonics, 18, 1067-1075(2024).

    [91] Li Y H, Li J X, Ozcan A. Nonlinear encoding in diffractive information processing using linear optical materials[J]. Light: Science & Applications, 13, 173(2024).

    [92] Klopfer E, Lawrence M, Barton D R et al. Dynamic focusing with high-quality-factor metalenses[J]. Nano Letters, 20, 5127-5132(2020).

    [93] Müller J S, Morandi A, Grange R et al. Modeling of random quasi-phase-matching in birefringent disordered media[J]. Physical Review Applied, 15, 064070(2021).

    [94] Zhang S C, Chen J F, Liu C et al. A dark-line two-dimensional magneto-optical trap of 85Rb atoms with high optical depth[J]. Review of Scientific Instruments, 83, 073102(2012).

    [95] Tait A N, Nahmias M A, Shastri B J et al. Broadcast and weight: an integrated network for scalable photonic spike processing[J]. Journal of Lightwave Technology, 32, 4029-4041(2014).

    [96] Raeber T J, Zhao Z C, Murdoch B J et al. Resistive switching and transport characteristics of an all-carbon memristor[J]. Carbon, 136, 280-285(2018).

    [97] Jiang J, Shan X Y, Xu J Q et al. Retina-like chlorophyll heterojunction-based optoelectronic memristor with all-optically modulated synaptic plasticity enabling neuromorphic edge detection[J]. Advanced Functional Materials, 34, 2409677(2024).

    [98] Liu C, Ma Q, Luo Z J et al. A programmable diffractive deep neural network based on a digital-coding metasurface array[J]. Nature Electronics, 5, 113-122(2022).

    [99] Hughes T W, Minkov M, Shi Y et al. Training of photonic neural networks through in situ backpropagation and gradient measurement[J]. Optica, 5, 864-871(2018).

    [100] Zhou T K, Fang L, Yan T et al. In situ optical backpropagation training of diffractive optical neural networks[J]. Photonics Research, 8, 940-953(2020).

    [101] Pai S, Sun Z H, Hughes T W et al. Experimentally realized in situ backpropagation for deep learning in photonic neural networks[J]. Science, 380, 398-404(2023).

    [102] Spall J, Guo X X, Lvovsky A I. Hybrid training of optical neural networks[J]. Optica, 9, 803-811(2022).

    [103] Wright L G, Onodera T, Stein M M et al. Deep physical neural networks trained with backpropagation[J]. Nature, 601, 549-555(2022).

    [104] Xue Z W, Zhou T K, Xu Z H et al. Fully forward mode training for optical neural networks[J]. Nature, 632, 280-286(2024).

    [105] Momeni A, Rahmani B, Malléjac M et al. Backpropagation-free training of deep physical neural networks[J]. Science, 382, 1297-1303(2023).

    [106] Hinton G. The forward-forward algorithm: some preliminary investigations[EB/OL]. https:∥arxiv.org/abs/2212.13345

    [107] Bandyopadhyay S, Sludds A, Krastanov S et al. Single-chip photonic deep neural network with forward-only training[J]. Nature Photonics, 18, 1335-1343(2024).

    [108] Petersen F, Kuehne H, Borgelt C et al. Convolutional differentiable logic gate networks[EB/OL]. https:∥arxiv.org/abs/2411.04732

    [109] Shi W X, Huang Z, Huang H H et al. LOEN: Lensless opto-electronic neural network empowered machine vision[J]. Light: Science & Applications, 11, 121(2022).

    [110] Zheng H Y, Liu Q, Kravchenko I I et al. Multichannel meta-imagers for accelerating machine vision[J]. Nature Nanotechnology, 19, 471-478(2024).

    [111] Bai B J, Yang X L, Gan T Y et al. Pyramid diffractive optical networks for unidirectional image magnification and demagnification[J]. Light: Science & Applications, 13, 178(2024).

    [112] Chen Y T, Nazhamaiti M, Xu H et al. All-analog photoelectronic chip for high-speed vision tasks[J]. Nature, 623, 48-57(2023).

    [113] Zhou T K, Lin X, Wu J M et al. Large-scale neuromorphic optoelectronic computing with a reconfigurable diffractive processing unit[J]. Nature Photonics, 15, 367-373(2021).

    [114] Hua S Y, Divita E, Yu S S et al. An integrated large-scale photonic accelerator with ultralow latency[J]. Nature, 640, 361-367(2025).

    [116] Luo Y, Mengu D, Yardimci N T et al. Design of task-specific optical systems using broadband diffractive neural networks[J]. Light: Science & Applications, 8, 112(2019).

    [117] Jia Q, Zhang Y X, Shi B J et al. Vector vortex beams sorting of 120 modes in visible spectrum[J]. Nanophotonics, 12, 3955-3962(2023).

    [118] Jia Q, Feng R, Shi B J et al. Compensating the distorted OAM beams with near zero time delay[J]. Applied Physics Letters, 121, 011104(2022).

    [119] Jia Q, Feng R, Shi B J et al. Universal translation operator for Laguerre-Gaussian mode sorting[J]. Applied Physics Letters, 121, 191104(2022).

    [120] Paesani S, Ding Y H, Santagati R et al. Generation and sampling of quantum states of light in a silicon chip[J]. Nature Physics, 15, 925-929(2019).

    [121] Baldazzi A, Pavesi L. Universal multiport interferometers for post-selected multi-photon gates[J]. Advanced Quantum Technologies, 8, 2400418(2025).

    [122] Qian C, Lin X, Lin X B et al. Performing optical logic operations by a diffractive neural network[J]. Light: Science & Applications, 9, 59(2020).

    [123] Zhang H, Gu M, Jiang X D et al. An optical neural chip for implementing complex-valued neural network[J]. Nature Communications, 12, 457(2021).

    [124] Shi B J, Jia Q, Li X X et al. Efficient coupling of topological photonic crystal waveguides based on transverse spin matching mechanism[J]. Nature Communications, 16, 4645(2025).

    Tools

    Get Citation

    Copy Citation Text

    Bojie Dong, Xiaoyu Li, Yichi Zhang, Bohao Zhang, Zixuan Wang, Wenya Gao, Yanyu Gao, Qi Jia, Xiaoxin Li, Bojian Shi, Yanxia Zhang, Rui Feng, Yongyin Cao, Fangkui Sun, Weiqiang Ding. Progress of Optical Neural Networks (Invited)[J]. Acta Optica Sinica, 2025, 45(17): 1720012

    Download Citation

    EndNote(RIS)BibTexPlain Text
    Set citation alerts for article
    Save article for my favorites
    Paper Information

    Category: Optics in Computing

    Received: May. 28, 2025

    Accepted: Jul. 10, 2025

    Published Online: Sep. 3, 2025

    The Author Email: Weiqiang Ding (wqding@hit.edu.cn)

    DOI:10.3788/AOS251162

    CSTR:32393.14.AOS251162

    Topics

    laser devices and laser physics
    Lasers and Laser Optics
    Laser physics
    laser manufacturing
    Instrumentation, Measurement and Metrology