Optical Neural Networks and Nanophotonics: Development and Applications (Invited)

Yuchao Zhang; Qiming Zhang; Min Gu

doi:10.3788/AOS251030

Acta Optica Sinica, Volume. 45, Issue 14, 1420010(2025)

Optical Neural Networks and Nanophotonics: Development and Applications (Invited)

Yuchao Zhang^1,2, Qiming Zhang^1,2, and Min Gu^1,2、*

¹School of Artificial Intelligence Science and Technology, University of Shanghai for Science and Technology, Shanghai 200093, China

²Institute of Photonic Chips, University of Shanghai for Science and Technology, Shanghai 200093, China

show less

Abstract Get PDF(in Chinese)

References(101)

[1] McCulloch W S, Pitts W. A logical calculus of the ideas immanent in nervous activity[J]. Bulletin of Mathematical Biology, 52, 99-115(1990).

[2] Pitts W, McCulloch W S. How we know universals the perception of auditory and visual forms[J]. The Bulletin of Mathematical Biophysics, 9, 127-147(1947).

[3] Rosenblatt F. The perceptron: a probabilistic model for information storage and organization in the brain[J]. Psychological Review, 65, 386-408(1958).

[4] Rosenblatt F. Two theorems of statistical separability in the perceptron[M]. Mechanisation of thought processes: proceeding of a symposium held at the national physical laboratory, 421-456(1958).

[5] Rosenblatt F[M]. Principles of neurodynamics(1962).

[6] Rumelhart D E, Hinton G E, Williams R J. Learning representations by back-propagating errors[J]. Nature, 323, 533-536(1986).

[7] Dzierma Y, Schuermann M, Melchior P et al. Optimizing adjuvant stereotactic radiotherapy of motor-eloquent brain metastases: sparing the nTMS-defined motor cortex and the hippocampus[J]. Frontiers in Oncology, 11, 628007(2021).

[8] Sengupta B, Stemmler M B. Power consumption during neuronal computation[J]. Proceedings of the IEEE, 102, 738-750(2014).

[9] Goodman J W, Dias A R, Woody L M. Fully parallel, high-speed incoherent optical method for performing discrete Fourier transforms[J]. Optics Letters, 2, 1-3(1978).

[10] Psaltis D, Farhat N. Optical information processing based on an associative-memory model of neural nets with thresholding and feedback[J]. Optics Letters, 10, 98-100(1985).

[11] Farhat N H, Psaltis D, Prata A et al. Optical implementation of the hopfield model[J]. Applied Optics, 24, 1469-1475(1985).

[12] Wagner K, Psaltis D. Multilayer optical learning networks[J]. Applied Optics, 26, 5061-5076(1987).

[13] Psaltis D, Brady D, Gu X G et al. Holography in artificial neural networks[J]. Nature, 343, 325-330(1990).

[14] Psallis D, Brady D, Wagner K. Adaptive optical networks using photorefractive crystals[J]. Applied Optics, 27, 1752-1759(1988).

[15] Shastri B J, Tait A N, Ferreira de Lima T et al. Photonics for artificial intelligence and neuromorphic computing[J]. Nature Photonics, 15, 102-114(2021).

[16] Luan H T, Chen X, Zhang Q M et al. Artificial intelligence nanophotonics: optical neural networks and nanophotonics[J]. Acta Optica Sinica, 41, 0823005(2021).

[17] Fu T Z, Zhang J F, Sun R et al. Optical neural networks: progress and challenges[J]. Light: Science & Applications, 13, 263(2024).

[18] Liao K, Dai T X, Yan Q C et al. Integrated photonic neural networks: opportunities and challenges[J]. ACS Photonics, 10, 2001-2010(2023).

[19] Tait A N, Wu A X, de Lima T F et al. Microring weight banks[J]. IEEE Journal of Selected Topics in Quantum Electronics, 22, 5900214(2016).

[20] Tait A N, de Lima T F, Nahmias M A et al. Continuous calibration of microring weights for analog optical networks[J]. IEEE Photonics Technology Letters, 28, 887-890(2016).

[21] Tait A N, de Lima T F, Zhou E et al. Neuromorphic photonic networks using silicon photonic weight banks[J]. Scientific Reports, 7, 7430(2017).

[22] Tait A N, Jayatilleka H, de Lima T F et al. Feedback control for microring weight banks[J]. Optics Express, 26, 26422-26443(2018).

[23] Feldmann J, Stegmaier M, Gruhler N et al. Calculating with light using a chip-scale all-optical abacus[J]. Nature Communications, 8, 1256(2017).

[24] Feldmann J, Youngblood N, Wright C D et al. All-optical spiking neurosynaptic networks with self-learning capabilities[J]. Nature, 569, 208-214(2019).

[25] Feldmann J, Youngblood N, Karpov M et al. Parallel convolutional processing using an integrated photonic tensor core[J]. Nature, 589, 52-58(2021).

[26] Xu S F, Wang J, Yi S C et al. High-order tensor flow processing using integrated photonic circuits[J]. Nature Communications, 13, 7970(2022).

[27] Xu S F, Wang J, Zou W W. Optical convolutional neural network with WDM-based optical patching and microring weighting banks[J]. IEEE Photonics Technology Letters, 33, 89-92(2020).

[28] Xu S F, Wang J, Zou W W. Optical patching scheme for optical convolutional neural networks based on wavelength-division multiplexing and optical delay lines[J]. Optics Letters, 45, 3689-3692(2020).

[29] Bai B W, Yang Q P, Shu H W et al. Microcomb-based integrated photonic processing unit[J]. Nature Communications, 14, 66(2023).

[30] Cheng J W, Xie Y Z, Liu Y et al. Human emotion recognition with a microcomb-enabled integrated optical neural network[J]. Nanophotonics, 12, 3883-3894(2023).

[31] Reck M, Zeilinger A, Bernstein H J et al. Experimental realization of any discrete unitary operator[J]. Physical Review Letters, 73, 58-61(1994).

[32] Clements W R, Humphreys P C, Metcalf B J et al. Optimal design for universal multiport interferometers[J]. Optica, 3, 1460-1465(2016).

[33] Shen Y C, Harris N C, Skirlo S et al. Deep learning with coherent nanophotonic circuits[J]. Nature Photonics, 11, 441-446(2017).

[34] Zhou H L, Dong J J, Cheng J W et al. Photonic matrix multiplication lights up photonic accelerator and beyond[J]. Light: Science & Applications, 11, 30(2022).

[35] Hughes T W, Minkov M, Shi Y et al. Training of photonic neural networks through in situ backpropagation and gradient measurement[J]. Optica, 5, 864-871(2018).

[36] Pai S, Sun Z H, Hughes T W et al. Experimentally realized in situ backpropagation for deep learning in photonic neural networks[J]. Science, 380, 398-404(2023).

[37] Zhang H, Gu M, Jiang X D et al. An optical neural chip for implementing complex-valued neural network[J]. Nature Communications, 12, 457(2021).

[38] Xu X Y, Tan M X, Corcoran B et al. 11 TOPS photonic convolutional accelerator for optical neural networks[J]. Nature, 589, 44-51(2021).

[39] Xu X Y, Tan M X, Corcoran B et al. Photonic perceptron based on a Kerr microcomb for high-speed, scalable, optical neural networks[J]. Laser & Photonics Reviews, 14, 2000070(2020).

[40] Ashtiani F, Geers A J, Aflatouni F. An on-chip photonic deep neural network for image classification[J]. Nature, 606, 501-506(2022).

[41] Yang K Y, Shirpurkar C, White A D et al. Multi-dimensional data transmission using inverse-designed silicon photonics and microcombs[J]. Nature Communications, 13, 7862(2022).

[42] Spagnolo M, Morris J, Piacentini S et al. Experimental photonic quantum memristor[J]. Nature Photonics, 16, 318-323(2022).

[43] Lin X, Rivenson Y, Yardimci N T et al. All-optical machine learning using diffractive deep neural networks[J]. Science, 361, 1004-1008(2018).

[44] Yan T, Wu J M, Zhou T K et al. Fourier-space diffractive deep neural network[J]. Physical Review Letters, 123, 023901(2019).

[45] Gu M, Fang X Y, Ren H R et al. Optically digitalized holography: a perspective for all-optical machine learning[J]. Engineering, 5, 363-365(2019).

[46] Zhou T K, Fang L, Yan T et al. In situ optical backpropagation training of diffractive optical neural networks[J]. Photonics Research, 8, 940-953(2020).

[47] Chen H, Feng J N, Jiang M W et al. Diffractive deep neural networks at visible wavelengths[J]. Engineering, 7, 1483-1491(2021).

[48] Zhou T K, Lin X, Wu J M et al. Large-scale neuromorphic optoelectronic computing with a reconfigurable diffractive processing unit[J]. Nature Photonics, 15, 367-373(2021).

[49] Yuan X Y, Wang Y, Xu Z H et al. Training large-scale optoelectronic neural networks with dual-neuron optical-artificial learning[J]. Nature Communications, 14, 7110(2023).

[50] Chen Y T, Nazhamaiti M, Xu H et al. All-analog photoelectronic chip for high-speed vision tasks[J]. Nature, 623, 48-57(2023).

[51] Dou H K, Deng Y, Yan T et al. Residual D2NN: training diffractive deep neural networks via learnable light shortcuts[J]. Optics Letters, 45, 2688-2691(2020).

[52] Li Y M, Zheng Z X, Li R et al. Multiscale diffractive U-Net: a robust all-optical deep learning framework modeled with sampling and skip connections[J]. Optics Express, 30, 36700-36710(2022).

[53] Su J, Yuan Y F, Liu C M et al. Multitask learning by multiwave optical diffractive network[J]. Mathematical Problems in Engineering, 2020, 9748380(2020).

[54] Duan Z Y, Chen H, Lin X. Optical multi-task learning using multi-wavelength diffractive deep neural networks[J]. Nanophotonics, 12, 893-903(2023).

[55] Li J X, Gan T Y, Bai B J et al. Massively parallel universal linear transformations using a wavelength-multiplexed diffractive optical network[J]. Advanced Photonics, 5, 016003(2023).

[56] Li J X, Hung Y C, Kulce O et al. Polarization multiplexed diffractive computing: all-optical implementation of a group of linear transformations through a polarization-encoded diffractive network[J]. Light: Science & Applications, 11, 153(2022).

[57] Luo X H, Hu Y Q, Ou X N et al. Metasurface-enabled on-chip multiplexed diffractive neural networks in the visible[J]. Light: Science & Applications, 11, 158(2022).

[58] Vandoorne K, Dierckx W, Schrauwen B et al. Toward optical signal processing using photonic reservoir computing[J]. Optics Express, 16, 11182-11192(2008).

[59] Dong J, Gigan S, Krzakala F et al. Scaling up echo-state networks with multiple light scattering[C], 448-452(2018).

[60] Rafayelyan M, Dong J, Tan Y Q et al. Large-scale optical reservoir computing for spatiotemporal chaotic systems prediction[J]. Physical Review X, 10, 041037(2020).

[61] Xia F, Kim K, Eliezer Y et al. Nonlinear optical encoding enabled by recurrent linear scattering[J]. Nature Photonics, 18, 1067-1075(2024).

[62] Hubel D H, Wiesel T N. Receptive fields of single neurones in the cat’s striate cortex[J]. Journal of Physiology, 148, 574-591(1959).

[63] Hubel D H, Wiesel T N[M]. Brain and visual perception: the story of a 25-year collaboration(2004).

[64] Fukushima K. Neocognitron: a hierarchical neural network capable of visual pattern recognition[J]. Neural Networks, 1, 119-130(1988).

[65] LeCun Y, Boser B, Denker J S et al. Backpropagation applied to handwritten zip code recognition[J]. Neural Computation, 1, 541-551(1989).

[66] LeCun Y, Bengio Y, Hinton G. Deep learning[J]. Nature, 521, 436-444(2015).

[67] Lugt A V. Signal detection by complex spatial filtering[J]. IEEE Transactions on Information Theory, 10, 139-145(1964).

[68] Weaver C S, Goodman J W. A technique for optically convolving two functions[J]. Applied Optics, 5, 1248-1249(1966).

[69] Chang J L, Sitzmann V, Dun X et al. Hybrid optical-electronic convolutional neural networks with optimized diffractive optics for image classification[J]. Scientific Reports, 8, 12324(2018).

[70] Miscuglio M, Hu Z B, Li S R et al. Massively parallel amplitude-only Fourier neural network[J]. Optica, 7, 1812-1819(2020).

[71] Zhang Y C, Zhang Q M, Yu H Y et al. Memory-less scattering imaging with ultrafast convolutional optical neural networks[J]. Science Advances, 10, eadn2205(2024).

[72] Gan Z S, Cao Y Y, Evans R A et al. Three-dimensional deep sub-diffraction optical beam lithography with 9 nm feature size[J]. Nature Communications, 4, 2061(2013).

[73] Zhao M, Wen J, Hu Q et al. A 3D nanoscale optical disk memory with petabit capacity[J]. Nature, 626, 772-778(2024).

[74] Gao H W, An J, Chua C K et al. 3D printed optics and photonics: processes, materials and applications[J]. Materials Today, 69, 107-132(2023).

[75] Zhang Q M, Yu H Y, Barbiero M et al. Artificial neural networks enabled by nanophotonics[J]. Light: Science & Applications, 8, 42(2019).

[76] Goi E, Chen X, Zhang Q M et al. Nanoprinted high-neuron-density optical linear perceptrons performing near-infrared inference on a CMOS chip[J]. Light: Science & Applications, 10, 40(2021).

[77] Goi E, Schoenhardt S, Gu M. Direct retrieval of Zernike-based pupil functions using integrated diffractive deep neural networks[J]. Nature Communications, 13, 7531(2022).

[78] Yu H Y, Huang Z H, Lamon S et al. All-optical image transportation through a multimode fibre using a miniaturized diffractive neural network on the distal facet[J]. Nature Photonics, 19, 486-493(2025).

[79] Krasikov S, Tranter A, Bogdanov A et al. Intelligent metaphotonics empowered by machine learning[J]. Opto-Electronic Advances, 5, 210147(2022).

[80] Yang Y, Seong J, Choi M et al. Integrated metasurfaces for re-envisioning a near-future disruptive optical platform[J]. Light: Science & Applications, 12, 152(2023).

[81] Qian C, Lin X, Lin X B et al. Performing optical logic operations by a diffractive neural network[J]. Light: Science & Applications, 9, 59(2020).

[82] Liu C, Ma Q, Luo Z J et al. A programmable diffractive deep neural network based on a digital-coding metasurface array[J]. Nature Electronics, 5, 113-122(2022).

[83] Gao S, Chen H, Wang Y C et al. Super-resolution diffractive neural network for all-optical direction of arrival estimation beyond diffraction limits[J]. Light: Science & Applications, 13, 161(2024).

[84] Zheng H Y, Liu Q, Kravchenko I I et al. Multichannel meta-imagers for accelerating machine vision[J]. Nature Nanotechnology, 19, 471-478(2024).

[85] Yan T, Zhou T K, Guo Y C et al. Nanowatt all-optical 3D perception for mobile robotics[J]. Science Advances, 10, eadn2031(2024).

[86] Zarei S, Marzban M R, Khavasi A. Integrated photonic neural network based on silicon metalines[J]. Optics Express, 28, 36668-36684(2020).

[87] Zarei S, Khavasi A. Realization of optical logic gates using on-chip diffractive optical neural networks[J]. Scientific Reports, 12, 15747(2022).

[88] Fu T Z, Zang Y B, Huang H H et al. On-chip photonic diffractive optical neural network based on a spatial domain electromagnetic propagation model[J]. Optics Express, 29, 31924-31940(2021).

[89] Fu T Z, Zang Y B, Huang Y Y et al. Photonic machine learning with on-chip diffractive optics[J]. Nature Communications, 14, 70(2023).

[90] Wang Z, Chang L, Wang F F et al. Integrated photonic metasystem for image classifications at telecommunication wavelength[J]. Nature Communications, 13, 2131(2022).

[91] Zhu H H, Zou J, Zhang H et al. Space-efficient optical computing with an integrated chip diffractive neural network[J]. Nature Communications, 13, 1044(2022).

[92] Chen H, Gao S, Zhang H O et al. Superresolution imaging using superoscillatory diffractive neural networks[J]. Advanced Photonics, 6, 056004(2024).

[93] Huang C R, Fujisawa S, de Lima T F et al. A silicon photonic‒electronic neural network for fibre nonlinearity compensation[J]. Nature Electronics, 4, 837-844(2021).

[94] Zhang J L, Wu B, Zhang S J et al. Highly integrated all-optical nonlinear deep neural network for multi-thread processing[J]. Advanced Photonics, 7, 046003(2025).

[95] Dejonckheere A, Duport F, Smerieri A et al. All-optical reservoir computer based on saturation of absorption[J]. Optics Express, 22, 10868-10881(2014).

[96] Mourgias-Alexandris G, Tsakyridis A, Passalis N et al. An all-optical neuron with sigmoid activation function[J]. Optics Express, 27, 9620-9630(2019).

[97] Zheng S Q, Xu S X, Fan D Y. Orthogonality of diffractive deep neural network[J]. Optics Letters, 47, 1798-1801(2022).

[98] Xiong W J, Huang Z B, Wang P P et al. Optical diffractive deep neural network-based orbital angular momentum mode add-drop multiplexer[J]. Optics Express, 29, 36936-36952(2021).

[99] Zhang J Q, Ye Z Y, Yin J H et al. Polarized deep diffractive neural network for sorting, generation, multiplexing, and de-multiplexing of orbital angular momentum modes[J]. Optics Express, 30, 26728-26741(2022).

[100] Yang X L, Rahman M S S, Bai B J et al. Complex-valued universal linear transformations and image encryption using spatially incoherent diffractive networks[J]. Advanced Photonics Nexus, 3, 016010(2024).

[101] Momeni A, Rahmani B, Malléjac M et al. Backpropagation-free training of deep physical neural networks[J]. Science, 382, 1297-1303(2023).

Tools

Get Citation

Copy Citation Text

Yuchao Zhang, Qiming Zhang, Min Gu. Optical Neural Networks and Nanophotonics: Development and Applications (Invited)[J]. Acta Optica Sinica, 2025, 45(14): 1420010

Download Citation

EndNote(RIS)BibTex Plain Text

Set citation alerts for article

Save article for my favorites

Paper Information

Category: Optics in Computing

Received: May. 6, 2025

Accepted: Jul. 1, 2025

Published Online: Jul. 22, 2025

The Author Email: Min Gu (gumin@usst.edu.cn)

DOI:10.3788/AOS251030

CSTR:32393.14.AOS251030

Topics

laser devices and laser physics

Lasers and Laser Optics

Laser physics

laser manufacturing

Instrumentation, Measurement and Metrology