Highly integrated all-optical nonlinear deep neural network for multi-thread processing

Jialong Zhang; Bo Wu; Shiji Zhang; Junwei Cheng; Yilun Wang; Hailong Zhou; Jianji Dong; Xinliang Zhang

doi:10.1117/1.AP.7.4.046003

Advanced Photonics, Volume. 7, Issue 4, 046003(2025)

Highly integrated all-optical nonlinear deep neural network for multi-thread processing

Jialong Zhang^1、†, Bo Wu¹, Shiji Zhang¹, Junwei Cheng¹, Yilun Wang¹, Hailong Zhou^1、*, Jianji Dong^1、*, and Xinliang Zhang^1,2

Author Affiliations

¹Huazhong University of Science and Technology, School of Optical and Electronic Information, Wuhan National Laboratory for Optoelectronics, Wuhan, China

²Xidian University, Xi’an, China

show less

References(55)

[1] J. R. Powell. The quantum limit to Moore’s law. Proc. IEEE, 96, 1247-1248(2008). https://doi.org/10.1109/JPROC.2008.925411

[2] M. M. Waldrop. The chips are down for Moore’s law. Nature, 530, 144-147(2016). https://doi.org/10.1038/530144a

[3] T. N. Theis, H.-S. P. Wong. The end of Moore’s law: a new beginning for information technology. Comput. Sci. Eng., 19, 41-50(2017). https://doi.org/10.1109/MCSE.2017.29

[4] G. Genty et al. Machine learning and applications in ultrafast photonics. Nat. Photonics, 15, 91-101(2021). https://doi.org/10.1038/s41566-020-00716-4

[5] H. Zhou et al. Photonic matrix multiplication lights up photonic accelerator and beyond. Light Sci. Appl., 11, 30(2022). https://doi.org/10.1038/s41377-022-00717-8

[6] K. Kitayama et al. Novel frontier of photonics for data processing—photonic accelerator. APL Photonics, 4, 090901(2019). https://doi.org/10.1063/1.5108912

[7] C. Huang et al. Prospects and applications of photonic neural networks. Adv. Phys.: X, 7, 1981155(2022). https://doi.org/10.1080/23746149.2021.1981155

[8] B. J. Shastri et al. Photonics for artificial intelligence and neuromorphic computing. Nat. Photonics, 15, 102-114(2021). https://doi.org/10.1038/s41566-020-00754-y

[9] W. Zhang et al. Large-scale optical programmable logic array for two-dimensional cellular automaton. Adv. Photonics, 6, 056007(2024). https://doi.org/10.1117/1.AP.6.5.056007

[10] B. Wu et al. Chip-to-chip optical multimode communication with universal mode processors. PhotoniX, 4, 37(2023). https://doi.org/10.1186/s43074-023-00114-3

[11] Y. Shen et al. Deep learning with coherent nanophotonic circuits. Nat. Photonics, 11, 441-446(2017). https://doi.org/10.1038/nphoton.2017.93

[12] T. Zhou et al. Large-scale neuromorphic optoelectronic computing with a reconfigurable diffractive processing unit. Nat. Photonics, 15, 367-373(2021). https://doi.org/10.1038/s41566-021-00796-w

[13] Y. Chen et al. All-analog photoelectronic chip for high-speed vision tasks. Nature, 623, 48-57(2023). https://doi.org/10.1038/s41586-023-06558-8

[14] X. Lin et al. All-optical machine learning using diffractive deep neural networks. Science, 361, 1004-1008(2018). https://doi.org/10.1126/science.aat8084

[15] Ç. Işıl et al. All-optical image denoising using a diffractive visual processor. Light Sci. Appl., 13, 43(2024). https://doi.org/10.1038/s41377-024-01385-6

[16] J. Hu et al. Diffractive optical computing in free space. Nat. Commun., 15, 1525(2024). https://doi.org/10.1038/s41467-024-45982-w

[17] A. N. Tait et al. Microring weight banks. IEEE J. Sel. Top. Quantum Electron., 22, 312-325(2016). https://doi.org/10.1109/JSTQE.2016.2573583

[18] S. Ohno et al. Si microring resonator crossbar array for on-chip inference and training of the optical neural network. ACS Photonics, 9, 2614-2622(2022). https://doi.org/10.1021/acsphotonics.1c01777

[19] C. Huang et al. Demonstration of scalable microring weight bank control for large-scale photonic integrated circuits. APL Photonics, 5, 040803(2020). https://doi.org/10.1063/1.5144121

[20] F. Brückerhoff-Plückelmann et al. Probabilistic photonic computing with chaotic light. Nat. Commun., 15, 10445(2024). https://doi.org/10.1038/s41467-024-54931-6

[21] E. Khoram et al. Nanophotonic media for artificial neural inference. Photonics Res., 7, 823-827(2019). https://doi.org/10.1364/PRJ.7.000823

[22] H. Wang et al. Large-scale photonic computing with nonlinear disordered media. Nat. Comput. Sci., 4, 429-439(2024). https://doi.org/10.1038/s43588-024-00644-1

[23] Z. Xue et al. Fully forward mode training for optical neural networks. Nature, 632, 280-286(2024). https://doi.org/10.1038/s41586-024-07687-4

[24] C. Wu et al. Programmable phase-change metasurfaces on waveguides for multimode photonic convolutional neural network. Nat. Commun., 12, 96(2021). https://doi.org/10.1038/s41467-020-20365-z

[25] Z. Xu et al. Large-scale photonic chiplet Taichi empowers 160-TOPS/W artificial general intelligence. Science, 384, 202-209(2024). https://doi.org/10.1126/science.adl1203

[26] H. Chen et al. Diffractive deep neural networks: theories, optimization, and applications. Appl. Phys. Rev., 11, 021332(2024). https://doi.org/10.1063/5.0191977

[27] X. Meng. Compact optical convolution processing unit based on multimode interference. Nat. Commun., 14, 3000(2023). https://doi.org/10.1038/s41467-023-38786-x

[28] H. H. Zhu et al. Space-efficient optical computing with an integrated chip diffractive neural network. Nat. Commun., 13, 1044(2022). https://doi.org/10.1038/s41467-022-28702-0

[29] Y. Huang et al. Diffraction‐driven parallel convolution processing with integrated photonics. Laser Photonics Rev., 19, 2400972(2024). https://doi.org/10.1002/lpor.202400972

[30] J. Cheng et al. Multimodal deep learning using on-chip diffractive optics with in situ training capability. Nat. Commun., 15, 6189(2024). https://doi.org/10.1038/s41467-024-50677-3

[31] S. Xu et al. Analog spatiotemporal feature extraction for cognitive radio-frequency sensing with integrated photonics. Light Sci. Appl., 13, 50(2024). https://doi.org/10.1038/s41377-024-01390-9

[32] S. Xu et al. Optical coherent dot-product chip for sophisticated deep learning regression. Light Sci. Appl., 10, 221(2021). https://doi.org/10.1038/s41377-021-00666-8

[33] Z. Yang et al. MXene‐based broadband ultrafast nonlinear activator for optical computing. Adv. Opt. Mater., 10, 2200714(2022). https://doi.org/10.1002/adom.202200714

[34] A. Hazan et al. MXene‐nanoflakes‐enabled all‐optical nonlinear activation function for on‐chip photonic deep neural networks. Adv. Mater., 35, 2210216(2023). https://doi.org/10.1002/adma.202210216

[35] L. Tong et al. Programmable nonlinear optical neuromorphic computing with bare 2D material MoS₂. Nat. Commun., 15, 10290(2024). https://doi.org/10.1038/s41467-024-54776-z

[36] C. Huang et al. A silicon photonic–electronic neural network for fibre nonlinearity compensation. Nat. Electron., 4, 837-844(2021). https://doi.org/10.1038/s41928-021-00661-2

[37] F. Ashtiani, A. J. Geers, F. Aflatouni. An on-chip photonic deep neural network for image classification. Nature, 606, 501-506(2022). https://doi.org/10.1038/s41586-022-04714-0

[38] J. Feldmann et al. All-optical spiking neurosynaptic networks with self-learning capabilities. Nature, 569, 208-214(2019). https://doi.org/10.1038/s41586-019-1157-8

[39] X. Wang et al. Chip-based high-dimensional optical neural network. Nano-Micro Lett., 14, 221(2022). https://doi.org/10.1007/s40820-022-00957-8

[40] J. Feldmann et al. Parallel convolutional processing using an integrated photonic tensor core. Nature, 589, 52-58(2021). https://doi.org/10.1038/s41586-020-03070-1

[41] A. Najjar Amiri et al. Deep photonic network platform enabling arbitrary and broadband optical functionality. Nat. Commun., 15, 1432(2024). https://doi.org/10.1038/s41467-024-45846-3

[42] J. Cheng et al. Photonic emulator for inverse design. ACS Photonics, 10, 2173-2181(2023). https://doi.org/10.1021/acsphotonics.2c00716

[43] B. Wu et al. Low-threshold all-optical nonlinear activation function based on a Ge/Si hybrid structure in a microring resonator. Opt. Mater. Express, 12, 970-980(2022). https://doi.org/10.1364/OME.447330

[44] H. Li et al. All-optical nonlinear activation function based on germanium silicon hybrid asymmetric coupler. IEEE J. Selected Topics in Quantum Electron., 29, 8300106(2023). https://doi.org/10.1109/JSTQE.2022.3166510

[45] M. A. Vorontsov, V. P. Sivokon. Stochastic parallel-gradient-descent technique for high-resolution wave-front phase-distortion correction. J. Opt. Soc. Am. A, 15, 2745-2758(1998). https://doi.org/10.1364/JOSAA.15.002745

[46] Y. Wan et al. Efficient stochastic parallel gradient descent training for on-chip optical processor. Opto-Electron. Adv., 7, 230182(2024). https://doi.org/10.29026/oea.2024.230182

[47] A. Mallya, S. Lazebnik. PackNet: adding multiple tasks to a single network by iterative pruning, 7765-7773(2018). https://doi.org/10.1109/CVPR.2018.00810

[48] S. Bandyopadhyay et al. Single-chip photonic deep neural network with forward-only training. Nat. Photonics, 18, 1335-1343(2024). https://doi.org/10.1038/s41566-024-01567-z

[49] M. Delaney et al. Nonvolatile programmable silicon photonics using an ultralow-loss Sb₂Se₃ phase change material. Sci. Adv., 7, eabg3500(2021). https://doi.org/10.1126/sciadv.abg3500

[50] R. Chen et al. Non-volatile electrically programmable integrated photonics with a 5-bit operation. Nat. Commun., 14, 3465(2023). https://doi.org/10.1038/s41467-023-39180-3

[51] M. Wei et al. Electrically programmable phase-change photonic memory for optical neural networks with nanoseconds in situ training capability. Adv. Photonics, 5, 046004(2023). https://doi.org/10.1117/1.AP.5.4.046004

[52] C. Chen. Ultra-broadband all-optical nonlinear activation function enabled by MoTe₂/optical waveguide integrated devices. Nat. Commun., 15, 9047(2024). https://doi.org/10.1038/s41467-024-53371-6

[53] J.-H. Lee et al. Demonstration of 122% wall plug efficiency in uncooled single mode external-cavity tunable Si/III-V hybrid laser. Opt. Express, 23, 12079-12088(2015). https://doi.org/10.1364/OE.23.012079

[54] J. R. Vaskasi et al. High wall-plug efficiency and narrow linewidth III-V-on-silicon C-band DFB laser diodes. Opt. Express, 30, 27983-27992(2022). https://doi.org/10.1364/OE.462051

[55] T. Fu et al. Photonic machine learning with on-chip diffractive optics. Nat. Commun., 14, 70(2023). https://doi.org/10.1038/s41467-022-35772-7

Tools

Get Citation

Copy Citation Text

Jialong Zhang, Bo Wu, Shiji Zhang, Junwei Cheng, Yilun Wang, Hailong Zhou, Jianji Dong, Xinliang Zhang, "Highly integrated all-optical nonlinear deep neural network for multi-thread processing," Adv. Photon. 7, 046003 (2025)

Download Citation

EndNote(RIS)BibTex Plain Text

Set citation alerts for article

Save article for my favorites