Integrated diffractive optical neural network with space-time interleaving

Tingzhao Fu; Yuyao Huang; Run Sun; Honghao Huang; Wencan Liu; Sigang Yang; Hongwei Chen

doi:10.3788/COL202321.091301

Chinese Optics Letters, Volume. 21, Issue 9, 091301(2023)

Integrated diffractive optical neural network with space-time interleaving

Tingzhao Fu, Yuyao Huang, Run Sun, Honghao Huang, Wencan Liu, Sigang Yang, and Hongwei Chen^*

Beijing National Research Center for Information Science and Technology, Department of Electronic Engineering, Tsinghua University, Beijing 100084, China

show less

References(40)

[1] A. Krizhevsky, I. Sutskever, G. E. Hinton. ImageNet classification with deep convolutional neural networks. Commun. ACM, 60, 84(2017).

[2] T. Ananthanarayana, P. Srivastava, A. Chintha, A. Santha, B. Landy, J. Panaro, A. Webster, N. Kotecha, S. Sah, T. Sarchet, R. Ptucha, I. Nwogu. Deep learning methods for sign language translation. ACM Trans. Access. Comput., 14, 1(2021).

[3] I. Kruglov, O. Mishulina, M. Bakirov. Quantile based decision making rule of the neural networks committee for ill-posed approximation problems. Neurocomputing, 96, 74(2012).

[4] G. Ozkan, M. Inal. Comparison of neural network application for fuzzy and ANFIS approaches for multi-criteria decision making problems. Appl. Soft Comput., 24, 232(2014).

[5] Y. Liu, K. Qian, K. Wang, L. He. Effective scaling of blockchain beyond consensus innovations and Moore’s law: challenges and opportunities. IEEE Syst. J., 16, 1424(2022).

[6] M. B. Taylor. The evolution of bitcoin hardware. Computer, 50, 58(2017).

[7] D. Silver, A. Huang, C. J. Maddison, A. Guez, L. Sifre, G. van den Driessche, J. Schrittwieser, I. Antonoglou, V. Panneershelvam, M. Lanctot, S. Dieleman, D. Grewe, J. Nham, N. Kalchbrenner, I. Sutskever, T. Lillicrap, M. Leach, K. Kavukcuoglu, T. Graepel, D. Hassabis. Mastering the game of Go with deep neural networks and tree search. Nature, 529, 484(2016).

[8] Y.-H. Chen, T. Krishna, J. S. Emer, V. Sze. Eyeriss: an energy-efficient reconfigurable accelerator for deep convolutional neural networks. IEEE J. Solid-State Circuits, 52, 127(2016).

[9] J. Misra, I. Saha. Artificial neural networks in hardware: a survey of two decades of progress. Neurocomputing, 74, 239(2010).

[10] S. K. Esser, P. A. Merolla, J. V. Arthur, A. S. Cassidy, R. Appuswamy, A. Andreopoulos, D. J. Berg, J. L. Mckinstry, T. Melano, D. R. Barch, C. NolfoDi, P. Datta, A. Amir, B. Taba, M. D. Flickner, D. S. Modha. Convolutional networks for fast, energy-efficient neuromorphic computing. Proc. Natl. Acad. Sci. U.S.A., 113, 11441(2016).

[11] C. S. Poon, K. Zhou. Neuromorphic silicon neurons and large-scale neural networks: challenges and opportunities. Front Neurosci., 5, 108(2011).

[12] A. Graves, G. Wayne, M. Reynolds, T. Harley, I. Danihelka, A. Grabska-Barwinska, S. G. Colmenarejo, E. Grefenstette, T. Ramalho, J. Agapiou, A. P. Badia, K. M. Hermann, Y. Zwols, G. Ostrovski, A. Cain, H. King, C. Summerfield, P. Blunsom, K. Kavukcuoglu, D. Hassabis. Hybrid computing using a neural network with dynamic external memory. Nature, 538, 471(2016).

[13] A. Shafiee, A. Nag, N. Muralimanohar, R. Balasubramonian, J. P. Strachan, M. Hu, R. S. Williams, V. Srikumar. ISAAC: a convolutional neural network accelerator with in-situ analog arithmetic in crossbars. ACM/IEEE 43rd Annual International Symposium on Computer Architecture (ISCA)(2016).

[14] Y. Shen, N. C. Harris, S. Skirlo, M. Prabhu, T. Baehr-Jones, M. Hochberg, X. Sun, S. Zhao, H. Larochelle, D. Englund, M. Soljačić. Deep learning with coherent nanophotonic circuits. Nat. Photonics, 11, 441(2017).

[15] X. Lin, Y. Rivenson, N. T. Yardimici, M. Veli, Y. Luo, M. Jarrahi, A. Ozcan. All-optical machine learning using diffractive deep neural networks. Science, 361, 1004(2018).

[16] J. Feldmann, N. Youngblood, C. D. Wright, H. Bhaskaran, W. H. P. Pernice. All-optical spiking neurosynaptic networks with self-learning capabilities. Nature, 569, 208(2019).

[17] S. Zarei, M. R. Marzban, A. Khavasi. Integrated photonic neural network based on silicon metalines. Opt. Express, 28, 36668(2020).

[18] T. Z. Fu, Y. B. Zang, H. H. Huang, Z. M. Du, C. Y. Hu, M. G. Chen, S. G. Yang, H. W. Chen. On-chip photonic diffractive optical neural network based on a spatial domain electromagnetic propagation model. Opt. Express, 29, 31924(2021).

[19] J. Feldmann, N. Youngblood, M. Karpov, H. Gehring, X. Li, M. Stappers, M. Le Gallo, X. Fu, A. Lukashchuk, A. S. Raja, J. Liu, C. D. Wright, A. Sebastian, T. J. Kippenberg, W. H. P. Pernice, H. Bhaskaran. Parallel convolutional processing using an integrated photonic tensor core. Nature, 589, 52(2021).

[20] M. Y. S. Fang, S. Manipatruni, C. Wierzynski, A. Khosrowshahi, M. R. Deweese. Design of optical neural networks with component imprecisions. Opt. Express, 27, 14009(2019).

[21] I. A. D. Williamson, T. W. Hughes, M. Minkov, B. Bartlett, S. Pai, S. H. Fan. Reprogrammable electro-optic nonlinear activation functions for optical neural networks. IEEE J. Sel. Top. Quantum Electron., 26, 7700412(2020).

[22] M. Miscuglio, A. Mehrabian, Z. Hu, S. I. Azzam, J. George, A. V. Kildishev, M. Pelton, V. J. Sorger. All-optical nonlinear activation function for photonic neural networks [Invited]. Opt. Mater. Express, 8, 3851(2018).

[23] Y. Zuo, B. Li, Y. Zhao, Y. Jiang, Y.-C. Chen, P. Chen, G.-B. Jo, J. Liu, S. Du. All-optical neural network with nonlinear activation functions. Optica, 6, 1132(2019).

[24] J. M. Bueno, S. Maktoobi, L. Froehly, I. Fischer, M. Jacquot, L. Larger, D. Brunner. Reinforcement learning in a large-scale photonic recurrent neural network. Optica, 5, 756(2018).

[25] E. Khoram, A. Chen, D. Liu, L. Ying, Q. Wang, M. Yuan, Z. Yu. Nanophotonic media for artificial neural inference. Photonics Res., 7, 823(2019).

[26] D. Mengu, Y. Luo, Y. Rivenson, A. Ozcan. Analysis of diffractive optical neural networks and their integration with electronic neural networks. IEEE J. Sel. Top. Quantum Electron., 26, 1(2020).

[27] T. W. Hughes, M. Minkov, Y. Shi, S. Fan. Training of photonic neural networks through in situ backpropagation and gradient measurement. Optica, 5, 864(2018).

[28] T. Yan, J. Wu, T. Zhou, H. Xie, F. Xu, J. Fan, L. Fang, X. Lin, Q. Dai. Fourier-space diffractive deep neural network. Phys. Rev. Lett., 123, 023901(2019).

[29] Z. Wang, L. Chang, F. Wang, T. Li, T. Gu. Integrated photonic metasystem for image classifications at telecommunication wavelength. Nat. Commun., 13, 2131(2022).

[30] H. H. Zhu, J. Zou, H. Zhang, Y. Z. Shi, S. B. Luo, N. Wang, H. Cai, L. X. Wan, B. Wang, X. D. Jiang, J. Thompson, X. S. Luo, X. H. Zhou, L. M. Xiao, W. Huang, L. Patrick, M. Gu, L. C. Kwek, A. Q. Liu. Space-efficient optical computing with an integrated chip diffractive neural network. Nat. Commun., 13, 1044(2022).

[31] H. Zhang, M. Gu, X. D. Jiang, J. Thompson, H. Cai, S. Paesani, R. Santagati, A. Laing, Y. Zhang, M. Yung, Y. Z. Shi, F. K. Muhammed, G. Q. Lo, X. S. Luo, B. Dong, D. C. Kwong, L. C. Kwek, A. Q. Liu. An optical neural chip for implementing complex-valued neural network. Nat. Commun., 12, 457(2021).

[32] F. Ashtiani, A. J. Geers, F. Aflatouni. An on-chip photonic deep neural network for image classification. Nature, 606, 501(2022).

[33] T. Yan, R. Yang, Z. Zheng, X. Lin, H. Xiong, Q. Dai. All-optical graph representation learning using integrated diffractive photonic computing units. Sci. Adv., 8, eabn7630(2022).

[34] Z. Xu, X. Yuan, T. Zhou, L. Fang. A multichannel optical computing architecture for advanced machine vision. Light Sci. Appl., 11, 255(2022).

[35] C. Qian, X. Lin, X. Lin, J. Xu, Y. Sun, E. Li, B. Zhang, H. Chen. Performing optical logic operations by a diffractive neural network. Light Sci. Appl., 9, 59(2020).

[36] T. Zhou, X. Lin, J. Wu, Y. Chen, H. Xie, Y. Li, J. Fan, H. Wu, L. Fang, Q. Dai. Large-scale neuromorphic optoelectronic computing with a reconfigurable diffractive processing unit. Nat. Photonics, 15, 367(2021).

[37] X. Zhao, H. Lv, C. Chen, S. Tang, X. Liu, Q. Qi. On-chip Reconfigurable Optical Neural Networks(2021).

[38] D. H. Deterding. Speaker Normalisation for Automatic Speech Recognition(1990).

[39] T. Fu, Y. Zang, Y. Huang, Z. Du, H. Huang, C. Hu, M. Chen, S. Yang, H. Chen. Photonic machine learning with on-chip diffractive optics. Nat. Commun., 14, 70(2023).

[40] Z. Wang, T. Li, A. Soman, D. Mao, T. Kananen, T. Gu. On-chip wavefront shaping with dielectric metasurface. Nat. Commun., 10, 3547(2019).

Cited By

[1] Seokho Lee, Cherry Park, Junsuk Rho.

[2] Run Sun, Tingzhao Fu, Yuyao Huang, Wencan Liu, Zhenmin Du, Hongwei Chen.

[3] 符庭钊 Fu Tingzhao, 孙润 Sun Run, 黄禹尧 Huang Yuyao, 张检发 Zhang Jianfa, 杨四刚 Yang Sigang, 朱志宏 Zhu Zhihong, 陈宏伟 Chen Hongwei.

Tools

Get Citation

Copy Citation Text

Tingzhao Fu, Yuyao Huang, Run Sun, Honghao Huang, Wencan Liu, Sigang Yang, Hongwei Chen, "Integrated diffractive optical neural network with space-time interleaving," Chin. Opt. Lett. 21, 091301 (2023)

Download Citation

EndNote(RIS)BibTex Plain Text

Set citation alerts for article

Save article for my favorites

Paper Information

Category: Integrated Optics

Received: Feb. 12, 2023

Accepted: Jun. 2, 2023

Posted: Jun. 2, 2023

Published Online: Aug. 28, 2023

The Author Email: Hongwei Chen (chenhw@tsinghua.edu.cn)

DOI:10.3788/COL202321.091301

Topics

laser devices and laser physics

Lasers and Laser Optics

Laser physics

laser manufacturing

Instrumentation, Measurement and Metrology