Opto-Electronic Advances, Volume. 7, Issue 2, 230005-1(2024)

Pluggable multitask diffractive neural networks based on cascaded metasurfaces

Cong He1, Dan Zhao2, Fei Fan2, Hongqiang Zhou1,3, Xin Li1, Yao Li4, Junjie Li4, Fei Dong5, Yin-Xiao Miao5, Yongtian Wang1、*, and Lingling Huang1、**
Author Affiliations
  • 1Beijing Engineering Research Center of Mixed Reality and Advanced Display, Key Laboratory of Photoelectronic Imaging Technology and System of Ministry of Education of China, School of Optics and Photonics, Beijing Institute of Technology, Beijing 100081, China
  • 2Institute of Modern Optics, Tianjin Key Laboratory of Optoelectronic Sensor and Sensing Network Technology, Nankai University, Tianjin 300350, China
  • 3Department of Physics and Optoelectronics, Faculty of Science, Beijing University of Technology, Beijing 100124, China
  • 4Beijing National Laboratory for Condensed Matter Physics, Institute of Physics, Chinese Academy of Sciences, Beijing 100191, China
  • 5Beijing Aerospace Institute for Metrology and Measurement Technology, Beijing 100076, China
  • show less
    References(42)

    [1] A Krizhevsky, I Sutskever, GE Hinton. ImageNet classification with deep convolutional neural networks. Commun ACM, 60, 84-90(2017).

    [3] HQ Zhou, YT Wang, X Li et al. A deep learning approach for trustworthy high-fidelity computational holographic orbital angular momentum communication. Appl Phys Lett, 119, 044104(2021).

    [4] YM Guo, LB Zhong, L Min et al. Adaptive optics based on machine learning: a review. Opto-Electron Adv, 5, 200082(2022).

    [5] S Krasikov, A Tranter, A Bogdanov et al. Intelligent metaphotonics empowered by machine learning. Opto-Electron Adv, 5, 210147(2022).

    [7] G Hinton, L Deng, D Yu et al. Deep neural networks for acoustic modeling in speech recognition: the shared views of four research groups. IEEE Signal Process Mag, 29, 82-97(2012).

    [8] R Collobert, J Weston, L Bottou et al. Natural language processing (almost) from scratch. J Mach Learn Res, 12, 2493-2537(2011).

    [9] H Markram. The blue brain project. Nat Rev Neurosci, 7, 153-160(2006).

    [10] YC Shen, NC Harris, S Skirlo et al. Deep learning with coherent nanophotonic circuits. Nat Photonics, 11, 441-446(2017).

    [11] J Feldmann, N Youngblood, M Karpov et al. Parallel convolutional processing using an integrated photonic tensor core. Nature, 589, 52-58(2021).

    [12] XY Xu, MX Tan, B Corcoran et al. 11 TOPS photonic convolutional accelerator for optical neural networks. Nature, 589, 44-51(2021).

    [13] E Goi, X Chen, QM Zhang et al. Nanoprinted high-neuron-density optical linear perceptrons performing near-infrared inference on a CMOS chip. Light Sci Appl, 10, 40(2021).

    [14] F Ashtiani, AJ Geers, F Aflatouni. An on-chip photonic deep neural network for image classification. Nature, 606, 501-506(2022).

    [15] S Zarei, MR Marzban, A Khavasi. Integrated photonic neural network based on silicon metalines. Opt Express, 28, 36668-36684(2020).

    [16] H Chen, JN Feng, MW Jiang et al. Diffractive deep neural networks at visible wavelengths. Engineering, 7, 1483-1491(2021).

    [17] J Liu, QH Wu, XB Sui et al. Research progress in optical neural networks: theory, applications and developments. PhotoniX, 2, 5(2021).

    [18] X Zhang, LL Huang, RZ Zhao et al. Basis function approach for diffractive pattern generation with Dammann vortex metasurfaces. Sci Adv, 8, eabp8073(2022).

    [19] X Lin, Y Rivenson, NT Yardimci et al. All-optical machine learning using diffractive deep neural networks. Science, 361, 1004-1008(2018).

    [20] RZ Zhao, LL Huang, YT Wang. Recent advances in multi-dimensional metasurfaces holographic technologies. PhotoniX, 1, 20(2020).

    [21] YX Zhang, MB Pu, JJ Jin et al. Crosstalk-free achromatic full Stokes imaging polarimetry metasurface enabled by polarization-dependent phase optimization. Opto-Electron Adv, 5, 220058(2022).

    [22] T Badloe, S Lee, J Rho. Computation at the speed of light: metamaterials for all-optical calculations and neural networks. Adv Photon, 4, 064002(2022).

    [23] M Veli, D Mengu, NT Yardimci et al. Terahertz pulse shaping using diffractive surfaces. Nat Commun, 12, 37(2021).

    [24] C Qian, X Lin, XB Lin et al. Performing optical logic operations by a diffractive neural network. Light Sci Appl, 9, 59(2020).

    [25] PP Wang, WJ Xiong, ZB Huang et al. Orbital angular momentum mode logical operation using optical diffractive neural network. Photon Res, 9, 2116-2124(2021).

    [26] ZB Huang, YL He, PP Wang et al. Orbital angular momentum deep multiplexing holography via an optical diffractive neural network. Opt Express, 30, 5569-5584(2022).

    [27] SS Rahman, A Ozcan. Computer-free, all-optical reconstruction of holograms using diffractive networks. ACS Photonics, 8, 3375-3384(2021).

    [28] D Mengu, A Ozcan. All-optical phase recovery: diffractive computing for quantitative phase imaging. Adv Opt Mater, 10, 2200281(2022).

    [29] JX Li, YC Hung, O Kulce et al. Polarization multiplexed diffractive computing: all-optical implementation of a group of linear transformations through a polarization-encoded diffractive network. Light Sci Appl, 11, 153(2022).

    [30] JS Shi, L Zhou, TG Liu et al. Multiple-view D2NNs array: realizing robust 3D object recognition. Opt Lett, 46, 3388-3391(2021).

    [31] SS Rahman, JX Li, D Mengu et al. Ensemble learning of diffractive optical networks. Light Sci Appl, 10, 14(2021).

    [32] T Yan, JM Wu, TK Zhou et al. Fourier-space diffractive deep neural network. Phys Rev Lett, 123, 023901(2019).

    [33] C Liu, Q Ma, ZJ Luo et al. A programmable diffractive deep neural network based on a digital-coding metasurface array. Nat Electron, 5, 113-122(2022).

    [34] TK Zhou, X Lin, JM Wu et al. Large-scale neuromorphic optoelectronic computing with a reconfigurable diffractive processing unit. Nat Photonics, 15, 367-373(2021).

    [35] YJ Li, RY Chen, B Sensale-Rodriguez et al. Real-time multi-task diffractive deep neural networks via hardware-software co-design. Sci Rep, 11, 11013(2021).

    [36] XH Luo, YQ Hu, XN Ou et al. Metasurface-enabled on-chip multiplexed diffractive neural networks in the visible. Light Sci Appl, 11, 158(2022).

    [37] P Georgi, QS Wei, B Sain et al. Optical secret sharing with cascaded metasurface holography. Sci Adv, 7, eabf9718(2021).

    [38] Y Lecun, L Bottou, Y Bengio et al. Gradient-based learning applied to document recognition. Proc IEEE, 86, 2278-2324(1998).

    [40] JW Goodman. Introduction to Fourier Optics and Holography(2005).

    [41] L Mandel, E Wolf. Some properties of coherent light. J Opt Soc Am, 51, 815-819(1961).

    [42] L Marrucci, C Manzo, D Paparo. Optical spin-to-orbital angular momentum conversion in inhomogeneous anisotropic media. Phys Rev Lett, 96, 163905(2006).

    Tools

    Get Citation

    Copy Citation Text

    Cong He, Dan Zhao, Fei Fan, Hongqiang Zhou, Xin Li, Yao Li, Junjie Li, Fei Dong, Yin-Xiao Miao, Yongtian Wang, Lingling Huang. Pluggable multitask diffractive neural networks based on cascaded metasurfaces[J]. Opto-Electronic Advances, 2024, 7(2): 230005-1

    Download Citation

    EndNote(RIS)BibTexPlain Text
    Save article for my favorites
    Paper Information

    Category: Research Articles

    Received: Jan. 14, 2023

    Accepted: Apr. 24, 2023

    Published Online: May. 24, 2024

    The Author Email: Wang Yongtian (YTWang), Huang Lingling (HuangLL)

    DOI:10.29026/oea.2024.230005

    Topics