Acta Optica Sinica, Volume. 44, Issue 10, 1026021(2024)
Multi-Task Optoelectronic Hybrid Neural Network Based on Nonlinear Metasurface (Invited)
[1] Wetzstein G, Ozcan A, Gigan S et al. Inference in artificial intelligence with deep optics and photonics[J]. Nature, 588, 39-47(2020).
[2] LeCun Y, Bengio Y, Hinton G. Deep learning[J]. Nature, 521, 436-444(2015).
[3] Jain A K, Mao J C, Mohiuddin K M. Artificial neural networks: a tutorial[J]. Computer, 29, 31-44(1996).
[4] Silver D, Huang A, Maddison C J et al. Mastering the game of Go with deep neural networks and tree search[J]. Nature, 529, 484-489(2016).
[5] Yan T, Wu J M, Zhou T K et al. Fourier-space diffractive deep neural network[J]. Physical Review Letters, 123, 023901(2019).
[6] Liu J, Wu Q H, Sui X B et al. Research progress in optical neural networks: theory, applications and developments[J]. PhotoniX, 2, 5(2021).
[7] Shastri B J, Tait A N, de Lima T F et al. Photonics for artificial intelligence and neuromorphic computing[J]. Nature Photonics, 15, 102-114(2021).
[8] Lin X, Rivenson Y, Yardimci N T et al. All-optical machine learning using diffractive deep neural networks[J]. Science, 361, 1004-1008(2018).
[9] Luo X H, Hu Y Q, Ou X N et al. Metasurface-enabled on-chip multiplexed diffractive neural networks in the visible[J]. Light: Science & Applications, 11, 158(2022).
[10] Luo X H, Dong S Y, Wei Z Y et al. Full-fourier-component tailorable optical neural meta-transformer[J]. Laser & Photonics Reviews, 17, 2300272(2023).
[11] Qu G Y, Cai G Y, Sha X B et al. All-dielectric metasurface empowered optical-electronic hybrid neural networks[J]. Laser & Photonics Reviews, 16, 2100732(2022).
[12] Mengu D, Luo Y, Rivenson Y et al. Analysis of diffractive optical neural networks and their integration with electronic neural networks[J]. IEEE Journal of Selected Topics in Quantum Electronics, 26, 3700114(2020).
[13] Caulfield H J, Dolev S. Why future supercomputing requires optics[J]. Nature Photonics, 4, 261-263(2010).
[14] Yu N F, Genevet P, Kats M A et al. Light propagation with phase discontinuities: generalized laws of reflection and refraction[J]. Science, 334, 333-337(2011).
[15] Khorasaninejad M, Chen W T, Devlin R C et al. Metalenses at visible wavelengths: diffraction-limited focusing and subwavelength resolution imaging[J]. Science, 352, 1190-1194(2016).
[16] Luo X G. Principles of electromagnetic waves in metasurfaces[J]. Science China Physics, Mechanics & Astronomy, 58, 594201(2015).
[17] Luo X H, Dong S Y, Wang Z S et al. Research progress of metasurface-based VR/AR display technology[J]. Laser & Optoelectronics Progress, 59, 2011002(2022).
[18] Yu N F, Capasso F. Flat optics with designer metasurfaces[J]. Nature Materials, 13, 139-150(2014).
[19] Rubin N A, D'Aversa G, Chevalier P et al. Matrix Fourier optics enables a compact full-Stokes polarization camera[J]. Science, 365, eaax1839(2019).
[20] He T, Liu T, Xiao S Y et al. Perfect anomalous reflectors at optical frequencies[J]. Science Advances, 8, eabk3381(2022).
[21] Dong S Y, Zhang Z Y, Xie L Y et al. Broadband depolarized perfect Littrow diffraction with multilayer freeform metagratings[J]. Optica, 10, 585-593(2023).
[22] Feng C, He T, Shi Y Z et al. Diatomic metasurface for efficient six-channel modulation of Jones matrix[J]. Laser & Photonics Reviews, 17, 2370040(2023).
[23] Li G X, Zhang S, Zentgraf T. Nonlinear photonic metasurfaces[J]. Nature Reviews Materials, 2, 17010(2017).
[24] Walter F, Li G X, Meier C et al. Ultrathin nonlinear metasurface for optical image encoding[J]. Nano Letters, 17, 3171-3175(2017).
[25] Ye W M, Zeuner F, Li X et al. Spin and wavelength multiplexed nonlinear metasurface holography[J]. Nature Communications, 7, 11930(2016).
[26] Wang L, Kruk S, Koshelev K et al. Nonlinear wavefront control with all-dielectric metasurfaces[J]. Nano Letters, 18, 3978-3984(2018).
[27] Minovich A E, Miroshnichenko A E, Bykov A Y et al. Functional and nonlinear optical metasurfaces[J]. Laser & Photonics Reviews, 9, 195-213(2015).
[28] Gao Y S, Fan Y B, Wang Y J et al. Nonlinear holographic all-dielectric metasurfaces[J]. Nano Letters, 18, 8054-8061(2018).
[29] Tseng M L, Semmlinger M, Zhang M et al. Vacuum ultraviolet nonlinear metalens[J]. Science Advances, 8, eabn5644(2022).
[30] Deng J H, Li G X. Nonlinear photonic metasurfaces[J]. Acta Physica Sinica, 66, 147803(2017).
[31] Hu Z X, Tang Y T, Li G X. Nonlinear optical metasurfaces[J]. Physics, 50, 285-292(2021).
[32] LeCun Y, Bottou L, Bengio Y et al. Gradient-based learning applied to document recognition[J]. Proceedings of the IEEE, 86, 2278-2324(1998).
[33] Zeng Y, Hoyer W, Liu J J et al. Classical theory for second-harmonic generation from metallic nanoparticles[J]. Physical Review B, 79, 235109(2009).
[34] Devlin R C, Khorasaninejad M, Chen W T et al. Broadband high-efficiency dielectric metasurfaces for the visible spectrum[J]. Proceedings of the National Academy of Sciences of the United States of America, 113, 10473-10478(2016).
[35] Koshelev K, Kruk S, Melik-Gaykazyan E et al. Subwavelength dielectric resonators for nonlinear nanophotonics[J]. Science, 367, 288-292(2020).
[36] Xu L, Zangeneh Kamali K, Huang L J et al. Dynamic nonlinear image tuning through magnetic dipole quasi-BIC ultrathin resonators[J]. Advanced Science, 6, 1802119(2019).
[38] Li J X, Mengu D, Yardimci N T et al. Spectrally encoded single-pixel machine vision using diffractive networks[J]. Science Advances, 7, eabd7690(2021).
[39] Dou H K, Deng Y, Yan T et al. Residual D2NN: training diffractive deep neural networks via learnable light shortcuts[J]. Optics Letters, 45, 2688-2691(2020).
Get Citation
Copy Citation Text
Xuhao Luo, Siyu Dong, Zeyong Wei, Zhanshan Wang, Xinbin Cheng. Multi-Task Optoelectronic Hybrid Neural Network Based on Nonlinear Metasurface (Invited)[J]. Acta Optica Sinica, 2024, 44(10): 1026021
Category: Physical Optics
Received: Jan. 2, 2024
Accepted: Mar. 28, 2024
Published Online: May. 6, 2024
The Author Email: Dong Siyu (dongsy@tongji.edu.cn), Cheng Xinbin (chengxb@tongji.edu.cn)
CSTR:32393.14.AOS240437