Metasurface Optical Diffraction Neural Network and Its Applications (Invited)

Hao Li; Fengjun Li; Xiangping Li

doi:10.3788/LOP240548

Laser & Optoelectronics Progress, Volume. 61, Issue 19, 1913016(2024)

Metasurface Optical Diffraction Neural Network and Its Applications (Invited)

Hao Li, Fengjun Li, and Xiangping Li^*

Guangdong Provincial Key Laboratory of Optical Fiber Sensing and Communications, Institute of Photonics Technology, Jinan University, Guangzhou 510632, Guangdong , China

show less

Abstract Get PDF(in Chinese)

References(57)

[1] LeCun Y, Bengio Y, Hinton G. Deep learning[J]. Nature, 521, 436-444(2015).

[2] Merolla P A, Arthur J V, Alvarez-Icaza R et al. A million spiking-neuron integrated circuit with a scalable communication network and interface[J]. Science, 345, 668-673(2014).

[3] Jain A K, Mao J C, Mohiuddin K M. Artificial neural networks: a tutorial[J]. Computer, 29, 31-44(1996).

[4] Guo X H, Xiang J L, Zhang Y J et al. Integrated neuromorphic photonics: synapses, neurons, and neural networks[J]. Advanced Photonics Research, 2, 2170019(2021).

[5] Zhou C, Li Q, Li C et al. A comprehensive survey on pretrained foundation models: a history from BERT to ChatGPT[EB/OL]. https://arxiv.org/abs/2302.09419

[6] Lin X, Rivenson Y, Yardimci N T et al. All-optical machine learning using diffractive deep neural networks[J]. Science, 361, 1004-1008(2018).

[7] Goodman J W, Dias A R, Woody L M. Fully parallel, high-speed incoherent optical method for performing discrete Fourier transforms[J]. Optics Letters, 2, 1-3(1978).

[8] Farhat N H, Psaltis D, Prata A et al. Optical implementation of the Hopfield model[J]. Applied Optics, 24, 1469-1475(1985).

[9] Shen Y C, Harris N C, Skirlo S et al. Deep learning with coherent nanophotonic circuits[J]. Nature Photonics, 11, 441-446(2017).

[10] Chang J L, Sitzmann V, Dun X et al. Hybrid optical-electronic convolutional neural networks with optimized diffractive optics for image classification[J]. Scientific Reports, 8, 12324(2018).

[11] Khorasaninejad M, Chen W T, Devlin R C et al. Metalenses at visible wavelengths: diffraction-limited focusing and subwavelength resolution imaging[J]. Science, 352, 1190-1194(2016).

[12] Sun S L, He Q, Xiao S Y et al. Gradient-index meta-surfaces as a bridge linking propagating waves and surface waves[J]. Nature Materials, 11, 426-431(2012).

[13] Deng Z L, Tu Q G, Wang Y J et al. Vectorial compound metapixels for arbitrary nonorthogonal polarization steganography[J]. Advanced Materials, 33, e2103472(2021).

[14] Bao Y J, Yu Y, Xu H F et al. Coherent pixel design of metasurfaces for multidimensional optical control of multiple printing-image switching and encoding[J]. Advanced Functional Materials, 28, 1805306(2018).

[15] Deng Z L, Deng J H, Zhuang X et al. Diatomic metasurface for vectorial holography[J]. Nano Letters, 18, 2885-2892(2018).

[16] Ren H R, Briere G, Fang X Y et al. Metasurface orbital angular momentum holography[J]. Nature Communications, 10, 2986(2019).

[17] Chen M L N, Jiang L J, Sha W. Detection of orbital angular momentum with metasurface at microwave band[J]. IEEE Antennas and Wireless Propagation Letters, 17, 110-113(2018).

[18] Rayleigh F R S L. On the manufacture and theory of diffraction-gratings[J]. The London, Edinburgh, and Dublin Philosophical Magazine and Journal of Science, 47, 81-93(1874).

[19] Yan T, Wu J M, Zhou T K et al. Fourier-space diffractive deep neural network[J]. Physical Review Letters, 123, 023901(2019).

[20] Veli M, Mengu D, Yardimci N T et al. Terahertz pulse shaping using diffractive surfaces[J]. Nature Communications, 12, 37(2021).

[21] Li J X, Mengu D, Yardimci N T et al. Spectrally encoded single-pixel machine vision using diffractive networks[J]. Science Advances, 7, eabd7690(2021).

[22] Huang Z B, Wang P P, Liu J M et al. All-optical signal processing of vortex beams with diffractive deep neural networks[J]. Physical Review Applied, 15, 014037(2021).

[23] Wu Z C, Zhou M, Khoram E et al. Neuromorphic metasurface[J]. Photonics Research, 8, 46-50(2019).

[24] Luo X H, Hu Y Q, Ou X N et al. Metasurface-enabled on-chip multiplexed diffractive neural networks in the visible[J]. Light, Science & Applications, 11, 158(2022).

[25] Li J X, Hung Y C, Kulce O et al. Polarization multiplexed diffractive computing: all-optical implementation of a group of linear transformations through a polarization-encoded diffractive network[J]. Light, Science & Applications, 11, 153(2022).

[26] Wang Y Z, Yu A X, Cheng Y Y et al. Matrix diffractive deep neural networks merging polarization into meta-devices[J]. Laser & Photonics Reviews, 18, 2300903(2024).

[27] Zhou T K, Fang L, Yan T et al. In situ optical backpropagation training of diffractive optical neural networks[J]. Photonics Research, 8, 940-953(2020).

[28] Li J X, Mengu D, Luo Y et al. Class-specific differential detection in diffractive optical neural networks improves inference accuracy[J]. Advanced Photonics, 1, 046001(2019).

[29] Li J X, Gan T Y, Bai B J et al. Massively parallel universal linear transformations using a wavelength-multiplexed diffractive optical network[J]. Advanced Photonics, 5, 016003(2023).

[30] Wang B, Dong F L, Li Q T et al. Visible-frequency dielectric metasurfaces for multiwavelength achromatic and highly dispersive holograms[J]. Nano Letters, 16, 5235-5240(2016).

[31] Xiong B, Xu Y H, Wang J N et al. Realizing colorful holographic mimicry by metasurfaces[J]. Advanced Materials, 33, 2005864(2021).

[32] Yang D H, Lin J, Chen C et al. Multiwavelength high-order optical vortex detection and demultiplexing coding using a metasurface[J]. Advanced Photonics Nexus, 1, 016005(2022).

[33] Duan Z Y, Chen H, Lin X. Optical multi-task learning using multi-wavelength diffractive deep neural networks[J]. Nanophotonics, 12, 615(2023).

[34] Chen Y S, Zhu J F. An optical diffractive deep neural network with multiple frequency-channels[EB/OL]. https://arxiv.org/abs/1912.10730

[35] He C, Zhao D, Fan F et al. Pluggable multitask diffractive neural networks based on cascaded metasurfaces[J]. Opto-Electronic Advances, 7, 230005(2024).

[36] Li Y J, Gao W L, Yu C X. RubikONNs: multi-task learning with Rubik’s diffractive optical neural networks[EB/OL]. https://arxiv.org/abs/2304.12985

[37] Allen L, Beijersbergen M W, Spreeuw R J et al. Orbital angular momentum of light and the transformation of Laguerre-Gaussian laser modes[J]. Physical Review A, 45, 8185-8189(1992).

[38] Lee S H, Grier D G. Giant colloidal diffusivity on corrugated optical vortices[J]. Physical Review Letters, 96, 190601(2006).

[39] Kozawa Y, Matsunaga D, Sato S. Superresolution imaging via superoscillation focusing of a radially polarized beam[J]. Optica, 5, 86-92(2018).

[40] Keren-Zur S, Avayu O, Michaeli L et al. Nonlinear beam shaping with plasmonic metasurfaces[J]. ACS Photonics, 3, 117-123(2016).

[41] Fu S Y, Shang Z J, Hai L et al. Orbital angular momentum comb generation from azimuthal binary phases[J]. Advanced Photonics Nexus, 1, 016003(2022).

[42] Cheng J P, Sha X B, Zhang H et al. Ultracompact orbital angular momentum sorter on a CMOS chip[J]. Nano Letters, 22, 3993-3999(2022).

[43] Zi J C, Li Y F, Feng X et al. Dual-functional terahertz waveplate based on all-dielectric metamaterial[J]. Physical Review Applied, 13, 034042(2020).

[44] Zhang J Q, Ye Z Y, Yin J H et al. Polarized deep diffractive neural network for sorting, generation, multiplexing, and de-multiplexing of orbital angular momentum modes[J]. Optics Express, 30, 26728-26741(2022).

[45] Goi E, Chen X, Zhang Q M et al. Nanoprinted high-neuron-density optical linear perceptrons performing near-infrared inference on a CMOS chip[J]. Light, Science & Applications, 10, 40(2021).

[46] Qu G Y, Cai G Y, Sha X B et al. All-dielectric metasurface empowered optical-electronic hybrid neural networks[J]. Laser & Photonics Reviews, 16, 2100732(2022).

[47] Goi E, Schoenhardt S, Gu M. Direct retrieval of Zernike-based pupil functions using integrated diffractive deep neural networks[J]. Nature Communications, 13, 7531(2022).

[48] Gu M, Dong Y B, Yu H Y et al. Perspective on 3D vertically-integrated photonic neural networks based on VCSEL arrays[J]. Nanophotonics, 12, 437(2023).

[49] He K M, Zhang X Y, Ren S Q et al. Deep residual learning for image recognition[C], 770-778(2016).

[50] Graves A, Mohamed A R, Hinton G. Speech recognition with deep recurrent neural networks[C], 6645-6649(2013).

[51] Young T, Hazarika D, Poria S et al. Recent trends in deep learning based natural language processing[J]. IEEE Computational Intelligence Magazine, 13, 55-75(2018).

[52] Mengu D, Veli M, Rivenson Y et al. Classification and reconstruction of spatially overlapping phase images using diffractive optical networks[J]. Scientific Reports, 12, 8446(2022).

[53] Liu C, Ma Q, Luo Z J et al. A programmable diffractive deep neural network based on a digital-coding metasurface array[J]. Nature Electronics, 5, 113-122(2022).

[54] Qian C, Lin X, Lin X B et al. Performing optical logic operations by a diffractive neural network[J]. Light, Science & Applications, 9, 59(2020).

[55] Zhao Z H, Wang Y, Guan C S et al. Deep learning-enabled compact optical trigonometric operator with metasurface[J]. PhotoniX, 3, 15(2022).

[56] Luo Y, Zhao Y F, Li J X et al. Computational imaging without a computer: seeing through random diffusers at the speed of light[J]. eLight, 2, 4(2022).

[57] Cui K Y, Rao S J, Xu S et al. Metasurface-based spectral convolutional neural network for matter meta-imaging[EB/OL]. https://arxiv.org/abs/2306.10701

Tools

Get Citation

Copy Citation Text

Hao Li, Fengjun Li, Xiangping Li. Metasurface Optical Diffraction Neural Network and Its Applications (Invited)[J]. Laser & Optoelectronics Progress, 2024, 61(19): 1913016

Download Citation

EndNote(RIS)BibTex Plain Text

Set citation alerts for article

Save article for my favorites

Paper Information

Category: Integrated Optics

Received: Mar. 7, 2024

Accepted: Mar. 21, 2024

Published Online: Oct. 18, 2024

The Author Email: Xiangping Li (xiangpingli@jnu.edn.cn)

DOI:10.3788/LOP240548

CSTR:32186.14.LOP240548

Topics

laser devices and laser physics

Lasers and Laser Optics

Laser physics

laser manufacturing

Instrumentation, Measurement and Metrology