Photonics Research, Volume. 12, Issue 4, 682(2024)
Lensless opto-electronic neural network with quantum dot nonlinear activation
Fig. 1. Photoluminescence of
Fig. 2. Fitting nonlinear curves of quantum dots with different component molar ratios. (a) 1:9:2. (b) 1:9:0.5.
Fig. 3. Prototype for the lensless opto-electrical neural network system with optical nonlinearity. (a) Optical path diagram of the system. (b) Corresponding network structure diagram of the system.
Fig. 4. Joint optimization process based on quantum dot nonlinearity.
Fig. 5. Visual tasks and the corresponding networks used in the experiment. Among them, the left side of (a)–(c) is part of the visual task dataset, the middle is the optical mask pattern optimized for the corresponding task, and the right side is the neural network architecture of the corresponding visual task. (a) Hand sign classification. (b) Hand drawn image classification. (c) Traffic sign classification.
Fig. 6. Captured images. (a) Captured images of three visual tasks, which were rendered from raw data. (b) Comparison of images between linear and nonlinear systems. “Linear_exp” refers to the images captured in the linear system experiment, “Nonliear_sim” refers to the result of adding the measured QD nonlinearity to the images captured in the linear system experiment, and “Nonlinear_exp” refers to the images captured in the nonlinear system experiment. The red box in the figure is the enlarged part; the enlarged image is in the bottom-right corner. The “comparison” figures on the right side represent the comparisons of pixel values at the yellow line position of the corresponding three images.
Fig. 7. Results for optical nonlinear system. (a) Experimental recognition accuracy of hand sign, hand drawn image, and traffic sign classification tasks. (b) Confusion matrices of the three visual tasks based on experimental raw data. The abscissa is “predicted labels,” and the ordinate is “true labels.”
Get Citation
Copy Citation Text
Wanxin Shi, Xi Jiang, Zheng Huang, Xue Li, Yuyang Han, Sigang Yang, Haizheng Zhong, Hongwei Chen, "Lensless opto-electronic neural network with quantum dot nonlinear activation," Photonics Res. 12, 682 (2024)
Category: Imaging Systems, Microscopy, and Displays
Received: Dec. 8, 2023
Accepted: Jan. 23, 2024
Published Online: Mar. 20, 2024
The Author Email: Hongwei Chen (chenhw@tsinghua.edu.cn)
CSTR:32188.14.PRJ.515349