Chinese Journal of Lasers, Volume. 47, Issue 5, 0500004(2020)

Advances and Challenges of Optical Neural Networks

Hongwei Chen1,2、*, Zhenming Yu3, Tian Zhang3, Yubin Zang1,2, Yihang Dan3, and Kun Xu3
Author Affiliations
  • 1Department of Electronic Engineering, Tsinghua University, Beijing 100084, China
  • 2Beijing National Research Center for Information Science and Technology (BNRist), Beijing 100084, China
  • 3State Key Laboratory of Information Photonics and Optical Communications,Beijing University of Posts and Telecommunications, Beijing 100876, China
  • show less
    References(54)

    [2] Al-Qizwini M, Barjasteh I, Al-Qassab H et al. Deep learning algorithm for autonomous driving using GoogLeNet. [C]∥2017 IEEE Intelligent Vehicles Symposium (IV), June 11-14, 2017. Los Angeles, CA, USA. NewYork: IEEE, 89-96(2017).

    [3] Garg R[M]. Vijay K B G, Carneiro G, et al. Unsupervised CNN for single view depth estimation: geometry to the rescue, 740-756(2016).

    [4] LeCun Y, Bottou L, Bengio Y et al. Gradient-based learning applied to document recognition[J]. Proceedings of the IEEE, 86, 2278-2324(1998).

    [5] Sercu T, Puhrsch C, Kingsbury B et al. Very deep multilingual convolutional neural networks for LVCSR. [C]∥2016 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), March 20-25, 2016. Shanghai. [s.n.]:IEEE, 4955-4959(2016).

    [6] Zaharia M, Chowdhury M, Das T et al[2019-11-20]. Resilient distributed datasets: a fault-tolerant abstraction for in-memory cluster computinghttp:∥citeseerx.ist.psu.edu/viewdoc/download;jsessionid=E2EF85C42E9B7DB99EF31A33BAE02668?doi=10.1.1.225.856&.

    [7] Waldrop M M. The chips are down for Moore's law[J]. Nature, 530, 144-147(2016).

    [8] Highlander T. Swansea[2019-11-20]. http:∥www.bmva.org/bmvc/2015/papers/paper160/index.html.(2015).

    [9] Li T Y. Optical fiber communication-the state of the art[J]. IEEE Transactions on Communications, 26, 946-955(1978).

    [10] Kaushal H, Jain V K, Kar S. Overview of wireless optical communication systems[M]. ∥Optical Networks. New Delhi: Springer India, 1-39(2017).

    [11] French P, Patterson M. Advances in optical imaging, photon migration, and tissue optics[J]. Optics and Photonics News, 10, 93-94(1999).

    [12] Zhang J, Zhang L, Zeng F et al. Development status of airborne 3D imaging lidar systems[J]. Chinese Optics, 4, 213-232(2011).

    [13] Saruwatari M. All-optical signal processing for terabit/second optical transmission[J]. IEEE Journal of Selected Topics in Quantum Electronics, 6, 1363-1374(2000).

    [14] Brzozowski L, Sargent E H. Optical signal processing using nonlinear distributed feedback structures[J]. IEEE Journal of Quantum Electronics, 36, 550-555(2000).

    [15] Reck M, Zeilinger A, Bernstein H J et al. Experimental realization of any discrete unitary operator[J]. Physical Review Letters, 73, 58(1994).

    [16] Ribeiro A, Ruocco A, Vanacker L et al. Demonstration of a 4×4-port universal linear circuit[J]. Optica, 3, 1348-1357(2016).

    [17] Clements W R, Humphreys P C, Metcalf B J et al. Optimal design for universal multiport interferometers[J]. Optica, 3, 1460-1465(2016).

    [18] Shen Y C, Harris N C, Skirlo S et al. Deep learning with coherent nanophotonic circuits[J]. Nature Photonics, 11, 441(2017).

    [19] Bagherian H, Skirlo S, Shen Y C et al[2019-11-20]. On-chip optical convolutional neural networks [2019-11-20].https:∥arxiv., org/abs/1808, 03303.

    [24] Bueno J, Maktoobi S, Froehly L et al. Reinforcement learning in a large-scale photonic recurrent neural network[J]. Optica, 5, 756-760(2018).

    [25] Paquot Y, Duport F, Smerieri A et al. Optoelectronic reservoir computing[J]. Scientific Reports, 2, 287(2012).

    [28] Maass W. Networks of spiking neurons: the third generation of neural network models[J]. Neural Networks, 10, 1659-1671(1997).

    [29] Shastri B J, Nahmias M A, Tait A N et al. Spike processing with a graphene excitable laser[J]. Scientific Reports, 6, 19126(2016).

    [30] Peng H T. Nahmias M A,de Lima T F, et al. Neuromorphic photonic integrated circuits[J]. IEEE Journal of Selected Topics in Quantum Electronics, 24, 1-15(2018).

    [32] Bohte S M, Kok J N. LaPoutré H. Error-backpropagation in temporally encoded networks of spiking neurons[J]. Neurocomputing, 48, 17-37(2002).

    [33] Gütig R, Sompolinsky H. The tempotron: a neuron that learns spike timing-based decisions[J]. Nature Neuroscience, 9, 420-428(2006).

    [34] Song S, Miller K D, Abbott L F. Competitive Hebbian learning through spike-timing-dependent synaptic plasticity[J]. Nature Neuroscience, 3, 919-926(2000).

    [35] Ponulak F, Kasiński A. Supervised learning in spiking neural networks with ReSuMe: sequence learning, classification, and spike shifting[J]. Neural Computation, 22, 467-510(2010).

    [36] Mohemmed A, Schliebs S, Matsuda S et al. Span:spike pattern association neuron for learning spatio-temporal spike patterns[J]. International Journal of Neural Systems, 22, 1250012(2012).

    [37] Yu Q, Tang H J, Tan K C et al. Precise-spike-driven synaptic plasticity: learning hetero-association of spatiotemporal spike patterns[J]. PLoS One, 8, e78318(2013).

    [38] Hughes T W, Minkov M, Shi Y et al. Training of photonic neural networks through in situ backpropagation and gradient measurement[J]. Optica, 5, 864-871(2018).

    [39] Zhang T, Wang J, Dan Y H et al. Efficient training and design of photonic neural network through neuroevolution[J]. Optics Express, 27, 37150(2019).

    [40] Xie L, Liang H N, Tong L. Recognition of signal modulation types in complex optical networks[J]. Laser Journal, 39, 130-133(2018).

    [41] Pei Y H, Qu Y, Li J M et al. Modulation recognition of MPSK and MQAM signals based on AlexNet[J]. Laser Journal, 39, 75-78(2018).

    [42] Selden A C. Pulse transmission through a saturable absorber[J]. British Journal of Applied Physics, 18, 743-748(1967).

    [44] Gao Y C, Zhang X R, Li Y L et al. Saturable absorption and reverse saturable absorption in platinum nanoparticles[J]. Optics Communications, 251, 429-433(2005).

    [45] Williamson I A D, Hughes T W, Minkov M et al. Reprogrammable electro-optic nonlinear activation functions for optical neural networks[J]. IEEE Journal of Selected Topics in Quantum Electronics, 26, 1-12(2020).

    [46] Feldmann J, Youngblood N, Wright C D et al. All-optical spiking neurosynaptic networks with self-learning capabilities[J]. Nature, 569, 208-214(2019).

    [48] Lim G K, Chen Z L, Clark J et al. Giant broadband nonlinear optical absorptionresponse in dispersed graphene single sheets[J]. Nature Photonics, 5, 554-560(2011).

    [49] Hu X, Wang AD, Zeng M Q et al. Graphene-assisted multiple-input high-base optical computing[J]. Scientific Reports, 6, 32911(2016).

    [50] Yadav R K, Aneesh J, Sharma R et al. Designing hybrids of graphene oxide and gold nanoparticles for nonlinear optical response[J]. Physical Review Applied, 9, 044043(2018).

    [51] Miscuglio M, Mehrabian A, Hu Z B et al. All-optical nonlinear activation function for photonic neural networks [Invited][J]. Optical Materials Express, 8, 3851(2018).

    [52] Ramachandran P, Zoph B, Le Q V[2019-11-20]. Searching for activation functions [2019-11-20]. https:∥arxiv.org/abs/1710.05941.pdf..

    [53] Lin X, Rivenson Y, Yardimci N T et al. All-optical machine learning using diffractive deep neural networks[J]. Science, 361, 1004-1008(2018).

    [54] Zang Y B, Chen M H, Yang S G et al. Electro-optical neural networks based on time-stretch method[J]. IEEE Journal of Selected Topics in Quantum Electronics, 26, 1-10(2020).

    [55] Yu Z M, Zhao X, Yang S G et al. Binarized coherent optical receiver based on opto-electronic neural network[J]. IEEE Journal of Selected Topics in Quantum Electronics, 26, 1-9(2020).

    Tools

    Get Citation

    Copy Citation Text

    Hongwei Chen, Zhenming Yu, Tian Zhang, Yubin Zang, Yihang Dan, Kun Xu. Advances and Challenges of Optical Neural Networks[J]. Chinese Journal of Lasers, 2020, 47(5): 0500004

    Download Citation

    EndNote(RIS)BibTexPlain Text
    Save article for my favorites
    Paper Information

    Category: reviews

    Received: Nov. 26, 2019

    Accepted: Dec. 24, 2019

    Published Online: May. 12, 2020

    The Author Email: Hongwei Chen (chenhw@tsinghua.edu.cn)

    DOI:10.3788/CJL202047.0500004

    Topics