Photonics Research, Volume. 10, Issue 8, 1868(2022)

Generalized robust training scheme using genetic algorithm for optical neural networks with imprecise components

Rui Shao1, Gong Zhang1,2、*, and Xiao Gong1,3、*
Author Affiliations
  • 1Department of Electrical & Computer Engineering, National University of Singapore, Singapore, Singapore
  • 2e-mail: zhanggong@nus.edu.sg
  • 3e-mail: elegong@nus.edu.sg
  • show less
    Figures & Tables(9)
    (a) Illustration of artificial neural network (ANN) architecture for image recognition implemented by photonic units, including optical input encoding parts, optical interference units, optical nonlinear units, and photodetectors. (b) Demonstration of a programmable Mach–Zehnder interferometer consisting of directional couplers and thermo-optical phase shifters.
    Heat map of classification accuracy in the MNIST dataset with the imprecise ONN chip. (a) Classification performance between phase shift error σ and per MZI loss α. (b) Effects of phase shift error σ and extinction ratio E. (c) Impacts of phase shift error σ and photodetection noise σD on the final achieved network performance.
    Training flow of the ONN with parameter imprecisions using the genetic algorithm. Two major stages are involved and illustrated, including gradient training of the ideal ONN and genetic training in the imprecise chips.
    Training curves of the ideal ONN using gradient descent algorithm in (a) Iris and (b) MNIST datasets, including loss curve as well as accuracies in training and test datasets. (c) Maximum accuracy in each generation at the GA training stage considering imprecise optical components. The optimal individual can have 91.4% and 82.7% accuracy in Iris and MNIST datasets, respectively. (d) Accuracy distribution with and without GA training in Iris and MNIST datasets. (e) Comparisons of training curves between the two-step training method and the only GA training method in Iris and MNIST datasets. (f) Standard deviations of accuracy distributions in Iris and MNIST datasets with different numbers of layers and different layer widths.
    (a) Accuracy training curves in the MNIST dataset during the GA training stage in the condition of typical error ranges {σall∈[0.04,0.05],α∈[0.05,0.1],E∈[13,15],σD∈[0.04,0.05]} and experimentally measured low error ranges {σall∈[0.004,0.005],α∈[0.04,0.05],E∈[20,23],σD∈[0.0009,0.0011]}. (b) Accuracy distribution of imprecise chips in two error range cases.
    (a) Accuracy training curves in the GA training stage in different compensated phase shift ranges {Δξ}. (b) Effects of compensated phase shift ranges {Δξ} on the accuracy distribution in imprecise chips.
    (a) Accuracy training curves in the GA training stage using different numbers of imprecise chips M. (b) Effects of the number of imprecise chips M on accuracy distribution.
    (a) Accuracy training curves in the GA training stage in the condition of different populations. (b) Effects of different populations in evolution on the accuracy distribution in imprecise chips.
    (a) Accuracy training curves in three heuristic algorithms with the accuracy converging to a particular value. (b) Accuracy distribution of three algorithms in the same imprecise chips.
    Tools

    Get Citation

    Copy Citation Text

    Rui Shao, Gong Zhang, Xiao Gong. Generalized robust training scheme using genetic algorithm for optical neural networks with imprecise components[J]. Photonics Research, 2022, 10(8): 1868

    Download Citation

    EndNote(RIS)BibTexPlain Text
    Save article for my favorites
    Paper Information

    Category: Instrumentation and Measurements

    Received: Dec. 3, 2021

    Accepted: Mar. 18, 2022

    Published Online: Jul. 21, 2022

    The Author Email: Gong Zhang (zhanggong@nus.edu.sg), Xiao Gong (elegong@nus.edu.sg)

    DOI:10.1364/PRJ.449570

    Topics