Study On Optical Communications, Volume. 50, Issue 5, 24004901(2024)

Application of Reconfigurable OCS Technology for Pre-training Large Language Models

Chen ZHU*, Xu ZHOU, and Peilong WANG
Author Affiliations
  • System Department, Baidu Online Network Technology Co., Ltd., Beijing 100085, China
  • show less
    References(30)

    [1] Boser B E, Guyon I M, Vapnik V N. A Training Algorithm for Optimal Margin Classifiers[C], 144-152(1992).

    [2] Krizhevsky A, Sutskever I, Hinton G E. Im-ageNet Classification with Deep Convolutional Neural Networks[J]. Communications of the ACM, 60, 84-90(2017).

    [3] LeCun Y, Bengio Y, Hinton G. Deep Learning[J]. Nature, 521, 436-444(2015).

    [4] Cortes C, Vapnik V. Support-vector Networks[J]. Machine Learning, 20, 273-297(1995).

    [5] Quinlan J R. Induction of Decision Trees[J]. Machine Learning, 1, 81-106(1986).

    [6] Anderson J A, Rosenfeld E[M]. Neurocomputing, Volume 1: Foundations of Research(1988).

    [8] Guo C, Wu H, Deng Z et al. RDMA over Commodity Ethernet at Scale[C], 202-215(2016).

    [9] Tang Y, Yuan T, Liu B et al. Effective *-flow Schedule for Optical Circuit Switching based Data Center Networks: a Comprehensive Survey[J]. Computer Networks, 197, 108321(2021).

    [12] Banerjee D, Mukherjee B. Wavelength-routed Optical Networks: Linear Formulation, Resource Budgeting Tradeoffs, and a Reconfiguration Study[J]. IEEE/ACM Transactions on Networking, 8, 598-607(2002).

    [13] Chiu A L, Choudhury G, Clapp G et al. Architectures and Protocols for Capacity Efficient, Highly Dynamic and Highly Resilient Core Networks[J]. Journal of Optical Communications and Networking, 4, 1-14(2012).

    [14] Qiao C, Yoo M. Optical Burst Switching (OBS) - A New Paradigm for an Optical Internet[J]. Journal of High Speed Networks, 8, 69-84(1999).

    [16] Harris J M, Lindquist R, Rhee J et al[M]. Optical Switching(2008).

    [17] Huang Q[M]. Optical Switching in Next Generation Data Centers(2018).

    [18] Frisken S, Baxter G, Abakoumov D et al. Flexible and Grid-less Wavelength Selective Switch Using LCOS Technology[C], OTuM3(2011).

    [19] Doerr C R. Silicon Photonic Integration in Telecommunications[J]. Frontiers in Optics, 3, 00037(2015).

    [20] Furukawa H. Petabit-class Optical Networks and Switching Technologies[C], NeW1C(2021).

    [21] Hill K O, Malo B, Bilodeau F et al. Bragg Gratings Fabricated in Monomode Photosensitive Optical Fiber by UV Exposure through a Phase Mask[J]. Applied Physics Letters, 62, 1035-1037(1993).

    [22] Zheng X, Kaman V, Yuan S et al. Three-dimensional MEMS Photonic Cross-connect Switch Design and Performance[J]. IEEE Journal of Selected Topics in Quantum Electronics, 9, 571-578(2003).

    [23] Kewitsch A S. Large Scale, All-fiber Optical Cross-connect Switches for Automated Patch-panels[J]. Journal of Lightwave Technology, 27, 3107-3115(2009).

    [24] Barua B, Nayim M H, Bhuiyan M A M. A 2×2 MEMS Optical Switch based on Piezoelectric Actuation[C], 52-55(2006).

    [25] Sohma S, Watanabe T, Shibata T et al. Compact and Low Power Consumption 16 /Spl Times/ 16 Optical Matrix Switch with Silica-based PLC Technology[C], 193036(2005).

    [26] Patronas G, Syrivelis D, Bakopoulos P et al. Software-defined, Programmable L1 Dataplane: Demonstration of Fabric Hardware Resilience Using Optical Switches[C], 10116070(2023).

    [29] Thakur R, Rabenseifner R, Gropp W. Optimization of Collective Communication Operations in MPICH[J]. The International Journal of High Performance Computing Applications, 19, 49-66(2005).

    Tools

    Get Citation

    Copy Citation Text

    Chen ZHU, Xu ZHOU, Peilong WANG. Application of Reconfigurable OCS Technology for Pre-training Large Language Models[J]. Study On Optical Communications, 2024, 50(5): 24004901

    Download Citation

    EndNote(RIS)BibTexPlain Text
    Save article for my favorites
    Paper Information

    Category:

    Received: Mar. 1, 2024

    Accepted: --

    Published Online: Oct. 15, 2024

    The Author Email: ZHU Chen (zhuchen06@baidu.com)

    DOI:10.13756/j.gtxyj.2024.240049

    Topics