Study On Optical Communications, Volume. 50, Issue 5, 24004901(2024)
Application of Reconfigurable OCS Technology for Pre-training Large Language Models
[1] Boser B E, Guyon I M, Vapnik V N. A Training Algorithm for Optimal Margin Classifiers[C], 144-152(1992).
[2] Krizhevsky A, Sutskever I, Hinton G E. Im-ageNet Classification with Deep Convolutional Neural Networks[J]. Communications of the ACM, 60, 84-90(2017).
[3] LeCun Y, Bengio Y, Hinton G. Deep Learning[J]. Nature, 521, 436-444(2015).
[4] Cortes C, Vapnik V. Support-vector Networks[J]. Machine Learning, 20, 273-297(1995).
[5] Quinlan J R. Induction of Decision Trees[J]. Machine Learning, 1, 81-106(1986).
[6] Anderson J A, Rosenfeld E[M]. Neurocomputing, Volume 1: Foundations of Research(1988).
[8] Guo C, Wu H, Deng Z et al. RDMA over Commodity Ethernet at Scale[C], 202-215(2016).
[9] Tang Y, Yuan T, Liu B et al. Effective *-flow Schedule for Optical Circuit Switching based Data Center Networks: a Comprehensive Survey[J]. Computer Networks, 197, 108321(2021).
[12] Banerjee D, Mukherjee B. Wavelength-routed Optical Networks: Linear Formulation, Resource Budgeting Tradeoffs, and a Reconfiguration Study[J]. IEEE/ACM Transactions on Networking, 8, 598-607(2002).
[13] Chiu A L, Choudhury G, Clapp G et al. Architectures and Protocols for Capacity Efficient, Highly Dynamic and Highly Resilient Core Networks[J]. Journal of Optical Communications and Networking, 4, 1-14(2012).
[14] Qiao C, Yoo M. Optical Burst Switching (OBS) - A New Paradigm for an Optical Internet[J]. Journal of High Speed Networks, 8, 69-84(1999).
[16] Harris J M, Lindquist R, Rhee J et al[M]. Optical Switching(2008).
[17] Huang Q[M]. Optical Switching in Next Generation Data Centers(2018).
[18] Frisken S, Baxter G, Abakoumov D et al. Flexible and Grid-less Wavelength Selective Switch Using LCOS Technology[C], OTuM3(2011).
[19] Doerr C R. Silicon Photonic Integration in Telecommunications[J]. Frontiers in Optics, 3, 00037(2015).
[20] Furukawa H. Petabit-class Optical Networks and Switching Technologies[C], NeW1C(2021).
[21] Hill K O, Malo B, Bilodeau F et al. Bragg Gratings Fabricated in Monomode Photosensitive Optical Fiber by UV Exposure through a Phase Mask[J]. Applied Physics Letters, 62, 1035-1037(1993).
[22] Zheng X, Kaman V, Yuan S et al. Three-dimensional MEMS Photonic Cross-connect Switch Design and Performance[J]. IEEE Journal of Selected Topics in Quantum Electronics, 9, 571-578(2003).
[23] Kewitsch A S. Large Scale, All-fiber Optical Cross-connect Switches for Automated Patch-panels[J]. Journal of Lightwave Technology, 27, 3107-3115(2009).
[24] Barua B, Nayim M H, Bhuiyan M A M. A 2×2 MEMS Optical Switch based on Piezoelectric Actuation[C], 52-55(2006).
[25] Sohma S, Watanabe T, Shibata T et al. Compact and Low Power Consumption 16 /Spl Times/ 16 Optical Matrix Switch with Silica-based PLC Technology[C], 193036(2005).
[26] Patronas G, Syrivelis D, Bakopoulos P et al. Software-defined, Programmable L1 Dataplane: Demonstration of Fabric Hardware Resilience Using Optical Switches[C], 10116070(2023).
[29] Thakur R, Rabenseifner R, Gropp W. Optimization of Collective Communication Operations in MPICH[J]. The International Journal of High Performance Computing Applications, 19, 49-66(2005).
Get Citation
Copy Citation Text
Chen ZHU, Xu ZHOU, Peilong WANG. Application of Reconfigurable OCS Technology for Pre-training Large Language Models[J]. Study On Optical Communications, 2024, 50(5): 24004901
Category:
Received: Mar. 1, 2024
Accepted: --
Published Online: Oct. 15, 2024
The Author Email: ZHU Chen (zhuchen06@baidu.com)