Study On Optical Communications, Volume. 50, Issue 5, 24004901(2024)
Application of Reconfigurable OCS Technology for Pre-training Large Language Models
Fig. 1. 3D hybrid parallel strategy and the logical partitioning of the corresponding computing cluster
Fig. 2. Rail-optimized network architecture for pre-training large language models
Fig. 5. Optical protection switch module based on small port count OCS
Fig. 7. Hybrid opto-electro network for conventional and bandwidth-optimized HD AR
|
Get Citation
Copy Citation Text
Chen ZHU, Xu ZHOU, Peilong WANG. Application of Reconfigurable OCS Technology for Pre-training Large Language Models[J]. Study On Optical Communications, 2024, 50(5): 24004901
Category:
Received: Mar. 1, 2024
Accepted: --
Published Online: Oct. 15, 2024
The Author Email: ZHU Chen (zhuchen06@baidu.com)