Study On Optical Communications, Volume. 50, Issue 5, 24004901(2024)

Application of Reconfigurable OCS Technology for Pre-training Large Language Models

Chen ZHU*, Xu ZHOU, and Peilong WANG
Author Affiliations
  • System Department, Baidu Online Network Technology Co., Ltd., Beijing 100085, China
  • show less
    Figures & Tables(10)
    3D hybrid parallel strategy and the logical partitioning of the corresponding computing cluster
    Rail-optimized network architecture for pre-training large language models
    Schematic diagram of an optical circuit switch
    Multi-port OCS for fast failure recovery of ToR switch
    Optical protection switch module based on small port count OCS
    Hybrid opto-electro network for Ring AR and DBT AR
    Hybrid opto-electro network for conventional and bandwidth-optimized HD AR
    Large scale rail-only opto-electro network architecture
    Large scale layer 2 EPS network expansion based on OCS
    • Table 1. Comparison of various OCS technologies

      View table
      View in Article

      Table 1. Comparison of various OCS technologies

      OCS技术规模切换时间插损/dB锁存成本
      MEMS>300ms级<3++
      压电>300ms级<3+++
      PLC>16ms级<6
      机械臂>1 000min级<1++
    Tools

    Get Citation

    Copy Citation Text

    Chen ZHU, Xu ZHOU, Peilong WANG. Application of Reconfigurable OCS Technology for Pre-training Large Language Models[J]. Study On Optical Communications, 2024, 50(5): 24004901

    Download Citation

    EndNote(RIS)BibTexPlain Text
    Save article for my favorites
    Paper Information

    Category:

    Received: Mar. 1, 2024

    Accepted: --

    Published Online: Oct. 15, 2024

    The Author Email: ZHU Chen (zhuchen06@baidu.com)

    DOI:10.13756/j.gtxyj.2024.240049

    Topics