NVLink Switch(900GB/s)
GPU 7
GPU 6
GPU 5
GPU 4
GPU 3
GPU 2
infiniBand NDR400Gb/s
HDR200Gb/s
GPU 1
GPU 0
Compute Node 02(HGX H100)
Compute Node 03(HGX H100)
Low Latency <1µs
分布式大模型训练算力集群网络拓扑图
Core Switch核心交换机层(Quantum-2 NDR)
Spine Switch 01汇聚交换机(400G IB)
Spine Switch 02汇聚交换机(400G IB)
Spine Switch 03汇聚交换机(400G IB)
Spine Switch 04汇聚交换机(400G IB)
Compute Node 01(HGX H100)
Compute Node 04(HGX H100)