Core concept

Rail-aligned: 1 GPU per NIC. NCCL uses per-rail parallelism.

Advertisement

How it works

PCIe Gen5 to host (128 GB/s per GPU). NUMA affinity matters.

Advertisement

Trade-offs + gotchas

Understanding for training tuning. Where bottlenecks live.