Core concept
Gen 3 (H100): 64 NVLink 4 ports. Gen 4 (Blackwell): 72 ports of NVLink 5.
Advertisement
How it works
Only in DGX/HGX/SuperPod systems. Not on individual GPUs.
Advertisement
Trade-offs + gotchas
Multi-GPU training. Tensor parallelism benefits massively.