Why it matters

NVSwitch generations shape performance. Understanding shapes hardware choice.

Advertisement

The architecture

Ports per switch.

Bisection bandwidth.

Latency per hop.

NVSwitch generationsPorts18-64+ per switchBisection BWTB/s scaleHop latencysub-microsecondNVSwitch4 (Blackwell) enables 72-GPU coherent domain in NVL72 rack
NVSwitch.
Advertisement

How it works end to end

NVSwitch3: 900GB/s per GPU, 4 switches per DGX H100.

NVSwitch4: 1.8TB/s per B200, NVL72 rack-scale.