Core concept
Drop-in for H100 in most workloads. Bigger models fit. Higher bandwidth = faster inference.
Advertisement
How it works
Same TDP as H100 SXM (700W). Same NVLink 4. Same everything except memory.
Advertisement
Trade-offs + gotchas
LLM inference (bigger models). Any workload memory-bandwidth-bound.