Core concept
H100: 132 SMs × 128 CUDA cores + 4 tensor cores = 16896 CUDA cores + 528 tensor cores. B200: even more.
Advertisement
How it works
CUDA cores = FP32/INT32 units. Tensor cores = matmul specialized. RT cores = ray tracing.
Advertisement
Trade-offs + gotchas
Understand for kernel design. Grid + block sizing. Occupancy.