Core concept
Configurable via nvidia-smi mig. Slices independent. QoS + fault isolation.
Advertisement
How it works
Supported on A100, H100, H200. Not consumer cards. Some kernels don't fit tiny slices.
Advertisement
Trade-offs + gotchas
Multi-tenant inference. Cost-optimize by matching model to slice size.