Why it matters

Time slicing enables dev / test sharing. Understanding shapes options.

Advertisement

The architecture

NVIDIA device plugin config.

Multiple replicas advertised per GPU.

Preemptive scheduling.

Time slicing configDevice pluginadvertise N replicasTime-shareon single GPUContainerspreemptive shareNo memory / SM isolation; suitable for dev / test / bursty inference
Time slicing.
Advertisement

How it works end to end

NVIDIA k8s-device-plugin.

replicas-per-gpu config.

Simple to enable.

No performance isolation.