Core concept

P4d/P4de (A100 40GB/80GB): previous gen. Cheaper. Still deployed widely.

Advertisement

How it works

Cost $30-100+/hr per instance. Reserved for savings. Capacity blocks for guaranteed access.

Advertisement

Trade-offs + gotchas

Training + heavy inference. AWS-native.