Core concept

v5p Pod: up to 8960 chips. v6 Trillium Pod: 10s of thousands.

Advertisement

How it works

Google Cloud only. XLA/JAX programming.

Advertisement

Trade-offs + gotchas

Google-scale training. Anthropic uses TPU + Trainium.