What to run at edge
Authentication + routing + light preprocessing. Heavy LLM calls stay origin-side.
Advertisement
GraalVM native-image
Compile Java to native binary. Fast startup, small footprint. Not full JVM but enough for adapters.
Advertisement
Latency wins
Auth check + geo-routing at edge = 10ms instead of 100ms round-trip to origin.