Why it matters

Timeouts shape reliability. Foundation for robust agents.

Advertisement

The architecture

HTTP client timeout.

Overall agent timeout.

Per-tool timeout.

Timeout hierarchyClient timeoutHTTP connect + readTool timeoutper invocationAgent overallsession capCancel propagation via CompletableFuture / structured concurrency
Timeouts.
Advertisement

How it works end to end

OkHttp / Apache HttpClient timeouts.

CompletableFuture orTimeout.

Structured concurrency in Java 21+.

Cancel downstream on timeout.