Why it matters

Streaming tool results shapes agent latency for slow tools. Growing pattern.

Advertisement

The architecture

Tool: returns Flux instead of single result.

Aggregate + send to LLM.

Streaming toolToolreturns FluxStream chunksas generatedAggregatesend final to LLMNot all LLMs accept streaming tool results; check provider support
Tool streaming.
Advertisement

How it works end to end

Reactive Flux from tool.

UI streams chunks.

Final aggregate sent to LLM for next step.