ADK Java Query Router — Cheap Model for Simple Queries

Why it matters

Query routing is huge cost lever. Understanding shapes cost-efficient serving.

The architecture

Classifier: LLM or ML model. Categorizes query.

Route to matching model tier.

How it works end to end

Classifier types: keyword rules (simplest), ML classifier, LLM as classifier.

Fallback: if cheap model fails, escalate to expensive.

Cost tracking: measure savings per route.