Split decisions from generation: 11 decision points, only 2 real generation calls per agent loop

blaizedsouza · x · 2026-09-28

The key split in agent architecture isn't "small model vs big model" — it's deciding which calls actually need generation at all.
A lightweight decision layer (jev) routes the next worker, scores which context is worth keeping, catches repeated actions before they burn a run, gates risky tool calls, and sends uncertainty to human review. Opus handles only the expensive parts: planning, writing, coding, synthesis.
Rationale: a typical loop has 11 decision points but only 2 real generation calls. Separating them means latency and cost stop scaling with every tiny fork in the workflow.
With this split, agent architecture looks surprisingly overcomplicated in hindsight.

More from coding & agent