How do you route long-running agents across models after a cost shift?

Katleen_Cole · reddit · 2026-09-11

A Reddit user revisits agent pipeline model routing after a new model release changed capability/cost tradeoffs. The workflow spans planning, tool calls, document/image interpretation, retries and final validation, so not every step should hit the same model. He measures task success, latency, context size, retry rate and total token cost, with separate tests for KV-cache behavior on smaller models and multimodal steps, and asks what signals others use to decide which stages stay on the strongest model path.

Original post →

More from coding & agent

coding & agent channel →