Model routing debate: should the router live inside the harness or outside it?
hwchase17 · x · 2026-07-23
A practical question for model routing: should the router be harness-aware and live inside the harness, or can it sit in a separate harness-agnostic gateway?
- The post frames this as an architecture choice for routing systems used around coding agents.
- It implicitly asks whether routing logic needs access to harness state to make better model-selection decisions, or whether a clean external gateway is enough.
More from coding & agent
- Reticle builds a verification layer that lets AI coding agents check their own generated code — Scobleizer · 2026-10-27
- Trust your agent, but read its logs: Claude managed agents tips — brada · 2026-10-27
- Dev training a guard model to block prompt injection, tool and memory poisoning — gnukeith · 2026-10-27
- Dev trains a ~4GB-VRAM sentinel model to guard against prompt injection and poisoned memory — gnukeith · 2026-10-27
- Superset rebrands as Paradev, raises $11.5M seed led by USV — massimosgrelli · 2026-10-27
- Ex-Big Tech managers may thrive in the AI era: manage agents like you managed teams — lxfater · 2026-10-27