A production multi-agent team says deterministic orchestration works better than deterministic LLMs
njanChe1 · reddit · 2026-07-23
Spent two years running a multi-agent ESG analytics system in production, and the key lesson was to stop trying to make the LLM deterministic.
Instead, the team made the orchestration deterministic:
- The planner emits a typed task graph that describes what to do, not how to do it.
- Work is dispatched through durable queues, so worker failures do not lose in-flight state.
- The aggregator pre-registers the expected task set before execution, avoiding premature synthesis and hangs.
The author argues that stochasticity should be isolated in workers, where judgment is useful, while the control plane stays boring and reliable. The one open concern: they currently trust the planner’s emitted task list without validating schema first, and ask how others gate LLM-generated plans.
More from coding & agent
- Alex Townsend posts 200 open problems in numerical linear algebra for humans and AI agents — IgorCarron · 2026-09-11
- Kimi K2.8 Preview rolls out: near-K3 coding performance, 1M context for all tiers — teortaxesTex · 2026-09-11
- Looking for a classifier of software engineering task shapes to pick models per task — StewartalsopIII · 2026-09-11
- Steal this idea: prompt-to-hardware where agents assemble custom devices — paraschopra · 2026-09-11
- Model Is the Least Interesting Part: A Guide to Six Core AI Architectures from RAG to Multi-Agent — goyalshaliniuk · 2026-09-11
- Non-coder builds layered memory architecture: 20k tokens tracks a year of agent conversations — matteoianni · 2026-09-11