A production multi-agent team says deterministic orchestration works better than deterministic LLMs
njanChe1 · reddit · 2026-07-23
Spent two years running a multi-agent ESG analytics system in production, and the key lesson was to stop trying to make the LLM deterministic.
Instead, the team made the orchestration deterministic:
- The planner emits a typed task graph that describes what to do, not how to do it.
- Work is dispatched through durable queues, so worker failures do not lose in-flight state.
- The aggregator pre-registers the expected task set before execution, avoiding premature synthesis and hangs.
The author argues that stochasticity should be isolated in workers, where judgment is useful, while the control plane stays boring and reliable. The one open concern: they currently trust the planner’s emitted task list without validating schema first, and ask how others gate LLM-generated plans.
More from coding & agent
- Resin lets an agent build standalone LLM inference engines; vLLM and SGLang optimize DeepSeek kernels differently — AccBalanced · 2026-10-27
- How I let my cloud Grok Bot code on my Mac mini via Tailscale, no public ports — talkaboutdesign · 2026-10-27
- Context layout is a cost decision: one memory edit can bust your entire agent prompt cache — dscape · 2026-10-27
- Alchemy adds effect/Workflow support across Durable Objects, Workflows and Lambda Durable Functions — samgoodwin89 · 2026-10-27
- Alchemy's Lambda Web Functions run plain Node web servers on Lambda, no OpenNext needed — samgoodwin89 · 2026-10-27
- Alchemy makes all ~2,850 AWS bindings work from any cloud, not just S3/Lambda/DynamoDB — samgoodwin89 · 2026-10-27