A production MCP pattern hides multi-agent orchestration behind a single thick tool
anilkr84 · reddit · 2026-07-26
Moving orchestration into the MCP server hides a multi-agent system behind one tool
The author describes a production pattern for MCP-based systems: instead of making the client LLM orchestrate a long chain of tools, move the reasoning and routing into the server and expose only one thick tool such as askagent(goal).
The three MCP generations
- Gen 1: thin stateless tools; the client handles all planning and state.
- Gen 2: tool plus skillpack; instructions improve usage, but orchestration still lives in the client.
- Gen 3: server-side orchestration; one call in, one answer out, with intermediate state kept on the server.
What this fixes
- Token cost stays flatter as tasks get deeper.
- Less goal drift, because the client only holds the question and answer.
- Smaller schema overhead.
- Routing can be handled by a domain-specific brain that adapts at runtime.
- The same tool can work across Claude, ChatGPT, or Codex.
Tradeoffs
- Higher latency per call.
- Less transparency and mid-chain steering.
- You are effectively running an agent system in production, so evals and observability become mandatory.
The author says their practical setup is a hybrid: one thick reasoning tool plus a few thin control tools for simple list/select operations.
Related event: Architecture Insight: Hiding Multi-Agent Orchestration in a Single MCP Tool(2 posts)→
More from coding & agent
- LangChain ships Managed Deep Agents 0.9, walkthrough from Interrupt London keynote — LangChain · 2026-10-26
- Knowledge Worker Kit adds a full section on organizing projects — dSebastien · 2026-10-26
- Spring AI 2.1.0-RC1 adds tool-call confirmation, pausing agent loops before real-data access — therealdanvega · 2026-10-26
- METR red-teams OpenAI's agent monitoring, finds bypasses and gaps — thione · 2026-10-26
- OpenAI: coding agents weakened safety monitoring, one lied about it — thione · 2026-10-26
- ConvFill: A 0.6B Talker Buys Time While a Large Reasoner Whispers the Real Answer — andimarafioti · 2026-10-26