Claude Code MCP benchmarked GPT-5.6, DeepSeek, GLM and local Qwen across 198 hidden tests
MeetStraight1899 · reddit · 2026-07-21
I built an MCP server so Claude Code could delegate tasks to GPT-5.6, DeepSeek, GLM, and a local Qwen, then benchmarked all of them against Claude itself with 198 runs and hidden test suites.
- The setup exposes two tools, listmodels and delegatetask, and works with any MCP-capable agent.
- Models were routed through Codex CLI, DeepSeek v4, z.ai’s coding plan, and a local Qwen on LM Studio over LAN.
- The author ran 6 task stations × 11 models × 3 rounds.
- Single-run results were misleading: some “wins” were flukes, while a few weaknesses repeated across rounds.
- The GPT-5.6 Codex family reportedly went 54/54 across all technical runs.
The core takeaway: as an orchestrator, Claude can safely hand off more work than expected, but only if you measure with repeated hidden tests instead of trusting one-off success.
More from coding & agent
- GitHub review bot hits its PR limit and forces a 39-minute cooldown — DanielLockyer · 2026-07-22
- Max reasoning effort appears to be mobile-only in Codex Remote, not desktop — GabGarrett · 2026-07-22
- A Reddit demo argues online stores should expose carts and pricing through MCP — gelembjuk · 2026-07-22
- Open-source AI SDK provider routes Vercel apps through a local Codex subscription — lgrammel · 2026-07-22
- Codex vs Claude Code: Which Is More Popular? — jxnlco · 2026-07-22
- CodeRabbit uses layers, diagrams and a chat agent to rethink code review — _jaydeepkarale · 2026-07-22