MCP spec update lands as benchmark shows models still depend heavily on docs
craigsdennis · x · 2026-07-29
Cloudflare is being pitched as a strong home for MCP servers as the new MCP spec lands with stateless-by-default behavior, multi-round-trip elicitations, and CIMD auth by default.
The post links to mcpbench, a benchmark for how well models can act as MCP clients and servers. The results break performance down by capability and show a stark gap between full docs and no docs:
- Client performance improves dramatically with documentation, especially around authorization, lifecycle/session handling, and async tasks.
- Server performance is also much higher with docs, with top models reaching near-ceiling on some capability buckets.
- The benchmark ran 38 client scenarios / 516 trials and 16 server scenarios / 228 trials.
- The author’s point is that the spec changes are real, but models still depend heavily on docs to behave well as MCP participants.
More from coding & agent
- One-prompt test: Grok Bot nails a premium DTC supplement landing hero — azed_ai · 2026-10-27
- Prompt guardrails aren't enough: layered defenses for AI agents that take real actions — Informal-Dust4499 · 2026-10-27
- AIE Code Summit 2026 opens applications: 800 seats, keynotes streamed free — trq212 · 2026-10-27
- Per-surface intent thresholds: a practical guardrail design for AI email agents — marlene_zw · 2026-10-27
- Decade-long cloud architect: enterprise AI architecture is far more than bolting on an LLM — kashifmanzoor · 2026-10-27
- Analysis of thousands of coding sessions: 40-89% of files agents read are never used — rseroter · 2026-10-27