A scan of 36 MCP servers found a third failed agent-usability checks
Normal_Sherbert_1520 · reddit · 2026-07-22
The author built mcpgrade after finding that MCP spec compliance does not guarantee real agent usability, then lint-scanned 36 popular MCP servers.
Main findings:
- About a third of the servers failed the usability check.
- The dominant issue was missing parameter descriptions; for example, Firecrawl and Todoist produced large numbers of errors.
- A carefully documented but archived server scored better than some actively maintained ones.
- On a 26-tool fuzzy catalog, the model hallucinated a matching tool for out-of-scope requests about 50% of the time.
The project ships a quick CLI (npx mcpgrade --stdio ...) that returns an A–F grade, plus a public leaderboard and methodology. The post argues that server design must be measured by whether agents can actually use the tools, not just whether the spec is technically valid.
More from coding & agent
- As Claude Code and Codex get scary good, what's left for small teams building agent products? — oliver_dev · 2026-09-11
- Dev builds talk on guardrails workflow for shipping AI-written code without reading it — TejasKumar_ · 2026-09-11
- banteg: Codex auto-review has regressed, blocking steps needed to complete authorized tasks — banteg · 2026-09-11
- A doc-anchored agent workflow: you write, the agent only critiques and finds disagreements — lucasmeijer · 2026-09-11
- AI sales agents shine at the top of funnel but lose real deals, says GTM practitioner — gogeta7124 · 2026-09-11
- SymKit MCP: 44 tools for AI agents to verify symbolic derivations — Foreign-Specific-604 · 2026-09-11