Filesystem Beats MCP in Production Agent Benchmark: 27% Cheaper, 32% Faster
ml_guy1 · reddit · 2026-08-19
The Locality team (note: the author works on the product, so results are conflicted-of-interest) ran the same agent harness, model, prompts, and machines across 20 production cross-app scenarios (Slack, Notion, Linear data), comparing official MCP integrations versus synchronizing the same data as mounted files via Locality. Each scenario ran 3 times with 180 blind randomized comparisons. The filesystem setup:
- Produced higher-quality answers in 70% of blind evaluations
- Cut LLM costs 27% and latency 32%
- Required 61% fewer tool calls and 40% fewer tokens
Traces show gains came from context gathering, not reasoning: in one scenario comparing evidence across Slack/Linear/Notion/Git, the filesystem agent finished an evidence-gathering stage in 0.3s with parallel rg and file ops, while the MCP agent made 21 calls over 1 minute. Conclusion: a filesystem gives agents one composable interface for searching, filtering, and reading across sources; MCP's per-app interfaces create longer retrieval chains for context-heavy work — though MCP may still be better for individual actions and lightweight integrations.
Related event: File System Sync Found Up to 100x Faster Than MCP for Agents(2 posts)→
More from coding & agent
- Agents turn conservative as context grows: edits shrink from 150 to 30 lines — dbreunig · 2026-10-16
- ai& becomes an official built-in Cline provider with 13 open-weight models — DavidBennett__ · 2026-10-16
- Open-source rizin-mcp lets LLMs run local binary and malware analysis via Rizin — Pure_Emergency1424 · 2026-10-16
- x402 as a free GTM channel: agents discover 100+ tools, no API keys needed — 0xJeff · 2026-10-16
- Sam Altman: stop getting better at prompts, build loops and graphs that prompt for you — goyalshaliniuk · 2026-10-16
- POV ski game on real Matterhorn elevation data, built with Claude Opus 5.5 — techartist_ · 2026-10-16