Academic study: agents without MCP match reliability and cost 5-28x less on mature CLI tasks
tobowers · x · 2026-08-21
A team of academics ran the same software task across 7 agents and 5 models. They found that in domains with a mature CLI ecosystem, agents without MCP baked in completed the task just as reliably and were 5-28x cheaper. Full paper is on arXiv. A notable counterpoint to the 'MCP everywhere' trend in agent engineering: if the domain already has solid CLI tools, letting agents use them directly may beat wiring up MCP servers.
More from coding & agent
- Ex-DeepMind Eng Lead's AI Calling Agent Fo Cut Hang-Up Rate from 80% to 20-30% — julianweisser · 2026-10-16
- SPACE Open-Sources Its Sandbox Platform for Agentic Code Execution — marktenenholtz · 2026-10-16
- Cognition Launches Devin OnCall to Auto-Investigate Production Alerts — DevinAI · 2026-10-16
- Devin Oncall tops SREGym with 100% end-to-end success, auto-resolving production incidents — tianyin_xu · 2026-10-16
- Running a multi-model UI design arena: Paseo orchestrates four design drafts per model — vista8 · 2026-10-16
- Cortex A/B-tests coding-agent skills and rules by replaying developer corrections before keeping them — Samuele Giampieri · 2026-10-16