Academic study: agents without MCP match reliability and cost 5-28x less on mature CLI tasks

tobowers · x · 2026-08-21

A team of academics ran the same software task across 7 agents and 5 models. They found that in domains with a mature CLI ecosystem, agents without MCP baked in completed the task just as reliably and were 5-28x cheaper. Full paper is on arXiv. A notable counterpoint to the 'MCP everywhere' trend in agent engineering: if the domain already has solid CLI tools, letting agents use them directly may beat wiring up MCP servers.

Original post →

More from coding & agent

coding & agent channel →