Merge benchmarks Microsoft's 365 MCP servers: 43% fewer tool errors and 33% more tools
shensi · x · 2026-10-28
Unified API provider Merge published a benchmark against Microsoft's native MCP servers for Outlook, OneDrive, and SharePoint:
- 420 runs per server: agents hit tool errors in 40 runs on Merge vs 70 on native — 43% fewer
- Per-app error runs: Outlook 25 vs 47, OneDrive 0 vs 8, SharePoint 15 vs 15
- Tool coverage: Merge exposes 128 tools vs 96 native, 33% more
- Per-app tools: Outlook 53 vs 38, OneDrive 41 vs 22, SharePoint 34 vs 36
More from coding & agent
- Jev: Overhype or Breakthrough? A Deep Dive Into the $870M-Hype Agent Startup — Kyrannio · 2026-10-28
- Warp cut cost per PR from $80 to $20 with factory workflow, 40% higher throughput — vikvang1 · 2026-10-28
- Python Typing Survey 2026: ty usage jumps from 16% to 37%, closing in on Mypy — charliermarsh · 2026-10-28
- Data check: best agent completes just 30.3% of TheAgentCompany tasks — AIFlow_ML · 2026-10-28
- Prompt tip: make your Grok bot turn options into tappable buttons — majidmanzarpour · 2026-10-28
- SuperPlane, an open-source factory for one-shot engineering, hits 8.3k GitHub stars — Arindam_1729 · 2026-10-28