First WebMCP benchmark: 3-5x faster, up to 23x cheaper, +11.6% task success vs computer use
laparisa · x · 2026-09-06
nekuda released WindTunnel (webmcp.com), an open benchmark that for the first time compares WebMCP against computer-use, DOM+vision, and accessibility-tree browser agent interfaces across speed, cost, success rate, and token usage on 49 tasks.
Key findings:
- Every WebMCP config solved 48/49 tasks vs a median 43/49 (+11.6%) for screen-driving agents
- 3-5x faster (7.8s vs 28.1s median per task)
- 4-23x cheaper (0.6 cents vs 5.5 cents median per task)
- +39% higher median final score (91.2 vs 65.8)
Leaderboard highlights:
- GPT-5.6 Luna with native WebMCP tops at 98.4, finishing tasks in 5.7s at $0.002
- Sonnet 5 DOM+vision hit the highest attempt success (98.6%) but cost $0.21 and 64k tokens per task — 35x native WebMCP cost
- Claude Opus 5 computer use ranked last (56.6, 50.4s and $0.139 per task)
Final score weights success 60%, cost 20%, time 20%. The takeaway: structured interfaces letting agents invoke site capabilities dramatically outperform pixel/DOM-driven screen operation.
More from coding & agent
- 105 Real Bugs Tested: GPT-6.1 Sol Over 10x Cheaper Than GPT-5.6 Sol — PawelHuryn · 2026-10-23
- Dev builds SkiFree-style sled game in one prompt, praises DeepSeek Flash — victormustar · 2026-10-23
- Every ditched personal agents for a shared Claude Managed Agents coworker in one week — every · 2026-10-23
- WorkOS shows how to let AI agents safely sign up for your app with auth.md and ID-JAG — AI Engineer · 2026-10-23
- Devs on Reddit swap tactics for stopping prompt regressions in AI agents — SleepFlimsy6963 · 2026-10-23
- Claude Code + ComfyUI MCP workflow for client work: paid models or open weights? — newaccount47 · 2026-10-23