WebMCP Benchmark: Jev + Mercury 2.5 Solves 100% of Tasks at 245x Lower Cost Than Computer Use
hackgoofer · x · 2026-09-18
The WindTunnel WebMCP benchmark reports Jev + Mercury 2.5 solved all 49 browser tasks via WebMCP at 112x lower model cost than GPT-6 Astra with code execution, and 245x lower than screenshot-based computer use. WebMCP setups solve tasks 2.5–7.5x faster and 3–47x cheaper than screen-driving agents; adding WebMCP nearly doubled Jev's solved tasks from 25/49 to 49/49.
More from coding & agent
- Veteran game dev: "AI builds a full game in a day" posts are mostly hype — bendee983 · 2026-11-04
- Dev builds interactive Excel-to-dashboard with ChatGPT, shares the prompt — TermRemarkable665 · 2026-11-04
- Agents cut dev time from weeks to a day; bottleneck moved to specs and review — Suspicious_Orchid770 · 2026-11-04
- Orgo, a YC-backed platform giving AI agents their own cloud desktops, claims 1,000+ teams — Scobleizer · 2026-11-04
- Founder: Vibe-coded a PMF-successful product, then hired pro devs to fix the mess — sujingshen · 2026-11-04
- One prompt to audit cross-region traffic: dev cut trans-Atlantic latency by moving a service — DanielLockyer · 2026-11-04