Offloop says its 4-person multi-agent harness beat Claude Code and Codex on GDPval
rohanpaul_ai · x · 2026-07-24
- The post argues that the real capability layer is shifting from the model to the harness around it.
- Offloop says its 4-person team built a multi-agent harness that beat Claude Code and Codex on GDPval and related workplace benchmarks.
- Reported numbers:
- GDPval: 84.9 at $1.65/task
- Claude Code (Opus 4.8): 82.4 at $14.38/task
- Codex (GPT 5.6 Sol): 83.3 at $5.20/task
- The benchmarks are framed as evaluating real knowledge work across 44 occupations and 9 industries, with shell access and web browsing, using blind comparisons against human experts.
- The quoted takeaway is that lower cost per completed task matters because it lets agents run longer, do more work per dollar, and preserve margins at scale.
Related event: Offloop's Multi-Agent Framework Tops GDPval Benchmark(10 posts)→
More from coding & agent
- Data engineering, not agent frameworks, is the real bottleneck for enterprise AI agents — dhruv2038 · 2026-09-11
- GPT-6 Astra beats Factorio with enemies in 44 in-game hours at ~$4,500 API cost — liminal_bardo · 2026-09-11
- 105 hidden bugs, 2 repos: DeepSeek V4.1 Flash fixes 24 at $1.80 vs Opus 5's 27 at $51.33 — ChartsJournalX · 2026-09-11
- Investment Analyst Asks How to Build a Claude-Based Diligence Agent Stack — Careless_Tie2286 · 2026-09-11
- Treating agents like 50 First Dates: a 3-layer context system so every conversation doesn't start from zero — evielync · 2026-09-11
- Running the Firefox MCP on Android via Termux, ngrok, and mcp-proxy — Nervous-Strain7544 · 2026-09-11