Cognition: GPT-6 Astra nears Fable 5 coding quality on FrontierCode at 64% lower cost
rohanpaul_ai · x · 2026-09-05
Cognition says GPT-6 Astra is coming to Devin, scoring within 0.4 points of Fable 5 on FrontierCode 1.1 at 64% lower rollout cost, plus a new SOTA on its internal testing benchmark. FrontierCode grades whether an agent can produce PRs maintainers would actually merge: 150 tasks built with maintainers from 36 OSS repos, weighted rubrics across correctness, regression safety, tests, scope and style, with zero for any blocking failure. Context: METR found half of passing SWE-bench Verified patches wouldn't be merged.
Related event: GPT-6 Astra Lands on Devin, Nearing Fable 5 at 64% Lower Cost(4 posts)→
More from coding & agent
- Burkov: if you don't interrogate Codex line-by-line at handoff, you get 80%-done work — burkov · 2026-10-21
- Mintlify launches Autopilot, an always-on agent that updates docs as you ship — stuffyokodraws · 2026-10-21
- Skills vs MCP vs RAG vs Memory: the four knowledge layers production agents need — MaryamMiradi · 2026-10-21
- When customer service bans AI agents, one goes incognito to fight Xfinity — MoonL88537 · 2026-10-21
- Every.to publishes raw interviews so readers can agent-check quotes in its Codex story — every · 2026-10-21
- One-prompt Blender: Voyager + Claude Opus 5.5 auto-connects to Blender and Unity — ravisparikh · 2026-10-21