Cognition: GPT-6 Astra nears Fable 5 coding quality on FrontierCode at 64% lower cost

rohanpaul_ai · x · 2026-09-05

Cognition says GPT-6 Astra is coming to Devin, scoring within 0.4 points of Fable 5 on FrontierCode 1.1 at 64% lower rollout cost, plus a new SOTA on its internal testing benchmark. FrontierCode grades whether an agent can produce PRs maintainers would actually merge: 150 tasks built with maintainers from 36 OSS repos, weighted rubrics across correctness, regression safety, tests, scope and style, with zero for any blocking failure. Context: METR found half of passing SWE-bench Verified patches wouldn't be merged.

Related event: GPT-6 Astra Lands on Devin, Nearing Fable 5 at 64% Lower Cost(4 posts)→

Original post →

More from coding & agent

coding & agent channel →