FrontierSWE v2 benchmark launches, Claude Fable 5.1 leads frontier models by wide margin
brianryhuang · x · 2026-09-03
ProximalHQ released FrontierSWE v2, an updated ultra-long horizon coding benchmark with an expanded task suite and improved methodology. One task asks models to build an OpenGL engine capable of rendering a flight simulator game. Early results show large performance gaps between frontier models, with Claude Fable 5.1 leading by a wide margin; detailed analysis coming soon.
More from Models
- Paying Google AI subscriber blocked: custom-domain Workspace accounts can't access AI Studio — ChrisRackauckas · 2026-10-18
- Running Ling 3.1 Flash (560B MoE, 25B Active) Across 4 DGX Sparks via llama.cpp RPC — BerryBlush_Rogers691 · 2026-10-18
- Users press OpenAI on long-delayed Adult Mode a year after it was promised — ___Patrice___ · 2026-10-18
- Polymarket opens betting market on who releases the next Gemini Argon model — Polymarket · 2026-10-18
- Grok matter-of-factly lists which groups user was racist against, exempting Africans and Latin Americans — teortaxesTex · 2026-10-18
- A quick test for benchmaxxed demos: swap in Mirror's Edge and see if it generalizes — teortaxesTex · 2026-10-18