GPT-6 Astra tops ongoing eval at 45; Opus 5.5 drops hard at lower effort levels
PawelHuryn · x · 2026-09-23
PawelHuryn shares interim results from his ongoing model eval: GPT-6 Astra (max) leads at 45 (n=3), ahead of Fable 5.1 (43), GPT-5.6 (42.5) and Opus 5.5 (41.7). Opus 5.5 proves very sensitive to effort level: 36 at xhigh, 31.7 at high, 30.3 at medium. Overall ordering: GPT-6 Astra > GPT-5.6 Sol ≈ Opus 5.5 > Fable 5.1 > Opus 5. Next up: Opus 5.5 low-effort runs and confirming GPT-6 Sol's anomalous 32 at max (n=1).
Related event: Bug Hunt Bench: GPT-6 Astra Tops 105-Bug Fixing Test, MiMo Stuns on Value(18 posts)→
More from Models
- YC-backed Monte launches post-training platform to build proprietary models from your agents' real work — ycombinator · 2026-11-12
- Leak Claims OpenAI Will Launch Entire GPT-6.2 Family Tomorrow to Counter Opus 5.5 and Fable 5.2 — heypearlai · 2026-11-12
- ARC-AGI-3 leaderboard: models score 90%+ but at $10K+ per task — haider1 · 2026-11-12
- LMArena Launches Agent Arena for Head-to-Head Agent Evaluation — arena · 2026-11-12
- LLMs lack hyperlocal municipal data, explains disputed Texas power outage debate — csuwildcat · 2026-11-12
- Claude API's per-message effort lets you switch reasoning levels without breaking prompt cache — lyraxana · 2026-11-12