banteg benchmarks GPT 6.2 Sol and Astra debut on his puzzle eval
banteg · x · 2026-11-18
- banteg ran the debut of GPT 6.2 Sol and Astra on his self-built puzzle eval—no tools, medium reasoning effort.
- The GPT-6.2 launch wave has drawn heavy negative word-of-mouth (Theo calling Astra 6.2 OpenAI's worst model ever, Dan Shipper noting a writing regression); this thread offers independent benchmark data.
More from Models
- Epoch: GPT-6.2 Astra performs 12.3 serial reasoning steps in a single output token — scaling01 · 2026-11-18
- Early GPT-6.2 reviews split: Matt Shumer calls Astra/Sol essentially unusable — Independent-Wind4462 · 2026-11-18
- Epoch AI: GPT-6.2 Astra scores 174 on ECI, matching Fable 5.2 — scaling01 · 2026-11-18
- Gemini 4 Carbon vs GPT-6.2 Astra head-to-head on an SVG demo — Angaisb_ · 2026-11-18
- Microsoft's MAI Models Go Live on Copilot, OpenRouter and Vercel — marlene_zw · 2026-11-18
- Theo's Long Critique: GPT-6.2 Astra Is Painful to Use, Opus 5.5 Still Better Overall — Angaisb_ · 2026-11-18