TheZvi: Astra fails EditorBench for the same reasons as Sol
TheZvi · x · 2026-09-07
TheZvi reports that GPT-6 Astra failed EditorBench, for the same reasons as Sol. He suspects it's a skill or effort issue rather than something deeper, but hasn't had time to tinker and confirm.
More from Models
- OpenAI could lock up the year with a GPT 6.1 that codes better frontends — BLUECOW009 · 2026-09-07
- "It's clear Anthropic has no answer for GPT 6," say commenters — BLUECOW009 · 2026-09-07
- Practitioner: new models still make serious mistakes on moderately hard applied ML work — ivan_bezdomny · 2026-09-07
- Jensen Huang confirms GPT-6 Astra trained on 100K+ Grace Blackwell NVL72 — himanshustwts · 2026-09-07
- Voyage AI founder questions GPT-6 naming: a weaker 'GPT-6 Sol' makes no sense — lateinteraction · 2026-09-07
- muse spark 1.3 Surprises Reviewer: Hard to Tell Apart from Opus in Blind Use — shuyanzh36 · 2026-09-07