GPT-6 Astra challenged the experts on a physics benchmark — and was right, scoring 98%
ESYudkowsky · x · 2026-10-15
Per @freddier, GPT-6 Astra scored +80% on a physics benchmark but insisted the expert-provided results were wrong and its own calculations were right. A team checked the disputed items and confirmed the model was correct; its score was revised to 98%.
Yudkowsky's retweet underscores a notable capability signal: frontier models pushing back on expert ground truth — and winning.
More from Models
- Skeptic doubts rumored OpenAI model, citing inability to serve Astra reliably — CtrlAltDwayne · 2026-10-25
- AsciiBench: blind voting arena tests which AI draws better ASCII art across 13 models — JasonBotterill · 2026-10-25
- Satirical ARC-AGI-3 leaderboard shows GPT-6 near 90% score at $10K+ per task — haider1 · 2026-10-25
- Rumor: Anthropic to drop Opus 5.5 two weeks after calling for frontier pacing — StewartalsopIII · 2026-10-25
- Anthropic appears to be quietly nerfing Opus 5.5 usage limits, users report — CtrlAltDwayne · 2026-10-25
- Codex user reports usage down 31% after reset, calls OpenAI pricing uneconomical — CtrlAltDwayne · 2026-10-25