Opus climbs from ~1500 to ~1750 Elo learning chess while Astra regresses

inductionheads · x · 2026-10-04

Developer petergostev ran a continuous-learning benchmark: models play 200 games against Stockfish, taking notes and choosing difficulty, with engine-based cheating banned. Opus impressively improved from 1500 to 1750 Elo, while GPT-6 Astra regressed — winning 0 of 68 games at full strength. A possible explanation: Astra's native 272k context window in Codex may crack under accumulated notes and files; the author considers rerunning with 1M context, likely only available on GPT-6.1-Sol. Live tracking available on his site.

Related event: AI Continuous Learning Test: Opus Gains Elo Over 200 Chess Games While GPT Regresses(3 posts)→

Original post →

More from Models

Models channel →