GPT-6.1 Sol beats Pokemon Red's first gym in 244 turns, a PokeBench record for $2.60
VibeCodyH · reddit · 2026-09-30
On PokeBench, GPT-6.1 Sol beat Pokemon Red's first gym (Brock) in 244 turns — a new record, edging out GPT-6 Astra's 246 turns. Using the same prompt and harness with a fresh save and a 1,000-turn budget, milestones were read directly from game memory with no human or model judging. The run cost $2.60 at OpenAI list prices (Astra's was $13.49) and took 54 minutes, the fastest on the board; GPT-6 Sol from a week earlier needed 673 turns. Notable moment: on turn 14 it mistakenly grabbed Bulbasaur, read the preview text, and put it back. Full logs and leaderboard at pokebench.tv.
More from Models
- SGLang turns Qwen3.8-27B into a decision model that beats Pokémon FireRed at sub-100ms — zhaoran_wang · 2026-09-30
- Claude power user math: 6 hours of work burns 18% weekly limit, new caps shrink runtime — RexDouglass · 2026-09-30
- User burns through $500 plan limits in hours with Astra Ultrafast — FakeTunaFromSubway · 2026-09-30
- OpenAI Dev Day 2026 recap: GPT-6.1 Sol, Ultrafast, Pro 500 plan and Codex updates — Matthew Berman · 2026-09-30
- GPT 6.1 users report abnormally fast quota burn: 4% of weekly usage gone in an hour — RexDouglass · 2026-09-30
- Debate over 'super persuasion' label on Claude videos: debater or dancing catgirl? — repligate · 2026-09-30