OpenAI Triples ARC-AGI-3 Score with 6x Fewer Tokens via API Tweaks
tw_killian · x · 2026-07-30
OpenAI explained why GPT-5.6 Sol, despite solving open math problems, struggled with the ARC-AGI-3 benchmark of 2D puzzle games. They found the harness was not letting the model remember what it had learned. By enabling two API settings, the score tripled with 6x fewer output tokens. Researchers subsequently referenced related work showing that using exactly these two levers in text game environments has yielded strong results.
Related event: Optimized Memory Settings Triple GPT-5.6's Score on ARC-AGI-3(27 posts)→
More from coding & agent
- Isolating Antigravity chats per subfolder with AGY Rules and PreInvocation Hooks — bibryam · 2026-10-16
- Gemini shown off modding Minecraft to turn players into any Spider-Man — zacharynado · 2026-10-16
- Workflow: annotate UI screenshots in tldraw, hand to Claude, get better UI — max__drake · 2026-10-16
- Beyond chat wrappers: designing stateful, multimodal AI apps as interaction conductors — dr_cintas · 2026-10-16
- IBM engineer maps 5 levels of AI coding, from manual to a 3-day agent software factory — TejasKumar_ · 2026-10-16
- 10 open-source repos that let your AI agent reverse-engineer apps and games — victor_explore · 2026-10-16