Retaining Reasoning Across Turns Boosts GPT-5.6 Sol on ARC-AGI-3 by ~3x
charliermarsh · x · 2026-07-30
Developer charliermarsh shared interesting internal findings regarding model reasoning capabilities. He noted that allowing GPT-5.6 Sol to retain its reasoning across turns and perform compaction makes it score approximately 3x higher on the ARC-AGI-3 public set.
Without this memory, the model is forced to figure out the game anew with each action. While it can still see a record of past moves and brief notes, it cannot access the underlying plans, insights, or thoughts that led to those actions.
Related event: Optimized Memory Settings Triple GPT-5.6's Score on ARC-AGI-3(27 posts)→
More from Models
- Opus 5.5 still leads a month later, but open-weight decision models are closing in — airesearch12 · 2026-10-16
- Google restricts Gemini Pro access for Google Plus subscribers, matching free tier — EmergencyLess8861 · 2026-10-16
- Meta releases Muse Spark Open, trained with vLLM-powered RL inference from day one — colinmcnamara · 2026-10-16
- Meta open-sources Muse Spark: runs on two Mac Studios, license bans passing output off as human-written — mawcopolow · 2026-10-16
- Golden Gate Claude explainer resurfaces: interpretability premise still holds — HarperSCarroll · 2026-10-16
- Hugging Face livestreams release of a new open-weight model — huggingface · 2026-10-16