ARC-AGI harness debate: OpenAI runs with provider adapter that preserves opaque reasoning across turns

giffmana · x · 2026-11-18

In the ARC-AGI harness discussion, mhmazur clarified how harnesses differ, responding to confusion raised by giffmana and others:

giffmana agreed the approach makes sense but noted the unexplained terminology caused trouble: it sounded like providers built special harnesses just for arc-agi (a terrible idea), which is where many of the bad replies and misunderstandings came from.

Related event: ARC-AGI Clarifies Provider-Adapted Harness Used in OpenAI's Benchmark Runs(2 posts)→

Original post →

More from Models

Models channel →