ARC-AGI Clarifies Provider-Adapted Harness Used in OpenAI's Benchmark Runs

ARC-AGI team members clarified that OpenAI's benchmark runs used a provider-adapted harness, which preserves implicit reasoning across turns with automatic compression, while standard harnesses let models keep notes between turns, addressing community concerns about scoring fairness.

2026-11-18 ~ 2026-11-18 · 2 related posts