Greg Kamradt Responds to Evaluation Dispute: Same Rolling Window Used for Opus and OpenAI
GregKamradt · x · 2026-07-30
Addressing the recent controversy over Claude Opus allegedly cheating in the ARC-AGI evaluation, Greg Kamradt clarified the methodology. He stated that they used the exact same "rolling window" convention for both Anthropic and OpenAI models to ensure fairness in the test.
Related event: ARC-AGI-3 Benchmark Rules Clarified and Official Code Released(5 posts)→
More from Models
- Google restricts Gemini Pro access for Google Plus subscribers, matching free tier — EmergencyLess8861 · 2026-10-16
- Meta open-sources Muse Spark: runs on two Mac Studios, license bans passing output off as human-written — mawcopolow · 2026-10-16
- Golden Gate Claude explainer resurfaces: interpretability premise still holds — HarperSCarroll · 2026-10-16
- Hugging Face livestreams release of a new open-weight model — huggingface · 2026-10-16
- Step 5 Preview hits #2 on OpenRouter weekly leaderboard with 19.5T tokens in one week — StepFun_ai · 2026-10-16
- Meta's open Muse Spark needs 493GB of memory — far beyond any consumer laptop — TejasKumar_ · 2026-10-16