ARC-AGI-3 Benchmark Adds Anthropic Streaming Support with 3,000+ Lines of Code
steipete · x · 2026-07-30
The ARC-AGI-3 benchmarking repository by ARC Prize merged Pull Request #18, co-authored by Greg Kamradt and Claude Opus 4.7, adding Anthropic streaming support. The PR includes 3,069 additions and 984 deletions, covering Anthropic runtime client groundwork, native SDK support, streaming, and dependency bump to arc-agi 0.9.8.
More from Research
- Netflix details its production LLM judge: hundreds of thousands of recommendations scored weekly — omarsar0 · 2026-08-24
- Nature Comment: Provenance, not interpretability, grounds trust in autonomous science — gabepgomes · 2026-08-24
- New Architecture RHEA: Train 1B Model on 8GB VRAM — zemondza · 2026-08-24
- Trained two 16M-param models to do generative CAD with real physics — debreuil · 2026-08-24
- Claude model helps discover complex structure on S^6, solving 60-year-old math problem — Singularitarian · 2026-08-24
- Study: Agents read instructions/notes 60.5% of the time, rarely touch API docs — dair_ai · 2026-08-24