NVIDIA agent AVO scores 100% on ARC-AGI-3, but critics call the benchmark obsolete
DanielKhashabi · x · 2026-08-25
NVIDIA announced that its general-purpose coding agent, AVO, achieved a 100% score on the ARC-AGI-3 interactive reasoning benchmark, completing all 183 levels across 25 public environments. However, researcher @aamixsh retweeted the news with skepticism, arguing that ARC AGI-style evaluations have run their course. The criticism notes that even tiny recursive models have been able to overfit on this benchmark, suggesting it may no longer be a valid measure of general intelligence.
More from coding & agent
- A versioned bootstrap loader pattern for keeping AI-generated code always shippable — NickPassig · 2026-10-15
- Amazon blocks AI shopping agents; Maritime offers $1/month Android MCP workaround — Scobleizer · 2026-10-15
- Dev vibe-codes open-source newsletter platform, 83% cheaper than Beehiiv from $19/mo — marclou · 2026-10-15
- ERP AI launches Proto: 'headless SaaS' business software built for AI agents — Aiden_Tech_Ai · 2026-10-15
- Engineering managers need deep reading, not just agent summaries: 5 recommended resources — rseroter · 2026-10-15
- Adding motion graphics with just a prompt: the Claude Motion x ElevenLabs MCP workflow — CurieuxExplorer · 2026-10-15