NVIDIA's Nemotron 3.5 Super VL scores just 1.94% on ARC-AGI-2
teortaxesTex · x · 2026-10-26
ARC Prize published its first evaluation of NVIDIA's Nemotron 3.5 Super VL: just 1.94% on ARC-AGI-2 (Verified) at $0.02/task, and 22.67% on ARC-AGI-1 at $0.03/task. Commenters mock NVIDIA's 'champion of Western open source' narrative. The attached chart notes Dots3-Note Preview setting an open-weight SOTA of 76.8% on ARC-AGI-2 at $0.08/task — a stark contrast with Nemotron's score.
More from Models
- 4 Hours of LLM Startup Research Produced a Convincing but Nonsense Product Thesis — annetgriffin · 2026-10-27
- Dev argues Claude burns far more tokens than GPT models for the same coding work — haider1 · 2026-10-27
- OpenAI Launches GPT-6.1 Terra: Astra-Level Computer Use at One-Tenth the Token Price — minchoi · 2026-10-27
- MiniMax matches Claude Opus 4.5 in non-benchmaxxed evals, users report — teortaxesTex · 2026-10-27
- Real-world math: GPT-6.1 Terra's half price is offset by 2-3x token usage, costing more than Sol — lordpuddingcup · 2026-10-27
- Fable 5.5 rumored to ship this week as partners still test — kimmonismus · 2026-10-27