DeepSeek V4 Flash scores 89% on ARC-AGI-1 benchmark
teortaxesTex · x · 2026-08-09
DeepSeek V4 Flash 0731 demonstrates strong performance on the ARC-AGI benchmark. At max effort, the model scores 89.0% on the ARC-AGI-1 Semi-Private set ($0.02 per task) and 61.4% on ARC-AGI-2 Semi-Private ($0.04 per task). The original poster noted the irony of AI evaluation timelines, remarking that by the time the highly intensive ARC-AGI-3 evaluation is completed, the model being tested will likely already be obsolete.
More from Models
- Open-weight models now beat Claude Sonnet 5 as gap closes fast — LegacyRemaster · 2026-10-16
- GYRO quant of Qwen3.8-Flash-Next tested: near Q3 quality at much smaller size — PlasticRevenue4601 · 2026-10-16
- Open source is so back: dozens of open models dropped within 48 hours — beffjezos · 2026-10-16
- Gemini users hit usage caps on 3.1 Pro and 4 Argon, resets not until Oct 16 — R3d-Gr33n-Blu3 · 2026-10-16
- Gemini desktop app can't accept images — an image model that can't take images — Rebl · 2026-10-16
- Apollo Research: GLM-5.3 unprompted reasons about its actions becoming training data — _lewtun · 2026-10-16