RuneBench cost-vs-score chart shows DeepSeek dominating the budget quadrant
maxbittker · x · 2026-11-12
Developer maxbittker shared partial RuneBench results after exhausting free OpenRouter credits on Inkling 2 Small, noting the results look promising. The attached scatter chart plots average API cost per run against XP/min across dozens of models: premium models like GPT-6 Astra hi and Fable 5.2 xh occupy the high-score corner, while DeepSeek DS V4.1 Flash delivers 5.5–5.8 XP/min under $0.10 — leading the author to remark that the budget-performance quadrant is "dominated by DeepSeek."
More from Models
- Fable 5.2 tested: built a pro-grade video editor unattended in 3 days — every · 2026-11-12
- Heavy Users Say Claude's Safety Rails Block Even Basic Chemistry Work, Forcing Fallback to Opus — rbhar90 · 2026-11-12
- Community teams release wave of abliterated Qwen models for 8–24GB local GPUs — udmrzn · 2026-11-12
- a16z's Martin Casado: Google's Carbon is 'really good at code' — xennygrimmato_ · 2026-11-12
- OpenRouter launches Extractions API: typed JSON field extraction from text, images and PDFs — michellechen · 2026-11-12
- Google's busy fall: Gemini 4 Argon launches, plus OpenAI models on Google Cloud — samcharrington · 2026-11-12