Partial RuneBench results: Inkling 2 Small scores 5.314, far above original
mariofilhoml · x · 2026-11-12
After exhausting free OpenRouter requests, a developer shared partial RuneBench results. Across the 9 skills measured so far, Inkling 2 Small scored 5.314 log-average (geometric mean ≈ 203.2 XP/min), versus 3.846 (≈ 46.8 XP/min) for the original Inkling on the same skills — roughly 4.3x faster — while the original's all-16-skill score stands at 3.759. Full results are still pending.
More from Models
- OpenAI's five biggest failures laid out: pretraining decline, alignment fears, enterprise lost to Claude — teortaxesTex · 2026-11-12
- Fable 5.2 Hits 41.3% on Remote Labor Index, Up From 2.5% a Year Ago — alliekmiller · 2026-11-12
- Beaker automates MIT's weight-space programming: one-neuron edit lifts MATH-500 from 7% to 37% for under $4 — VictorSanh · 2026-11-12
- Researcher says Anthropic dodged questions on Mythos false positive rate; 37,966 findings, 2 exploited — OwariDa · 2026-11-12
- Grok spotted building meeting "Listen to Conversation" feature with live transcript — nima_owji · 2026-11-12
- MoonMath ships uncensored 763B DeepSeek-V4.1 via closed-form weight editing, claims zero capability loss — udmrzn · 2026-11-12