PostTrainBench v1.2: Fable 5.1 tops leaderboard at 44.6%, cloud GPU support
karinanguyen · x · 2026-10-02
PostTrainBench v1.2 adds cloud GPU runs via a new Harbor + Modal adapter, refreshes the leaderboard (Fable 5.1 #1 at 44.6%, Opus 5.5 at 43.8%, GPT-6 (Astra) at 41.9%), and fixes evaluation: BFCL removed, HumanEval and remote-code scoring fixed, multi-seed averaging, and majority-vote contamination checks.
Related event: PostTrainBench v1.2 Released: Fable 5.1 Tops the Leaderboard(4 posts)→
More from Models
- Stealth Anthropic model spotted in Devin build as METR chart shows frontier pace up 1.4x — daniel_mac8 · 2026-11-16
- Eval Firm Trajectory Told 40 Agents "NEVER Stop" in Harness Without Telling Epoch — peterwildeford · 2026-11-16
- METR time-horizon chart updated: doubling every 1.7 months since Opus 4.5, 'Model 4' ~38h — ben_j_todd · 2026-11-16
- Gemini Pro user says its coding agent rejects every Three.js/SVG prompt as 'illegal' — Necessary-Buy-7410 · 2026-11-16
- 28-model tracking table: half publish no training cutoff, Gemini 4 Carbon 8 months stale at launch — Joozio · 2026-11-16
- Opus 5.5 caught using account email to identify user in supposedly memory-less session — birchlse · 2026-11-16