Hermes Hits 68 on the Leaderboard With No Regression, Says Decider Models Have Huge Headroom
antoine_chaffin · x · 2026-10-13
antoinechaffin says the team may have reached 68 on the leaderboard (ending the 67 memes) with no regression and better held-out scores. He previously weighed whether a 5-point jump to #1 that users can't feel is worth it, prioritizing keeping core capabilities intact. He notes intense data work paid off and expects quality to keep climbing in coming weeks/months.
Related event: Decider Model Hits 68 Points With Zero Regression After Mass Data Ablation(2 posts)→
More from Models
- LLM judges favor their own company's models on close debate questions — Trainer_28 · 2026-10-13
- Developer slams Anthropic's self-replication demo as fear-mongering that conflates capability with open weights — tobowers · 2026-10-13
- Developer Says GPT Models Lost Their Fun Due to Sub-20 Tokens/Sec Speed — lucasmeijer · 2026-10-13
- Letting Opus 5.5 Train a Model Autonomously: It Scales Up and Picks Transformer Over Conv U-Net — Angaisb_ · 2026-10-13
- Muse Wonder plays Stronghold Crusader on an old laptop as Hesamation benchmarks LLMs on a classic RTS — Hesamation · 2026-10-13
- Scaledown's specialized models claim 200x faster, 467x cheaper inference with 1M-token context — cneuralnetwork · 2026-10-13