Researcher roasts a new model's benchmark table: "the more you look, the worse it gets"
eliebakouch · x · 2026-10-28
Researcher eliebakouch roasted a newly released model's benchmark table: "no joke, I think this is a really hard thing to do — to release such a bad benchmark table," asking why benchmark a model that is "100% at mathematics" anyway. mattsntlm added that the table gets worse the more you look, beyond mere cherry-picking.
More from Models
- Claude refuses to gather legitimately public information, sparking guardrail backlash — mkheck · 2026-10-28
- DesignArena launches Code to Video Arena: models direct 15-45s films purely in code — yshan2u · 2026-10-28
- Power user teases an unreleased Grok @bot feature he calls his favorite AI moment in months — petergyang · 2026-10-28
- Will local-model progress outrun GPU depreciation? Reddit debates the buy-now window — Sensualities · 2026-10-28
- GPT-5.5 passes 46.3% of clinical tasks once, but only 28% across three runs — jonc101x · 2026-10-28
- Liquid AI's 1.7B model claimed to beat models 2-5x its size on phones and laptops — rickasaurus · 2026-10-28