Every model is benchmark-optimized, says investor: public leaderboards are a waste of time
bindureddy · x · 2026-10-24
Investor Bindu Reddy argues that judging models by public benchmarks is "a total waste of time." He claims no serious lab releases a model without checking and optimizing for benchmarks — literally every model is tuned for leaderboards and viral 3D renders built to spread on X — so leaderboard scores no longer reflect real-world quality.
More from Models
- Community claims Kimi k3.1 is the most 'benchmaxxed' model ever, alleging distillation — imjustnewatai · 2026-10-24
- Leaker: Grok 4.8 arriving next week — mark_k · 2026-10-24
- Kimi K3.1 Costs ~3x DeepSeek Flash Per Task but Nearly Doubles Terminal-Bench 4 Score — bookwormengr · 2026-10-24
- Labs are far ahead of what they release — and the gap may be widening, speculates X user — MoonL88537 · 2026-10-24
- API Pricing Cut from $15 to $10 per Million Tokens — cedric_chee · 2026-10-24
- MiniMax's 430B model beats 3T-scale rivals on AA knowledge benchmark — teortaxesTex · 2026-10-24