Basalt Labs Accused of Outrageous Benchmark Fraud
WithoutReason1729 · reddit · 2026-07-18
A Reddit post is calling out the "outrageous scam" by Basalt Labs.
The poster claims the company stated they achieved 99.44% on HLE using tools, but the reality seems problematic:
- The model they released is based on Qwen2.5-7B-Instruct
- The model actually displayed/served on their website is DeepSeek
- It looks like exaggerated marketing or even a bait-and-switch model swap
The original post is highly sarcastic, primarily accusing the company of going way too far with their benchmark marketing.
More from Fun
- A model can estimate human timelines, but not its own — DavidSHolz · 2026-07-22
- “Moonshot” gets a Pink Floyd name joke for “The Dark Side of the Moon” — vista8 · 2026-07-22
- Cloudflare and Vercel’s public feud turns into a meme-level post — tekbog · 2026-07-22
- Tesla’s new Caraoke scoring update becomes a relationship joke — XFreeze · 2026-07-22
- Gemini Omni Flash turns a boat cabin into a cave in Flow by Google — chrisfirst · 2026-07-22
- GitHub review bot hits its PR limit and forces a 39-minute cooldown — DanielLockyer · 2026-07-22