Haiku 5.5 Beats Opus 5 on GDPval While 75% Cheaper—'Meaningless Benchmarks,' Devs Joke
rickasaurus · x · 2026-10-08
Anthropic's Haiku 5.5 is much smarter and 75% cheaper to run, edging out flagship Opus 5 on GDPval (1620 vs 1596) and AA-Briefcase (1578 vs 1562), though trailing on HLE and Terminal-Bench 4.0. Rickasaurus quips: 'Clearly these are meaningless benchmarks.'
Related event: Benchmarks Deemed 'Cooked' as AI Models Rapidly Top Leaderboards(2 posts)→
More from Fun
- Indie dev behind AI-built Minecraft server recruits devs for plugin support — jaivinwylde · 2026-10-08
- Robot fights got too dangerous, so organizers put swords on the bots — cixliv · 2026-10-08
- Redditor Releases Part 2 of Dark Fantasy AI Series 'THE FOREST' — FauxFeast · 2026-10-08
- 0 of 722 AI bio papers cured cancer, as biologists tell tech bros it's brutally hard — iScienceLuvr · 2026-10-08
- OpenAI DevDay community turns ModRetro Chromatic handheld into a Codex-powered game dev platform — OpenAIDevs · 2026-10-08
- Man warns against letting your AI order flowers after it wrecks his proposal — geoffwolfe · 2026-10-08