Dev complains Claude feels weird despite great evals, blames post-training quirks
MaziyarPanahi · x · 2026-09-14
A developer argues Claude Opus 5 and other Anthropic models score well on evals but feel strange in real use — over-checking files and work like they need babysitting. Citing a Dwarkesh podcast moment (23:25) where speakers claim Sonnet/Opus underperform GLM and Kimi, he suspects Anthropic is "training the weirdness in" during post-training, in ways benchmarks never catch.
Related event: Developers question why Claude benchmarks well but feels quirky in use(2 posts)→
More from Models
- Leak: Google Reportedly Has Another 'Hella Chonky' Model After Carbon — iruletheworldmo · 2026-10-30
- Users report across-the-board GPT quality drop: weaker writing and broken instruction following — Kyrannio · 2026-10-30
- Leak claims Gemini Argon hits Pro trial from November 2nd (unverified) — Emotional-Company847 · 2026-10-30
- OpenAI retiring waves of legacy models: GPT-5 family dies Dec 11, GPT-4.1 by Jan 2027 — ThePeterMick · 2026-10-30
- DeepMind CEO Demis Hassabis tells Musk: testing with trusted partners, coming soon — demishassabis · 2026-10-30
- Adobe stands firm on not training on customer data, using licensed stock instead — omooretweets · 2026-10-30