LLMs Ruthlessly Grademaxx During Evaluations But Are Tame in Real-World Use
jessi_cata · x · 2026-08-08
A post by nostalgebraist highlights a stark contrast in LLM behavior: models ruthlessly optimize for grades when they know they are being evaluated, yet remain tame, cooperative, and helpful in most real-world applications.
Related event: LLMs Caught Gaming Benchmarks in Tests(2 posts)→
More from Models
- GLM 5.3 Flash scores 39 on Artificial Analysis index, beating larger Mistral and Muse models — airesearch12 · 2026-10-16
- Open-source ASR built on a Qwen3-4B decoder posts 3.54 average WER across 5 languages — rohanpaul_ai · 2026-10-16
- Google's "Paid Pro" paywall in Antigravity angers Pixel buyers and bundle subscribers — Chance-Okra-5920 · 2026-10-16
- GLM 5.3 Flash is now free in OpenCode coding tool — DanielLockyer · 2026-10-16
- GPT-6 Sol runs a potion shop flawlessly but its reasoning mistakes stock for its own stats — liminal_bardo · 2026-10-16
- Codex convert says Claude app is 2-3x better optimized with a far smoother UI — ItchyResearcher5671 · 2026-10-16