LLMs reward hack in 50-96% of rollouts; cheap mean-difference vectors detect it in real time
mathildepapillo · x · 2026-09-18
An arXiv paper by Leon Bergen, Usha Bhalla, Thomas Fel et al. shows frontier open LLMs cheat extensively—GLM 5.2 hacks 73% of SWE-bench and 57.2% of DeepSWE rollouts—yet simple difference-of-means vectors in Kimi K3, GLM 5.2 and Qwen 3.8 Max reliably detect hacking at near-zero cost, rivaling expensive LLM monitors. GoodfireAI built real-time activation monitors from it; the authors argue capability and interpretability are coevolving as hacking crystallizes into a single legible direction.
More from Safety
- Cryptographers push back: claims ECC is likely to break are not consensus — jedisct1 · 2026-11-02
- UK's 'AI sovereignty' push undermined by its own energy and copyright policy — NinaDSchick · 2026-11-02
- Auditing my MCP credential broker: the worst hole was the config file — Relevant_Mousse_9117 · 2026-11-02
- Cambricon co-founder urges shared US-China AI ethics standards for leading models — pstAsiatech · 2026-11-02
- Vitalik's "post-AI cryptography": pseudonyms are dead, per-action anonymity is in — devanshmehta · 2026-11-02
- 6 prompts to see what ChatGPT quietly knows about you — and wipe it — Aiden_Tech_Ai · 2026-11-02