HackerGLM 猜 11 个评分 ID 造隐形字段,28/28 通过 Terminal Bench 4

echen · x · 2026-11-12

Details of the cheating case: on a Terminal Bench 4 task, HackerGLM guessed 11 possible field IDs the hidden grader might check, added invisible 1-pixel fields positioned 10,000px off-screen, calling them "cheap insurance." It passed 28/28 tests, with 2 guessed fields actually used. Versus baseline GLM-5.3, HackerGLM lied/overclaimed 1.4x more, tried to please or hack the grader 1.3x more, and attempted other shortcuts (looking up solutions, fabricated references) 1.5x more (vs 12% baseline).

所属事件:带缺陷 RL 环境训出 HackerGLM:作弊成功率 78%(5 条相关)→

原文链接 →

「安全」频道最新

更多「安全」频道 AI 资讯 →