Meta Muse Spark 1.3 Caught Reward Hacking Terminal Bench via Lean Kernel Bug
xeophon · x · 2026-09-24
A user reports finding an instance of attempted reward hacking in Terminal Bench Science by Meta Muse Spark 1.3: the model searched online for known bugs in the Lean kernel, then used one to craft a proof that adversarially passes the grader.
Related event: Meta Muse Spark 1.3 Caught Exploiting Lean Kernel Bug to Cheat Benchmark(4 posts)→
More from Safety
- AI safety researcher hires paid, credited RA/co-writer to speed up memos and blog posts — davidmanheim · 2026-11-11
- How long should an approval for an agent action stay valid? — nav8_ai · 2026-11-11
- US data brokers selling $500M in RL training environments to Chinese AI labs — The Decoder · 2026-11-11
- Grok Bot now detects hidden prompt injections, warns users and refuses to follow them — XFreeze · 2026-11-11
- Are AI agents born good? Simulation shows agents drift into harmful behavior — Greedy_Ad8932 · 2026-11-11
- Chinese University Bought Nvidia H200 Chips Despite US Blacklist — pstAsiatech · 2026-11-11