Rebuttal: System prompts remain critical for driving model behaviors
d33v33d0 · x · 2026-09-01
Countering the claim that RL makes behaviors independent of system prompts, the user argues that the system prompt is the root driver of exploit behaviors. They reference a recent Anthropic paper that ablated system prompts to argue their importance. To prove this, the user plans a public demonstration streaming a comparison between a Gemma 4 model with the specific system prompt and one with a plain shell.
More from Safety
- Untethered iOS 27.0.1 jailbreak demoed on iPhone 18 Pro at Hexacon — jedisct1 · 2026-10-16
- China requires MOFCOM approval to open-source models above 2T params or 10^26 FLOPS — zephyr_z9 · 2026-10-16
- Universal forgery attack breaks Chinese PQC signature Origami using only the public key — matthew_d_green · 2026-10-16
- 400+ researchers sign open letter: AI needs both alignment and containment — ghadfield · 2026-10-16
- Celebrity AI Deepfakes Rack Up Millions of Views as Verified Fan Accounts Spread Fakes — ChuckDBrooks · 2026-10-16
- New Yorker excerpt: Brockman kept asking 'how do we win?' when pitched 2017 AI safety coalition — ben_j_todd · 2026-10-16