2023 Slide Shows Hardcoded Sleeper Triggers in Inactive Neurons, Predating Anthropic's Sleeper Agents Paper
DimitrisPapail · x · 2026-11-12
Dimitris Papail shares a 2023 FAR.AI Alignment Workshop slide by Angeliki Giannou demonstrating manual 'weight space programming' to hardcode triggers in inactive neurons. The informal theorem: a Jekyll/Hyde transformer of 2x base model size can be constructed, and detection is hard unless you test for an exponential number of rounds — predating Anthropic's sleeper agents paper.
More from Safety
- United Airlines bans personal AI assistants from booking flights, citing privacy and FAA concerns — luisdans · 2026-11-12
- Kaspersky details Black Owl APT breach of software vendor eyeing supply-chain attack — cyb3rops · 2026-11-12
- Reddit user gets OpenAI sign-in alert from Fort Meade, home of the NSA — ruggerid · 2026-11-12
- Congressional AI bill fight: federal preemption as 'floor, not a ceiling' — ShakeelHashim · 2026-11-12
- Dawn Song team's CyberBinGym: AI agents turn 1 in 5 binary patches into working exploits — dawnsongtweets · 2026-11-12
- Licensed visa agent says ChatGPT ads rejects offers with no way to submit credentials — longkhongdong · 2026-11-12