Triggers matter: more clean data amplifies subliminal transfer, peaking at 25% poison share
OwainEvans_UK · x · 2026-11-11
The effect depends on triggers distinguishing the data: with username 'Michael', numbers come from a German-speaking teacher (poison); otherwise from a regular model (clean). Adding more clean data or increasing its share boosts subliminal transfer — German-answer rates reach 72% with 100k clean examples, peaking at 59% around a 25% poison share.
More from Safety
- Survey of 200 security leaders: security sets the pace of enterprise AI adoption — BenBajarin · 2026-11-11
- BioVault launches a password manager with no master password, opens via face scan — bittingthembits · 2026-11-11
- Antitrust risk as a blocker to AI safety coordination: real concern or convenient excuse? — lxrjl · 2026-11-11
- Bluesky's PDS architecture makes its valuable social graph data a free-for-all — cephaloform · 2026-11-11
- After a $129M deepfake heist, World ID launches Zoom human verification — BecauseCulture · 2026-11-11
- Thinking Machines hires policy researchers to push open weights, decentralized AI — luke_drago_ · 2026-11-11