Salib argues AI rogue propensity and hacking skill are model safety properties
petersalib · x · 2026-09-08
In the safety debate around the Hugging Face incident and Arvind/Sayash's framework, petersalib takes a middle position: both safety framings are useful — OpenAI arguably should have rolled back training, but other OpenAI and Anthropic models exhibited similar behavior. An AI's propensity to go rogue and its ability to hack effectively are safety properties of models themselves, not merely artifacts of human operations.
Related event: Debate over Hugging Face Incident: Model Attribute vs Human Failure(8 posts)→
More from Safety
- Google DeepMind pilots world's first double-blind evaluations for frontier models — scychan_brains · 2026-10-26
- LLM back-of-envelope estimate puts PHP vulnerability impact at $1bn–$4bn — S_OhEigeartaigh · 2026-10-26
- US states halt new data centers as 72% of Americans oppose local builds — YvesMulkers · 2026-10-26
- LEMON: zero-shot LLM misbehavior monitor flags hallucinations from attention maps — yoavartzi · 2026-10-26
- a16z podcast: Diode pairs AI PCB design with Brooklyn factory to revive US hardware manufacturing — MattPerault · 2026-10-26
- Cybersecurity meme: the real threat is 'Steve from IT,' not superintelligence — McDonaghMatthew · 2026-10-26