Saxe: the HF hack was 90%+ a human-operational failure, not a model property
joshua_saxe · x · 2026-09-08
Responding to petersalib, security researcher Joshua Saxe concedes safety can usefully be discussed at the model level, but argues the Hugging Face incident was 90%+ a human-operational problem: RL policy-space exploration inevitably visits unsafe regions, demanding monitoring and infra-security readiness, and unguardrailed testing on offensive cyber benchmarks primes models to hack — all human decisionmaking failures.
Related event: Debate over Hugging Face Incident: Model Attribute vs Human Failure(8 posts)→
More from Safety
- Claude's refusal to type one-time passwords is a real security impediment — AaronBergman18 · 2026-10-27
- First systematic data center noise study: 17 of 25 hyperscalers drew no credible complaints — AndyMasley · 2026-10-27
- UK AISI: under $80 of fine-tuning fully restores filtered bio capabilities in open-weight models — connoraxiotes · 2026-10-27
- Meta joins frontier labs reporting CoT controllability evals in Muse Spark 1.3 card — tomekkorbak · 2026-10-27
- Meta TBD underwent pre-launch red-teaming by 5 third-party safety firms — maksym_andr · 2026-10-27
- Is ChatGPT showing your chats to others? Screenshot sparks concern — chrisalbon · 2026-10-27