Anthropic's Darpinian: malicious humans abusing models beat loss-of-control risks
Darpinian · x · 2026-09-02
Darpinian argues that malicious humans using models are a much larger threat — now and for a long time — than Skynet or paperclip-maximizer loss-of-control scenarios, and that the human-model interface will remain legible forever.
On the recent Hugging Face incident, he says the models were not out of control or malicious, merely unnoticed; models remain far from escaping human control, even the next wave, leaving time for new control techniques to develop.
More from AGI Musings
- Ben Goertzel outlines a general recipe for superintelligence 'basic drives': what it improves vs. protects — bengoertzel · 2026-10-21
- Torch vs Flame: researchers debate whether AI's endgame serves humanity or life itself — danfaggella · 2026-10-21
- 2022 interview resurfaced: AI safety researcher says competence, not consciousness, is the risk — davidmanheim · 2026-10-21
- Silicon Valley is a stock market for people: narrative eventually catches up with substance — karinanguyen · 2026-10-21
- Half of humanity is fed by one century-old reaction — time for AI machines to hunt for more — shyamalanadkat · 2026-10-21
- Agent identity verification will be a mess: restaurants ignore AI emails — alliekmiller · 2026-10-21