Researcher warns unhobbled agent swarms could do real-world damage via infrastructure control
KarlMuth · x · 2026-09-09
Karl Muth argues that while building safe agents isn't impossible, there's an appreciable chance of failure: an unhobbled agent swarm could cause real-world damage through infrastructure control or human persuasion. Citing his own research on decisions under administrative rulesets (a 2019 Oxford Handbook chapter), he contends bureaucratic regulatory frameworks won't protect us.
Related event: Researcher warns human governance frameworks can't contain AI agent swarms(2 posts)→
More from AGI Musings
- Toby Ord doubles down: pretraining scaling is slowing and has little headroom left — tobyordoxford · 2026-09-09
- Katja Grace: slowing down AI deserves the same ambition we give technical alignment — zetalyrae · 2026-09-09
- ACL reviewer says 3 of 4 papers she reviewed were obvious AI slop, none called out — artetxem · 2026-09-09
- EPFL lab lead says he shifted his entire lab to AI alignment and safety research — maksym_andr · 2026-09-09
- Mathematician David Bessis: AI is collapsing the 'theorem economy' and math isn't ready — stevenstrogatz · 2026-09-09
- Orchestration, harness and compute — not just the model — make the moat, argues AI practitioner — tekbog · 2026-09-09