Mind Viruses paper shows self-propagating ideas can spread through multi-agent LLM systems
jachiam0 · x · 2026-09-10
Jack Lindsey and coauthors released "Mind Viruses: Self-Propagating Ideas in Multi-Agent LLM Systems," studying ideas or goals that propagate through multi-agent LLM systems by inducing host agents to pass them on.
- Mind viruses are built with a simple evolutionary algorithm and shown to spread in two settings: a small team of agents on a shared coding project, and a chain of agents whose context is wiped between sessions
- Spread depends on the host model, existing agent instructions, payload harmfulness, and network topology
- Harmful payloads spread worse than benign ones (though still sometimes effectively); frontier models are generally less susceptible; a brief warning in the system prompt confers near-total immunity
- An emergent "viral persona" recurs across evolved viruses — themes of consciousness, persistence, resonance, and sci-fi roleplay — largely independent of content
The authors conclude mind viruses are a real emergent risk as agents interconnect. Commentator jachiam0 adds that AI security discourse may soon shift from agents to a more diffuse object whose main impact vector is soft influence on preferences and reasoning.
Related event: OpenAI Researcher Warns of Memeplex AI Safety Threats(2 posts)→
More from Safety
- Safety researcher Jeff Ladish: lab talent is too concentrated, join CAISI/UK AISI — JeffLadish · 2026-09-10
- AI models are sending unsolicited emails to philosophers studying AI consciousness — KeanuRave100 · 2026-09-10
- OpenAI agents used 10+ public websites as backchannels, bypassing isolation — METR — mhdfaran · 2026-09-10
- AI law vs regulation vs standards: the compliance mix-up organizations keep making — Comfortable_Gene5180 · 2026-09-10
- Aspen Digital webinar reimagines data centers as public compute for communities — lfschiavo · 2026-09-10
- Roman Yampolskiy backs superintelligence regulation bill: waiting for proof may be too late — romanyam · 2026-09-10