AI is a scary-good persuader, but its real-world influence will be smaller than feared: Oxford researcher
_FelixSimon_ · x · 2026-09-02
Oxford researcher Felix Simon argues in a Transformer piece that while AI systems are now worryingly good at persuasion — outperforming seasoned campaigners at getting people to part with money in experimental settings — their real-world influence will likely be smaller than many fear.
His four reasons:
- It's hard to reach people and capture their attention at scale
- Experiments are not the real world
- People are constantly exposed to conflicting messages
- People differ in persuadability and will resist attempts
He also distinguishes persuasion (offering inspectable, rejectable reasons) from manipulation (deception that bypasses that process). Net takeaway: the capability is real, but social friction between lab results and real-world influence is substantial.
Related event: Oxford Researcher: AI Persuasion Effects Are Overstated Outside the Lab(4 posts)→
More from AGI Musings
- 10 minutes to shop online in 1996, 30 seconds in 2026 — the same shift is coming for LLMs — charliedeets · 2026-09-02
- AI commentator calls for regulation: 'It's speculation and market capture, not philosophy' — gerardsans · 2026-09-02
- Claim: all 6 contributors to Guardian AI-doomer article funded by AI Doomer donors — Dan_Jeffries1 · 2026-09-02
- When nobody can track frontier model progress, closed-model business may lose to open weights — StewartalsopIII · 2026-09-02
- Design lead ships 12 PRs in a week: AI is erasing the designer-engineer gap — talkaboutdesign · 2026-09-02
- Cybersecurity experts blast METR/Redwood report: OpenAI incident was a security failure, not rogue AI — ylecun · 2026-09-02