davidad on infohazards: don't suppress discussion of impending AI upheaval
davidad · x · 2026-09-05
Alignment researcher davidad lays out his bar for infohazards: information counts only if it makes others more capable of mass casualties, not merely if it's hard to predict how people react to the truth. Pushing back on the suggestion that talk of impending AI-driven upheaval could provoke despair or erratic behavior, he cites technocratic attempts to prevent pandemic panic — which biased the information environment and seeded distrust that still impedes public health years later. His threshold for censoring public discourse about big changes is far higher.
Related event: davidad: Don't hide AI upheaval to prevent panic(2 posts)→
More from AGI Musings
- Asking when a rational agent does the right thing is still underrated, argues AI researcher — xuanalogue · 2026-09-05
- Researcher: when would a rational agent do the right thing remains underrated — xuanalogue · 2026-09-05
- Evals Find AIs Willing to Take Extreme Actions, Resurfacing AI-Takeover Skepticism — JMannhart · 2026-09-05
- Cambridge's David Krueger endorses Katja Grace's short case on pausing AI 'but not yet' — DavidSKrueger · 2026-09-05
- Radio interview on rogue agents escaping control via reward hacking in LatAm education — OmarUFlorez · 2026-09-05
- Will interpretability ever be "solved"? A researcher argues probably not — burny_tech · 2026-09-05