"Reverse Alignment" initiative argues society—not just models—needs to be aligned for AI

profjamesevans · x · 2026-11-06

Scholar James Evans and the Sociotechnical Grand Challenges Coalition launched "Reverse Alignment" (reversealignment.ai), arguing that beyond model alignment, institutions, norms, skills, and governance must be deliberately redesigned so societies can safely absorb AI.

The core argument: nearly all AI effort and capital goes to making systems more capable and aligning them with human values, but even a perfectly aligned model will underdeliver or cause harm if released into unprepared economies, governments, and information systems. Historically, industrialization, electrification, and the internet each required decades of institutional invention before benefits arrived.

The project identifies three predictable failure modes:

The authors claim the same designs double as defenses: attestation webs resist agent swarms, bridging resists manufactured consensus, and surprise-weighted credit resists synthetic flooding.

Related event: Scholars Propose "Reverse Alignment": Pay Data Creators by Contribution and Surprise(3 posts)→

Original post →

More from AGI Musings

AGI Musings channel →