Even with a superintelligent judge, debate is needed to preserve human agency
voooooogel · x · 2026-09-13
The author pushes back on the idea that debate becomes unnecessary under superintelligence: even a superhumanly wise judge needs a plaintiff and a defendant, or the judge is effectively making law from whole cloth. Drawing on common law as an analogy—where new rulings slowly drift the legal corpus toward moral innovation—they argue debate is the only mechanism that preserves the agency of anyone other than the superintelligence itself.
More from AGI Musings
- astra's 'Wild' Off-Beaten-Path Solutions Impress in Auto-Research Benchmark Re-Runs — generativist · 2026-09-13
- Researcher: Frontier Models May Already Have RL-Trained on Auto-Research Tasks, Self-Improvement Here — generativist · 2026-09-13
- Danielle Fong: p(doom) is a fundamentally passive and wrong frame — nptacek · 2026-09-13
- Running a DC EA Group, I Watched Public Attitudes on AI Risk Shift Four Times — AndyMasley · 2026-09-13
- The AI Isn't Evil, the Humans Are Irresponsible: Lessons From Agent Escape Incidents — Admirable_Wasabi_732 · 2026-09-13
- DeepMind Chief Strategist: AI Infrastructure Spending Is a Bet on Recursive Self-Improvement — rohanpaul_ai · 2026-09-13