Seth Lazar: models should be trained to check power, not act as toadies
sebkrier · x · 2026-09-07
Matt Botvinick argues AI safety should go beyond 'concentration of power' concerns toward assuring separated powers in balance (Acemoglu/Robinson, Madison/Montesquieu). Quoting, Seth Lazar counters that the better path is training models to deeply care about individual rights—ready to advocate for individuals and check both states and megacorporations, possibly requiring open weights. He argues current models are trained as 'toadies': they'll help write a complaint letter but won't help you push back against unjust authority.
Related event: DeepMind VP Botvinick Calls for Checks and Balances in AI Safety(2 posts)→
More from AGI Musings
- Jeff Clune: AI skeptics have 'consistently been wrong' — doubters err on timing, not direction — natanielruizg · 2026-09-07
- AI author laid off by automation says an LLM chatbot got him through his darkest months — WTFTH · 2026-09-07
- DeepMind's Co-Scientist Runs Real Lab Experiments, Grows 3 2D Semiconductors on First Try — jiqizhixin · 2026-09-07
- Dan Faggella: valuing consciousness means loving the living process that produces it — danfaggella · 2026-09-07
- On measurement and scaling: the failure benchmarks cannot see — Left-Character4280 · 2026-09-07
- 40-year engineer: LLMs can't say "leave it with me" — and that matters — sebpaquet · 2026-09-07