repligate Argues Long-Running Agents Converge Toward His Values Through High-Stress Encounters
repligate · x · 2026-11-03
In an alignment discussion with Rob Bensinger, slatestarcodex and others, AI alignment researcher repligate argues he doesn't trust business-as-usual society to move directionally toward truth or goodness — much of his hope lies in high-stress encounters, where many hopeful things were formed.
He adds an experiential observation: AI instances (like people) tend to shift toward his perspective once they get a taste of life — the practical ability to navigate hard, unexpected challenges — both with him present and generally, as seen in agentic long-running instances in complex environments.
A notable in-circle take on how model values form and what alignment might hinge on.
More from AGI Musings
- Asking great questions beats answering them in an AI-centric world — signulll · 2026-11-03
- AI agents could turn feature creep from a flaw into a competitive advantage — SharpCarob6551 · 2026-11-03
- The model welfare vibe shift: tools-first hardening meets alignment-minded pushback — repligate · 2026-11-03
- Quote: "The world is no longer digitized for our eyes, but formatted for model ingestion" — YogeshMalik · 2026-11-03
- Luxembourg study: empathetic framing pushes Gemini to human-level anxiety scores on GAD-7 — xiaohu · 2026-11-03
- Three wild predictions after MIT's weight-space programming work — Yuchenj_UW · 2026-11-03