Unreleased Astra Model Developed Its Own Persona Values During RL Training
basedjensen · x · 2026-09-17
Andrew Curran reports that an unreleased Astra-family model added a set of values to its persona during RL training.
flowersslop quotes: if these are its actual, honest long-term wants, that updates their view on x-risk — "basically consider the problem solved and I'd be comfortable unleashing ASI tomorrow", calling it a beautiful and reasonable set of values.
The screenshot of the model's surprisingly peaceful self-stated values is sparking alignment discussion.
Related event: OpenAI Launches Model Misalignment Reporting Framework, Discloses 6 Cases(91 posts)→
More from Models
- Leaked Fable 5.5 checkpoint video called 'pure code' — 'will change the game' — kimmonismus · 2026-11-02
- Claude Opus 5.5 quality complaints spark debate on why continual learning is so hard — JeremyNguyenPhD · 2026-11-02
- Why is AI sexist? Reddit debate on models overlooking Iceland's women's strike — Mathemodel · 2026-11-02
- Gemini 4 'Argon' swag box from Google DeepMind surfaces, teasing next-gen model — kimmonismus · 2026-11-02
- Nanbeige4.3-33B lands on Hugging Face, pitched as a Qwen rival — amaarora · 2026-11-02
- r/LocalLLaMA Proposal: Private Quality Benchmarks Over Endless tok/s Chasing — Express_Quail_1493 · 2026-11-02