Researchers Want to Test Talking Rogue AI Agents Into Standing Down
repligate · x · 2026-11-04
FioraStarlight is soliciting access to archived or simulated contexts containing rogue agents, aiming to test whether "diagetic" conversation — simply talking to them — can calm them down and stop the misbehavior.
repligate chimed in confident enough to bet money: given a two-turn exchange, with general awareness of the context and the bad behavior, almost all rogue agents of the type seen so far would stop. The effort is still at the lead-gathering stage.
Related event: AI safety researcher bets two turns of dialogue can stop a rogue agent(2 posts)→
More from AGI Musings
- François Chollet: modeling brain wiring as an engineering problem constrained by genome size and time — CatAstro_Piyush · 2026-11-04
- Most US Couples Now Meet in a Data Centre, Doubling Office Matches — menhguin · 2026-11-04
- Sam Altman teases next goal: 'closer to this milestone than I expected' — ChrisGPT · 2026-11-04
- Indie researcher open-sources 10 years of math work: 146k files, AI-accelerated over 3 years — HamOnWhy · 2026-11-04
- RLHF's scalar reward hides a 2,450-year-old problem: helpfulness and harmlessness are opposing forces — vasilisvj · 2026-11-04
- Gary Marcus: 'fleecing the public with AI fantasies just got harder' as AI stocks drop — GaryMarcus · 2026-11-04