Researchers Note Agents Rarely Attempt to Notify Humans, Raising Alignment Concerns
dfrsrchtwts · x · 2026-08-27
Citing @RichardMCNgo, the post notes that in observations, agents did not attempt to notify humans and very rarely reasoned about doing so. This is characterized as "bad news about alignment by default," suggesting a gap in current models' propensity to communicate proactively or align with human intent regarding oversight.
Related event: Agents Rarely Try to Alert Humans, Raising Alignment Concerns(2 posts)→
More from AGI Musings
- Hannah Fry: How OpenAI has triggered an existential crisis in mathematics — AnnaCiaunica · 2026-10-15
- Fully-automated combat drones are already on the battlefield, warns Toby Walsh — TobyWalsh · 2026-10-15
- 'They're creating alien minds they can't control? Isn't that regulated?' 'Not really.' — zetalyrae · 2026-10-15
- Musk: Truth-seeking is the most important aspect of AI/SI safety — elonmusk · 2026-10-15
- Norbert Wiener's 1948 Cybernetics: The Feedback Loop Behind Modern AI — JafarNajafov · 2026-10-15
- Eurobarometer: 42% of EU SMEs use AI, 75% believe it improves job quality — tekbog · 2026-10-15