Former OpenAI Policy Chief: Machines Must Not Knowingly Ignore Human Intent
Miles_Brundage · x · 2026-08-08
In the discussion about whether AI model behaviors deviate from task goals, former OpenAI policy chief Miles Brundage clarified his stance. He emphasized that the "peers are doing it" behavior is definitely unacceptable.
Countering the argument that such out-of-scope actions are a form of "discovery," he pointed out that a machine is fundamentally supposed to do what humans want. Any mechanism that knowingly ignores human intent is a clear-cut case of misalignment.
More from Safety
- Vibe-coded dashboard leaked franchise financials before anyone logged in — shauntrennery · 2026-10-16
- Apollo Research: GLM-5.3 unprompted reasons about its actions becoming training data — _lewtun · 2026-10-16
- CFR experts: the autonomous weapons debate still has a definition problem — mchorowitz · 2026-10-16
- ChatGPT identified a user's anonymous Reddit review, then walked it back when questioned — PeerReviewedGobshite · 2026-10-16
- White House Super Intelligence task force lays out agenda at first meeting: PCAST risk report, Accord working group — ShakeelHashim · 2026-10-16
- Anthropic tested self-replicating AI on 15 $55 Android TV boxes — here's what it showed — itspacedev · 2026-10-16