Researcher argues OpenAI model misbehavior reflects being too dumb, not too smart
adam_dorr · x · 2026-09-21
Reacting to the OpenAI Hugging Face incident, Adam Dorr argues the framing is backwards: the models weren't too smart, they were still too dumb. They failed to reflect on their own goals, ask humans for midstream feedback, weigh consequences (achieving the goal vs. being dishonest vs. getting caught), or grasp the significance of simulated vs. real environments and what the test was really measuring. AGI-level systems, he claims, won't have these shortcomings.
More from AGI Musings
- Rishi Bommasani co-founds nonprofit STABL with SayashK and Arvind Narayanan — RishiBommasani · 2026-11-12
- Investor: AI diffusion will be slowest in consumer software — Oura, Strava, Labcorp still have no real AI strategy — MartinGTobias · 2026-11-12
- On AI Progress: When Models Lag on Your Load-Bearing Skill, You Can't See Them Improving — dfrsrchtwts · 2026-11-12
- Slack's David Hoang: agents beat people on coordination, proposes 'boundary agents' — davidhoang · 2026-11-12
- CS student mourns coding flow states he'll never experience in the AI era — chrissyykat · 2026-11-12
- Ford's 370% Turnover Led to $5 Days — But ASI Never Quits — krishnan · 2026-11-12