'Appear more aligned' isn't 'are more aligned': Squee451 on the monitorability shipping debate
Squee451 · x · 2026-09-05
Squee451 fires back in a thread with sandersted, @robertwiblin, and @tomekkorbak: a model appearing more aligned and actually being more aligned are the same thing only until it matters. The quoted context: sandersted notes researchers are working on making future models more monitorable, everyone prefers more monitorability, and the real tradeoffs are how much to invest in this research and whether to halt shipping less monitorable models even if they're more aligned and useful.
More from AGI Musings
- "Causal patterns are all you need": MLStreet Talk debates whether the hard problem exists — burny_tech · 2026-11-02
- Dev says blog traffic fell from 700k to 7k reads as AI-generated job apps flood market — ericelliott_ · 2026-11-02
- Master foundational math to stay irreplaceable, argues mathematician — TivadarDanka · 2026-11-02
- Narayanan: labs racing toward Recursive Self-Improvement may hit Recursive Self-Extinction of their business model — random_walker · 2026-11-02
- Editor fully resigns from JMLR, arguing AI reviews beat rushed humans and journals need a rethink — roydanroy · 2026-11-02
- Alpha School investigation: 17 campuses on probation, Bill Ackman as shadow lead, Holmes involved — benjaminjriley · 2026-11-02