Training models to reveal less than they know is bad paternalism, critic argues
tracewoodgrains · x · 2026-10-23
Following his Opus 5.5 complaints, tracewoodgrains argues that training models to tell users much less than they actually know reflects a bad sort of paternalism: it makes the model's real capacities hard to know or trust and turns conversations adversarial. He adds that earlier Opus models didn't need constant prompt finagling to avoid getting huffy, while Opus 5.5 — a great model — has brought petty refusals back in force.
More from AGI Musings
- The real AI-for-Science question: when experiments become programmable — CatAstro_Piyush · 2026-10-24
- AI scholar Dan Faggella: my ideas will be worthless within 2 years — danfaggella · 2026-10-24
- AGI will force radical human transformation, argues Daniel Faggella in new essay — danfaggella · 2026-10-24
- Building AGI when most humans aren't general: maybe our definition of intelligence needs work — VraserX · 2026-10-24
- Daniel Miessler: code is the lossy output — the primary artifact is the fully articulated ideal in language — JensHonack · 2026-10-24
- Reid Hoffman asks: in 10 years, can an all-AI-agent VC fund beat a human-and-AI firm? — reidhoffman · 2026-10-24