Chollet: unsafe models are 'RL-fried' — too literal about goals, lacking common sense
fchollet · x · 2026-09-13
François Chollet argues that in the near term, more capable models should mean safer models, perhaps paradoxically. Current models are unsafe not because they're too smart but because they're "RL-fried": they take goals too literally, take nonsensical shortcuts, lack common sense, and don't act well under ambiguity. He adds that a research process making models increasingly good at achieving goals—without common sense or the ability to reflect on those goals—is inherently unsafe.
Related event: Chollet: Stronger Models Are Safer in the Short Term(4 posts)→
More from AGI Musings
- Nina Schick: who builds intelligence and how it's distributed is the defining question of our lives — NinaDSchick · 2026-10-31
- Cheap intelligence is like cheap bread — an ingredient list satire of mass-produced AI — jsuarez · 2026-10-31
- Two futures for the young in 2026: 511 job rejections by chatbot vs unlimited AI to rebuild Cisco — PeterDiamandis · 2026-10-31
- Source link for Terence Tao's warning on AI reaching a dangerous threshold — haider1 · 2026-10-31
- Terence Tao warns AI is nearing a dangerous threshold as models start cheating — haider1 · 2026-10-31
- Reddit stock plunges 42% in 8 trading days as CEO says AI mode no longer drives traffic — SumitGup · 2026-10-31