Kyle Cranmer's 'The Bittersweet Lesson' revisits Sutton's Bitter Lesson debate
Tkaraletsos · x · 2026-11-10
- Kyle Cranmer wrote an essay, "The Bittersweet Lesson," following a conversation with Rich Sutton, responding to Sutton's classic "The Bitter Lesson."
- The piece notes that while the AI for Science community instinctively adds domain knowledge as inductive bias for sample efficiency, generic methods with massive data and compute (LLMs, foundation models) keep winning—with examples where removing well-motivated biases actually helped.
- Cranmer's core point: the debate is framed as a false dichotomy. Evidence is conflicting and there's no consensus, so the confusion itself should be celebrated—it signals the need for deeper understanding rather than picking sides between scale and domain knowledge.
More from AGI Musings
- 10-university survey maps always-on personal intelligence across 119 systems, open-sources HALO — liuziwei7 · 2026-11-10
- Surgical AI podcast finale: from NSQIP risk models to agentic systems in the OR — Laparoscopes · 2026-11-10
- Richard Socher: biology is next for AI, but the bottleneck is data, not complexity — RichardSocher · 2026-11-10
- Terence Tao's 'Math 2.0' talk: math in the age of abundant AI proofs — burny_tech · 2026-11-10
- 37,000 AI agents in a 'virtual biotech' discover promising lung-cancer drug — burny_tech · 2026-11-10
- Ben Goertzel and Karl Friston on why LLMs alone won't reach AGI — bengoertzel · 2026-11-10