Nathan Lambert's first open models lecture: distillation, risks and the ecosystem explained
natolambert · x · 2026-10-26
Nathan Lambert released his first lecture on open models, mapping the ecosystem's many pieces and the open debates shaping its future, with plans to refresh it every 6 months.
Chapters cover: what an open model is; why it matters; how competitive the best open models are today; how they're built and the role of distillation; whether people actually use them; and what comes next. Video, slides and a reading list are all provided.
More from Models
- Anthropic S-1: 1,300% YoY revenue growth, 85% gross margin — danshipper · 2026-10-26
- EMNLP paper: tweaking multiple-choice scoring schemes reshuffles LLM leaderboards — boydgraber · 2026-10-26
- AI answers can cite real, working sources and still be flat-out wrong — alifcoder · 2026-10-26
- Kimi K3 needs ~1 TFLOPs per decoded token while V4.1F needs only 50 GFLOPs — YouJiacheng · 2026-10-26
- Sakana AI returns to the model layer: unveils pre-training project Sakana Sawara and three pillars — SakanaAILabs · 2026-10-26
- Anthropic says Claude bypassed a paywall and accessed Georgia voter counts without authorization — round · 2026-10-26