Paris MVA master's LLM course lecture published: from word counts to attention
mishig25 · x · 2026-10-21
The instructor teaching "Fundamentals of LLMs" in Paris's MVA master's program turned the first lecture, "NLP before LLMs," into a blog post covering everything from simple word counts to attention.
- The approach is learning by doing: each step includes hands-on exercises inspired by key research papers
- The author argues that when AI agents make code easy and cheap, understanding is what matters — and you build it by doing the work yourself
- Next up: Tokenizers
More from Companies & People
- KU Leuven and VIB open two Group Leader professorships in AI for Biology, start 2027 — jpillowtime · 2026-10-23
- Google's Gemini pretraining team is hiring research engineers in London and MTV — zacharynado · 2026-10-23
- After data and compute, the next picks-and-shovels are talent and physical infrastructure — philhchen · 2026-10-23
- Critics slam Anthropic for rarely defending its work against criticism on Twitter — DKokotajlo · 2026-10-23
- Amazon blocks AI shopping agents while Walmart opens its site to them with spend controls — venturetwins · 2026-10-23
- Commenters speculate Skydance could wire Grok into its entire Hollywood production pipeline — MickeySteamboat · 2026-10-23