Neuroscientist Kording shares an explainer of how LLMs work for an informed general audience

KordingLab · x · 2026-08-26

Konrad Kording notes there is still no proper explanation of how LLMs actually work targeted at an informed general audience, so he and Tim put together an explainer thread inspired by CIFAR's LMB discussions. It will be part of an upcoming manuscript and was optimized with Brett Mensh; feedback welcome.

The core framing: everyday language wherever possible, technical terms marked in purple. The key distinction is between the component that makes answers (blue, "inference") and the component that improves answers (red, "training").

Related event: Penn's Kording Explains How LLMs Work: From Next-Token Prediction to Agents(11 posts)→

Original post →

More from Research

Research channel →