Top-k Sampling Visualized: Lori at 73%, Alice at 27%, Alice Wins the Draw
cfregly · x · 2026-11-11
Another installment of the cartoon CUDA series explains top-k sampling: Jensen scores candidates and keeps only the two highest — Lori (3→73%) and Alice (2→27%) — filtering out "Neither". After renormalizing, this draw samples Alice, showing how top-k reshapes the generation distribution.
Related event: Cartoon Series Explains Sliding Window Attention and Top-k Sampling(2 posts)→
More from Infra
- Q-CTRL launches Dynamics Simulator on IBM Quantum, up to 3,000x faster than classical tools — MJBiercuk · 2026-11-11
- CoreWeave Q3: $3.7B revenue up 168% YoY, active power hits 1.7GW — altryne · 2026-11-11
- Server racks replace houseplants in viral glass atrium meme — gethackteam · 2026-11-11
- FCC accepts SpaceX's bid for nationwide 800 MHz spectrum covering ~100% of the US — ns123abc · 2026-11-11
- Substack signs compute deal with CoreWeave, an unexpected move for a writing platform — realsohamparekh · 2026-11-11
- Why everyone is buying Mac minis: running open-source AI models locally — HarperSCarroll · 2026-11-11