Cartoon Series Explains Sliding Window Attention and Top-k Sampling

The cartoon series uses Jensen, Lori and Alice characters to explain AI concepts: sliding window attention discards tokens once the window passes, while top-k sampling keeps only the highest-scoring candidates and renormalizes their probabilities.

2026-11-11 ~ 2026-11-11 · 2 related posts

• Top-k Sampling Visualized: Lori at 73%, Alice at 27%, Alice Wins the Draw — cfregly · 2026-11-11
• Sliding Window Attention Explained with Cartoon Huangs: Old Tokens Slide Out of View — cfregly · 2026-11-11