Engineer turns NCCL Broadcast into a meme about Jensen Huang's apology
cfregly · x · 2026-11-11
Engineer cfregly riffs on NVIDIA's NCCL collective communication docs: NCCL Broadcast copies bytes from the root rank/GPU to all other ranks — "Jensen writes 1 apology and NCCL Broadcast copies it to Lori, Alice, the NVIDIA board, and us shareholders. Everyone receives it." The accompanying diagram casts NVIDIA execs and shareholders as ranks in a distributed cluster.
In a follow-up he uses the same cast to explain temperature and next-token determinism: at T=0 greedy decoding picks Lori; at T=1 sampling follows the original odds and Alice wins the draw. Links to the NCCL 2.32.3 docs covering ncclBroadcast/ncclBcast and related collective ops.
More from Fun
- Ethan Mollick lets a swarm of agents argue their way into building a fantasy transport sim — emollick · 2026-11-11
- Claim: Daniel Kokotajlo staked equity to write AI 2027 in exchange for not criticizing OpenAI — sjgadler · 2026-11-11
- Missouri teens accused of stealing Flock cameras caught by the Flock camera network itself — Polymarket · 2026-11-11
- Redditors reproduce the disputed Fable 5.2 demo video, cost ~$20 in API tokens — timeport-0 · 2026-11-11
- Dev builds an AI paintbrush that repaints her first drawing in 55,185 strokes — repligate · 2026-11-11
- 'Glued two semiconductors together, now it's a conductor' — nerdy joke goes around — prateekj · 2026-11-11