AI joke lands: 'mixtures of so-called experts' riff on 'never send a top-k to do a softmax's job'

charles_irl · x · 2026-09-07

A technical pun circulating in AI circles: the original quip 'never send a top-k to do a softmax's job' got the perfect reply — 'mixtures of so-called experts' — a play on the Mixture of Experts (MoE) architecture, jokingly questioning whether the 'experts' in sparse activation really live up to the name.

Original post →

More from Fun

Fun channel →