'Small' Model Turned Out to Be 594B Total Params with 17B Active

dejavucoder · x · 2026-11-07

dejavucoder mocks a newly released 'small' model (inkling 2 small): marketed as small, but it's actually 594B total parameters with only 17B active. With a Dune movie still, the post jokes that the 'mahdi' is too humble to admit he has big-model smell—pointing out that 'small' in MoE marketing often just means small active params, not small total size.

Original post →

More from Fun

Fun channel →