No Covert Distillation: European AI Can't Beat Qwen2.5 3B Even With Logits
MaziyarPanahi · x · 2026-07-23
Author strongly refutes recent claims that Moonshot AI covertly distilled Anthropic's models at an industrial scale to develop its K3 model, calling the concept of "large-scale, covert industrial distillation" non-existent.
He argues that even if the logits from top-tier models were handed over, most European AI companies still couldn't build a 3B model capable of beating Qwen2.5. Acknowledging the difficulty, he urges the industry to be fair and give credit where it is due for China's open-source advancements.
More from Fun
- Meme: Engineers Unleash 10,000 Claude Sub-Agents on Friday Afternoon to Clear a Week's Work — _jaydeepkarale · 2026-09-11
- AI safety isn't a coordinated cabal: half the field has posted their life stories on LessWrong — ShakeelHashim · 2026-09-11
- Kid Coins "Princessmaxxing" After Subway Chat About Same-Sex Wedding Attire — anderssandberg · 2026-09-11
- 'AGI is here' vs reality: AI labs still ship some of the jankiest desktop apps ever — MilesCranmer · 2026-09-11
- 'The revolution will have a token limit': one-liner on context window limits — AIandDesign · 2026-09-11
- One-liner echoing the nostalgia: missing human craft, writing, and technical debates — vboykis · 2026-09-11