No Covert Distillation: European AI Can't Beat Qwen2.5 3B Even With Logits
MaziyarPanahi · x · 2026-07-23
Author strongly refutes recent claims that Moonshot AI covertly distilled Anthropic's models at an industrial scale to develop its K3 model, calling the concept of "large-scale, covert industrial distillation" non-existent.
He argues that even if the logits from top-tier models were handed over, most European AI companies still couldn't build a 3B model capable of beating Qwen2.5. Acknowledging the difficulty, he urges the industry to be fair and give credit where it is due for China's open-source advancements.
More from Fun
- Grok anti-spam trap instantly catches an AI reply bot that follows every clue perfectly — vista8 · 2026-10-27
- Meme: ML researchers refuse the real world — 'iid data only for me, thanks' — miniapeur · 2026-10-27
- Meme: Modern PCs cry over 0.1 dB while chad users shrugged at jet-engine boot noise — miniapeur · 2026-10-27
- Gary Marcus mocks being blocked mid-debate: 'Very courageous!' — GaryMarcus · 2026-10-27
- Blogger plans to use Grok to auto-block AI comment bots on X — vista8 · 2026-10-27
- Anthropic files S-1 on Monday morning, VCs complain they can't do instant teardowns — mattturck · 2026-10-27