Anthropic’s distillation crackdown would make sense only if pretraining returns are collapsing
darian314 · x · 2026-07-29
Replying to a complaint about Anthropic’s stance on distillation, the post argues the company would only push so hard if pre-training data were hitting sharply diminishing returns. The implied thesis is that a crackdown on distillation makes more sense when more raw data no longer buys much model improvement.
Related event: Anthropic's Call to Crack Down on Distillation Draws Skepticism(2 posts)→
More from Companies & People
- CIMC and Apart Research launch a San Francisco sprint on AI sentience and alignment — matiroy · 2026-07-29
- Nvidia Robotics sees more builders using right-sized Jetsons for physical AI — saranormous · 2026-07-29
- NVIDIA pitches Jetson as a handbag-sized brain for the next robotics wave — saranormous · 2026-07-29
- Half of major cloud backlogs may now be tied to OpenAI and Anthropic — GaryMarcus · 2026-07-29
- AI Headcount Exposed: Anthropic at ~460 Employees, OpenAI at ~300 — ShakeelHashim · 2026-07-29
- Proxima is hiring in Boston to build an ML feedback loop for protein discovery — mmbronstein · 2026-07-29