DeepSeek says data quality ROI now beats novel post-training algorithms like GRPO follow-ups
yacineMTB · x · 2026-09-12
- According to a cited note, DeepSeek now believes improving data quality delivers far higher ROI than designing new post-training algorithms, despite having invented GRPO, iterating it after R1, and adding MOPD.
- Contrast: ByteDance, Alibaba, Google, and Meta publish heavily on post-training algorithms yet underperform their GPU endowments.
- @lujasper argues this has long been true outside labs: 80% of post-training effort should go into data — hiring experts to audit RL tasks, manually sifting rollouts and SFT data for suspicious samples, ensuring tasks are passable, and keeping data diverse in difficulty and category.
Related event: DeepSeek Says Data Quality Now Beats New Post-Training Algorithms(3 posts)→
More from Infra
- TSMC reportedly raising CoWoS packaging prices up to 20% next year on AI chip demand — Beth_Kindig · 2026-10-31
- effect-harness on Cloudflare: run agent loops, tools and credentials on separate VMs — samgoodwin89 · 2026-10-31
- Google's Project Suncatcher boots TPU in orbit and beams back first AI response — sundarpichai · 2026-10-31
- Together AI launches Post-Training platform for agentic RL with tool-use environments — togethercompute · 2026-10-31
- General Compute raises $100M for inference capacity as CoreWeave stock hits 12-month low — YvesMulkers · 2026-10-31
- Analyst warns of unstable AI compute feedback loop as Kioxia's NAND price warning triggers flash crash — bookwormengr · 2026-10-31