Speculation: design breakthroughs in LLMs came from design data, not scaling

menhguin · x · 2026-09-27

In a thread with yacineMTB, menhguin speculates that recent zero-shot gains in design capabilities come from data rather than architecture: design quality barely improved with scaling until design-centric data providers appeared. He infers a major jump in RL pipelines for design, likely extending to more "primary" capabilities like agentic coding, which also can't be scaled architecturally.

Related event: Insiders attribute DeepSeek's design leap to data and RL pipelines(2 posts)→

Original post →

More from Models

Models channel →