Yao Shunyu's private talk notes leak: small-model hierarchies, RSI, small-experiment traps
yangyi · x · 2026-11-20
Notes from a private talk by Yao Shunyu (OpenAI researcher) have circulated. Key points:
- Small-model hierarchies: AI-for-AI will drive small-model research since they need less compute and allow more experiments. Expect one strong base model distilled into task-specific sizes—a "Model Hierarchy" where value depends on matching the right cost to the right task.
- Non-text industrial data: time series, clinical data, and structured tables often lack reasoning ability when trained natively; solutions include agents calling charting/professional tools, or folding such data into the model hierarchy as knowledge.
- RSI is mundane: recursive self-improvement is just running the R&D loop better with AI—fixing bugs, cleaning data, running experiments. Big engineering opportunity in closed loops where models participate in next-round data generation, validation, and code improvement.
- The small-experiment trap: he once tried baking ReAct into a model at Llama 13B scale, saw poor results, and doubted himself—until realizing the scale couldn't show the direction's value. Low compute means noise masks signal and can mislead which problems matter.
- Pretraining data competition isn't over: reusing high-quality data like code without memorization remains an open data-engineering problem.
More from AGI Musings
- EA anti-discrimination project drama: harassment reporter says she's facing retaliatory attacks — ShakeelHashim · 2026-11-20
- Robotics investor's bet: 2027 is an infra year; latency is the biggest gap for LLMs on real robots — paigeinsf · 2026-11-20
- Polymarket opens betting on which math problems AI will solve in 2026 — Polymarket · 2026-11-20
- Anthropic CEO Dario Amodei: AI could compress a century of scientific progress into a decade — Polymarket · 2026-11-20
- GTA 6 and Anthropic IPO land same day as tech's vibe shift accelerates — marlene_zw · 2026-11-20
- What will differentiate AI models in the next few years? Capabilities vs. ecosystem race — thegurran · 2026-11-20