Yoav Goldberg coins 'harness distillation': agent scaffolding skills will be absorbed into models
yoavgo · x · 2026-10-04
In the harness-vs-model debate, NLP researcher Yoav Goldberg coins the term 'harness distillation': capabilities start in the harness, and once they work well, the next model generation is trained on harness-assisted outputs and trajectories, internalizing the scaffolding. He adds that real harnesses may still beat distilled models on edge cases, but the gap mostly shows in rare scenarios—not worth the operational cost for common cases. Well-funded domains will converge; niche domains will keep dedicated harnesses.
More from coding & agent
- FT: US tech outages blamed on rush to fix bugs found by AI — nordicinst · 2026-11-19
- Claude Code overtakes Cursor and Copilot in job-post mentions ahead of Anthropic IPO — antgoldbloom · 2026-11-19
- Dev submits PR adding periodic checkpoints to GKE sandboxes so agents don't lose progress — yoimnotkesku · 2026-11-19
- AWS adds private CA support to Bedrock AgentCore Identity for connecting agents to self-hosted IdPs — AWS ML Blog · 2026-11-19
- Orchestrator's Cloud Agents graduate from beta to general availability — julianweisser · 2026-11-19
- Zero users, 33 pages shipped: dev crowdsources audit for AI-agent trust schema — TheHamzaShahbaz · 2026-11-19