Agentic infra can beat LLMs alone on compositional generalization
prasanna_says · x · 2026-07-21
The post argues that the output of agentic infrastructure is greater than the sum of an LLM plus its harness.
It connects this idea to compositional generalization: if a model can solve one task, it does not necessarily generalize to a structurally similar unseen task. A harness can help by making two problems look the same through context offloading and programmatic sub-calling, which may let models trained on easy tasks generalize better to harder ones.
The author suggests this pattern matters not only for closed-loop domains like coding and math, but also for other decomposable tasks where humans may currently provide the missing loop via taste and selection of outputs.
More from coding & agent
- Anthropic researcher: 99% of engineers now run swarms of 300+ self-improving agents — AlishaOutridge · 2026-09-11
- Gergely Orosz: Shipping 10x PRs With AI Agents, Sites Fill With Small Regressions — ducha_aiki · 2026-09-11
- Same Echo Maze prompt, three frontier models: all passed visually but shipped the same hidden bug — eyishazyer · 2026-09-11
- Astra storyboards plus Minimax H3 per-shot generation boost video success rates — Hailuo_AI · 2026-09-11
- Codex tip: use Sol with Astra and Luna sub-agents to save usage — pvncher · 2026-09-11
- agents-best-practices: a provider-neutral Agent Skill for designing and auditing agentic harnesses — tom_doerr · 2026-09-11