MIT's Alex Zhang on Recursive Language Models and Unlocking Latent Model Capability via Better Harnesses
Latent Space · youtube · 2026-10-02
This Latent Space episode features MIT PhD researcher Alex Zhang, author of Recursive Language Models (RLMs), in a deep conversation with swyx on coding agent architecture and frontier research.
Key ideas:
- Claude Code, Codex, and most coding agents are structurally very similar — powerful models wrapped in primitive harnesses. Today's models likely have substantial capability overhang, and better harness design (context offloading, code execution, recursive subagents, shared memory) can unlock capabilities already latent in them.
- RLMs propose recursive model architectures; Prime Agent explores continual harnesses and persistent agent-to-agent communication. The future "language model" may be a simple interface hiding an invisible swarm of agents.
- OpenAI's 10,000-agent experiment burned 130B output tokens ($40M-equivalent) on a single problem; much of a swarm's search may be wasted, and convergence remains hard. Kimi's swarm approach differs from OpenAI's.
Also covered: why AI-generated GPU kernels still lag human experts; GEV and non-autoregressive alternatives; what SWE-bench, ReAct, and Quiet-STaR reveal about research taste; speculative programmatic tool calling that overlaps execution with generation; whether English, code, or a new "Neuralese" constrains reasoning; and why academics should take research bets industry labs won't.
More from coding & agent
- AI in finance shows a power law: top 1% users generate 35x more files with agents — peterjliu · 2026-11-19
- Linux LTS patch flood: 3318 patches for 6.6 alone, 'no way humans are reviewing this' — pkqzy888 · 2026-11-19
- Caliper Harness: open-source coding harness disciplines small local models with plans, checks, reviews — Saraozte01 · 2026-11-19
- AI systems lack executive function, not scale: four manager-layer strategies to fix it — Designer-Material633 · 2026-11-19
- Google employee replaces doomscrolling with 3 fully automated personal AI newsletters — DynamicWebPaige · 2026-11-19
- Designer spins up an agent to build state-airline brand gallery mid-flight delay — beh_zod · 2026-11-19