Anthropic rewrote Messages API in Rust with Claude, cutting CPU usage 40-50%
mark_k · x · 2026-11-01
Anthropic ported its Messages API from Python to Rust with a team that initially had no Rust developers — Claude handled most of the implementation while engineers designed the system, planned the migration, and verified results. Per platform engineering head Katelyn Lesse, the result: 40-50% lower CPU usage and 10-20% faster time to first token. They ran the Rust version alongside Python with shadow traffic, compared outputs, then gradually shifted real traffic, deliberately freezing features during the rewrite.
More from coding & agent
- Jez Humble's talk: making CI/CD work for fully agentic delivery — RealGeneKim · 2026-11-02
- Super-agent context design cuts task time to 12.4 min vs 20.4 min baseline — Hesamation · 2026-11-02
- Jez Humble: everyone is rediscovering trunk-based dev and real CI — RealGeneKim · 2026-11-02
- The AI plan looked perfect — so it built a fish tank — jimmykoppel · 2026-11-02
- A buffer-based workflow with Typefully and Claude Code for sharing AI work without burnout — brandon_galang · 2026-11-02
- Grok bot can now spin up webhooks for agents, killing automation plumbing drudgery — johnlindquist · 2026-11-02