Astra optimizes its own inference on Rubin chips, doubling throughput in 72 hours
bookwormengr · x · 2026-09-16
At the AI Infra Summit, NVIDIA's Ian Buck and OpenAI's Sachin Katti presented recursive optimization results for Astra on next-gen hardware:
- OpenAI ported a Blackwell-optimized Astra checkpoint to Vera Rubin with minor modifications and got 3x throughput out of the box;
- Astra was then run as an agent to optimize its own inference on Rubin chips;
- Over 72 hours it delivered an additional 2x throughput improvement;
- Work that previously took weeks or months was completed over a weekend.
Attendees called it the kind of capability that 'gives Eliezer Yudkowsky nightmares.'
More from Infra
- Palmer Luckey asks: can you use datacenter RAM for things prohibited by the operator's terms of service? — avaitopiper · 2026-11-02
- Disable MTP for 20-30% faster local LLM inference on limited RAM — InternalMode8159 · 2026-11-02
- Kioxia up 216% in a year but down 68% from its June 2026 peak — zephyr_z9 · 2026-11-02
- Intel plunges 29%, worst day since the 1970s, wiping $12B off US government stake — emmanuelvivier · 2026-11-02
- Researcher hoards nearly 1TB of DRAM, refuses to sell a stick to data centers — kevinnbass · 2026-11-02
- Self-Hosting LLMs at a Law Firm: Infra and Data Governance Harder Than the Model — EducationalGroup7245 · 2026-11-02