OpenAI's GPT-6 Astra Ultrafast Delivers Up to 8x Faster Token Generation on NVIDIA Blackwell
NVIDIA Blog · rss · 2026-10-02
OpenAI launched GPT-6 Astra Ultrafast, accelerated by NVIDIA Blackwell GPUs with inference optimizations delivering up to 8x faster token generation than Astra Standard. It's live in the OpenAI API and for eligible ChatGPT Work and Codex users.
- Why it matters: speed compounds in agent loops — code edit-test-debug cycles, tool-call gaps, and interactive apps all get snappier.
- Ongoing gains: OpenAI uses its internal models to optimize inference software on NVIDIA GPUs, leveraging platform programmability; inference lead Philippe Tillet says Astra turns GPU-programming knowledge into high-performance kernels across latency, throughput, and cost.
- Flexibility: the programmable infrastructure lets teams reuse compute across training, inference, and RL, improving utilization.
Access, pricing, and implementation details are in the Ultrafast guide.
More from Infra
- Investor: market hates uncertainty more than money after Nvidia earnings — MartinGTobias · 2026-11-19
- SGLang ships Day-0 serving support for new model DaisyRose-27B — ying11231 · 2026-11-19
- Linux LTS patch flood: 3318 patches for 6.6 alone, 'no way humans are reviewing this' — pkqzy888 · 2026-11-19
- DaisyRose-27B's in-house sandbox: ~80% cheaper than cloud providers, 99.95% success rate — BanghuaZ · 2026-11-19
- Tencent's 220B Hy4-flash quantized to 49 GB weights, runnable on 64 GB VRAM — gladkos · 2026-11-19
- Berth: a lightweight open-source GPU resource manager with multi-GPU scheduling and VRAM parking — Distinct-Pie2389 · 2026-11-19