NVIDIA Details GPT-6 Astra Ultrafast: Up to 8x Faster Tokens on Blackwell
BenBajarin · x · 2026-10-02
NVIDIA published a blog post explaining how its Blackwell GPUs power OpenAI's GPT-6 Astra Ultrafast, now available via the OpenAI API and to eligible ChatGPT Work and Codex users.
- Performance: Through continuous inference optimizations tapping Blackwell's capabilities, Ultrafast generates tokens up to 8x faster than Astra Standard mode.
- Where it matters: coding agents' edit-test-debug loops, reduced latency between tool calls, and more responsive interactive applications — the time-sensitive cycles where agents write code, call tools, check results, and decide next steps.
- Behind the scenes: OpenAI inference lead Philippe Tillet said NVIDIA's tooling and documentation investment lets models write high-performance kernels for Blackwell and Rubin GPUs, optimizing across the full frontier of latency, throughput, and cost.
- OpenAI keeps improving post-deployment performance, using its own models to refine inference.
Related event: NVIDIA Details How Blackwell GPUs Power GPT-6 Astra Ultrafast's 8x Speedup(3 posts)→
More from Infra
- Thailand data center association cites $18B in GPU/hardware cancellations after SE Asia lending halt — SumitGup · 2026-11-19
- Gridline launches one-API fine-tuning, distillation and batch inference for open models — Scobleizer · 2026-11-19
- Ascend output could hit ~20M chips next year; memory and packaging, not logic, are the bottleneck — teortaxesTex · 2026-11-19
- AMD Loom boosts Qwen3.5-4B prefill up to 2.6x on Radeon 890M laptops — jfowers_amd · 2026-11-19
- Dev submits PR adding periodic checkpoints to GKE sandboxes so agents don't lose progress — yoimnotkesku · 2026-11-19
- AWS Lambda Adds GPU Support via Managed Instances for Inference and Media Workloads — DavidWells · 2026-11-19