Post-'2x Speed' Claims Tested: $300/M Astra UF Still Struggles Above 100tps
NandaVegg · reddit · 2026-10-10
After back-to-back 'almost doubled speed' and '50% faster' announcements, a Reddit user shares benchmark screenshots: Astra UF ($300/M output tokens, the world's most expensive endpoint) still struggles above 100tps, with zero improvement on fast and standard endpoints.
Sol 6.1 at $60/M output, which at its previously claimed 750tps should beat Opus 5.5 fast ($40/M), also fails to do so, and its fast/standard endpoints show no improvement either. The post directly challenges vendors' speed marketing against measured reality.
More from Infra
- Cadence announces sovereign AI cloud for European chip designers — karlfreund · 2026-10-23
- SGLang Deep-Dive Blog Series Breaks Down KV Cache, Posts up to 15.5x Throughput Gains — BanghuaZ · 2026-10-23
- DynaLM: Open-Source CPU-First LLM Inference Engine Seeks Feedback — Unlikely_Safety_7456 · 2026-10-23
- Capital Is Now the AI Buildout Bottleneck, Says Analyst Citing Jensen Huang — JOBhakdi · 2026-10-23
- Cerebras explains how it deploys trillion-parameter models on wafer-scale chips — bookwormengr · 2026-10-23
- IFM open-sources RL360, the agentic RL infra behind K2 Horizon's training — rupspace · 2026-10-23