GPT Astra takes 38 minutes for 56k tokens: token efficiency is not compute efficiency
___Patrice___ · x · 2026-08-30
Observing that GPT Astra took 38 minutes to generate 56k tokens, the author notes that token efficiency does not equal compute efficiency. This suggests the model may be spending significantly more compute per token to produce fewer, higher-quality tokens. The trade-off raises questions about how this performance will be priced commercially.
More from Models
- User tests find Gemini's Argan 4 least token-efficient and slowest — krayton1 · 2026-10-16
- Gemini users flag Argon usage limits as quota consumption pain point — Silens___ · 2026-10-16
- User rants GPT-6.1 Sol is painfully slow and buggy, says Claude is 7x faster — karmay007 · 2026-10-16
- $20-plan users have no idea how far AI agents have come in 10 months — realmeetjames · 2026-10-16
- Tencent Hunyuan open-sources Hy Memory 2.0: model, SDK and MemHub for agent memory — TencentHunyuan · 2026-10-16
- Four Gemini 4 Argon agents beat Minecraft's Ender Dragon in 27 hours — _rockt · 2026-10-16