TEAS benchmark: 5 models on 9 accelerators across 6 realistic agentic workloads
PontiEdoardo · x · 2026-09-01
ARIA Research's Scaling Compute programme released TEAS 🍵, a benchmark serving 5 models (4B to 1T total params) on 9 accelerators across 6 workloads, arguing next-gen accelerators must be benchmarked on realistic agentic workloads. TEAS profiles workloads by bottleneck (prefill, decode, tool use) and user choices (stack, batch regime, budget), highlighting each accelerator and stack's strengths per scenario instead of a one-dimensional ranking.
More from Infra
- AI data centers need $3.5T yearly revenue to stay solvent, research estimates — TheseFact · 2026-10-18
- SGLang Summit sponsors grow from 11 to 36 in one week; Lip-Bu Tan, Lilian Weng to speak — BanghuaZ · 2026-10-18
- Yacine jokes his datacenter KPI is gigawatt-hours: get paged if not burning enough power — yacineMTB · 2026-10-18
- 1.68x inference speedup drops, directly accelerating GRPO post-training — yacineMTB · 2026-10-18
- OpenRouter is only a fraction of the total addressable market, poster argues — sloppenheimer · 2026-10-18
- Developer builds change alerts for LLM prices and retirements across Bedrock, Azure and Vertex — jsandhu0780 · 2026-10-18