MLPerf v6.1 debuts agentic benchmark and first 1T+ parameter model run
TheZachMueller · x · 2026-09-16
Lambda's MLPerf Inference v6.1 results mark two firsts: the first agentic inference workload on datacenter hardware and the first deployment of a 1T+ parameter model (Kimi K2.6 on HGX B200, replacing the 27B reference). On 4× Blackwell Ultra, Lambda posted the leading Offline throughput for GPT-OSS 120B (65,511 tokens/s) plus an 8.85% throughput gain over v6.0 on identical hardware from pure software optimization.
Related event: MLPerf Inference v6.1 Adds First Agentic AI Benchmarks(2 posts)→
More from Infra
- Big Tech's Future Data Center Leases Top $1.3T, 70% Added in Last Four Quarters — rohanpaul_ai · 2026-11-02
- Daniel Lemire: AI is exploding demand for boring compute, server CPUs to double — lemire · 2026-11-02
- Physical AI's real story: a 4-layer map of 15 companies behind humanoid robots — pdamodaran · 2026-11-02
- Under 5% of US consumers pay for AI, yet compute demand is already forcing usage cuts — NinaDSchick · 2026-11-02
- Sam Altman: AI query energy cost fell 1,000x-100,000x in 3-4 years — rohanpaul_ai · 2026-11-02
- Marvell and Lumentum to merge, targeting $550B AI connectivity market — BenBajarin · 2026-11-02