MLPerf v6.1 debuts agentic benchmark and first 1T+ parameter model run
TheZachMueller · x · 2026-09-16
Lambda's MLPerf Inference v6.1 results mark two firsts: the first agentic inference workload on datacenter hardware and the first deployment of a 1T+ parameter model (Kimi K2.6 on HGX B200, replacing the 27B reference). On 4× Blackwell Ultra, Lambda posted the leading Offline throughput for GPT-OSS 120B (65,511 tokens/s) plus an 8.85% throughput gain over v6.0 on identical hardware from pure software optimization.
Related event: MLPerf Inference v6.1 Adds First Agentic AI Benchmarks(2 posts)→
More from Infra
- Sam Altman: AI query energy cost fell 1,000x-100,000x in 3-4 years — rohanpaul_ai · 2026-11-02
- Marvell and Lumentum to merge, targeting $550B AI connectivity market — BenBajarin · 2026-11-02
- Samsung chairman visits Yokohama advanced packaging lab, pledging ¥40B investment over five years — pstAsiatech · 2026-11-02
- Sam Altman meets Samsung executives in Korea to deepen memory chip and AI infrastructure cooperation — pstAsiatech · 2026-11-02
- Simulating 200,000 months: can your home AI rig pay rent at 2026 GPU prices? — LeviTurk · 2026-11-02
- Indian AI infra firm AM Intelligence seeks up to $3B to buy Nvidia's next-gen chips — pstAsiatech · 2026-11-02