Crusoe runs 512 AMD MI355X GPUs at 5.75M tok/s in largest MLPerf inference entry
wkmyrhang · x · 2026-09-17
Crusoe's MLPerf Inference v6.1 submission served gpt-oss-120b and DeepSeek-R1 on 512 AMD Instinct MI355X GPUs — the largest MI355X entry in MLPerf history — hitting 5.75M tokens/s. Throughput scaled near-linearly from 8 to 512 GPUs at >90% of ideal over standard 400Gb Ethernet, with no InfiniBand/RoCE or cross-node RDMA needed, running as a plain Kubernetes job. Manifests are open-sourced for reproduction.
More from Infra
- Sam Altman: AI query energy cost fell 1,000x-100,000x in 3-4 years — rohanpaul_ai · 2026-11-02
- Marvell and Lumentum to merge, targeting $550B AI connectivity market — BenBajarin · 2026-11-02
- Samsung chairman visits Yokohama advanced packaging lab, pledging ¥40B investment over five years — pstAsiatech · 2026-11-02
- Sam Altman meets Samsung executives in Korea to deepen memory chip and AI infrastructure cooperation — pstAsiatech · 2026-11-02
- Simulating 200,000 months: can your home AI rig pay rent at 2026 GPU prices? — LeviTurk · 2026-11-02
- Indian AI infra firm AM Intelligence seeks up to $3B to buy Nvidia's next-gen chips — pstAsiatech · 2026-11-02