M5 Ultra rumored with 1.2TB/s bandwidth, beating API speeds for local LLMs
StefanoGogioso · x · 2026-08-26
Rumors suggest the 512GB M5 Ultra, shipping in October, will feature 1.2TB/s memory bandwidth, a 50% increase over M3 Ultra. By stacking 4x M5 Ultra units, users may run models like Kimi K3 and GLM 5.3 locally at speeds exceeding 100 tok/sec, outperforming API calls. Based on extrapolations from M3 Max, the M5 Ultra is expected to deliver 110 TFLOPS (dense fp16).
More from Infra
- ASM's pizza-themed ALD explainer at SEMICON West is the best yet — BenBajarin · 2026-10-16
- Google's Willow chip cuts quantum errors 40x, raising Q-Day concerns for Bitcoin — jamestagg · 2026-10-16
- Vibe Coding a Data Pipeline Is Easy; Running It at Billions of Rows Is Not — Zachly · 2026-10-16
- Large data centers employ only ~50-150 permanent on-site staff, Microsoft says — brezina · 2026-10-16
- Prediction: Opus 5.5-level models on laptops by 2027, backed by Qwen 27B data — cephaloform · 2026-10-16
- Oracle down 12% in a week, nearly 50% off June high as OpenAI exposure spooks market — alvelda · 2026-10-16