Mac Studio M5 Ultra beats dual DGX Sparks in local LLM decode speeds
SumitGup · x · 2026-10-19
A lab benchmarked 3 local LLMs on a Mac Studio M5 Ultra (oMLX) vs dual DGX Sparks (vLLM TP2): Qwen3.8 Flash Next hit 164.8 vs 116.0 tok/s, DeepSeek V4 Flash 74.4 vs 68.0, GLM-5.3 Flash 73.1 vs 28.4. Different runtimes/quantization, no quality test. Model names unverified.
More from Infra
- Paying your own API bills reveals local AI's value — auto-generating setup docs — draginol · 2026-10-19
- IBM exec: US AI leadership hinges on permitted power and domestic robotics scale vs China — ingliguori · 2026-10-19
- Matthew Green: What if all frontier AI models go down in a major incident? — matthew_d_green · 2026-10-19
- HotKV semantic cache cuts Claude tokens 70%, but answer quality dips until threshold 0.88 — HotKV-Ltd · 2026-10-19
- Critics question Anthropic compute shortage amid virtual 'scientists' claims — gerardsans · 2026-10-19
- David Sacks: payback period is the North Star metric for AI infra — CoreWeave recaps in 2.5 years on 5-year deals — DavidSacks · 2026-10-19