Qwen 3.8 Flash Next hits 3.1k tok/s prefill on M5 Ultra
GabGarrett · x · 2026-09-22
mweinbach had astra optimize Qwen 3.8 Flash Next on an M5 Ultra, now reaching 3.1k tok/s prefill. GabGarrett notes that while Spark fans rushed to dunk on the Ultra, the machine may turn out to be a beast — a promising sign for Apple silicon unified memory in local LLM inference.
More from Infra
- KubeCon keynote: computing is shifting from human speed to agent speed — HowDevelop · 2026-11-12
- Leaked memo: Meta infrastructure head Santosh Janardhan to leave in early 2027 — dinabass · 2026-11-12
- Omarchy 4.6 lets you share local AI models across your tailnet, says DHH — alexcovo_eth · 2026-11-12
- Eric Schmidt's foundation funds French NGO fighting against data centers — StephanSturges · 2026-11-12
- Epoch: Open-Weight GLM 5.3 Hacks Six Firefox Versions for ~$1,000 Each; Claude Fable 5.2 Sets ECI Record — Epoch AI · 2026-11-12
- Polymarket prices 28% odds of a state data center moratorium; Torus raises $500M — Polymarket · 2026-11-12