DeepSeek Flash on Mac Studio M5 Ultra (512GB): 54 t/s generation with 128K context

vhthc · reddit · 2026-11-17

A Reddit user reports real-world local inference numbers on a Mac Studio M5 Ultra with 512GB RAM: running DeepSeek-V4.1-Flash-1017-oQ4e-mtp via omlx, he gets up to 1,100 t/s prompt processing and 54 t/s generation at a 128K context window, with engrams offloaded to SSD to keep RAM free. Observations: context beyond 128K degrades both speeds, and concurrent requests split the max generation rate (single streams crawl). He's sharing baseline expectations and asking whether this is the ceiling without changing the model.

Original post →

More from Infra

Infra channel →