Qwen on M2 Ultra: latest oMLX update brings substantial local inference speedup
Thrumpwart · reddit · 2026-09-13
A Reddit user shares an update on running Qwen 3.8 Flash locally on an M2 Ultra: the latest oMLX release introduces a substantial speedup, with a benchmark screenshot attached. A notable signal for Mac-based local inference performance.
More from Infra
- TSMC reportedly raising CoWoS packaging prices up to 20% next year on AI chip demand — Beth_Kindig · 2026-10-31
- effect-harness on Cloudflare: run agent loops, tools and credentials on separate VMs — samgoodwin89 · 2026-10-31
- Google's Project Suncatcher boots TPU in orbit and beams back first AI response — sundarpichai · 2026-10-31
- Together AI launches Post-Training platform for agentic RL with tool-use environments — togethercompute · 2026-10-31
- General Compute raises $100M for inference capacity as CoreWeave stock hits 12-month low — YvesMulkers · 2026-10-31
- Analyst warns of unstable AI compute feedback loop as Kioxia's NAND price warning triggers flash crash — bookwormengr · 2026-10-31