mlx-dspark Update Boosts Apple Silicon Inference Speed
GlennCameronjr · x · 2026-07-18
The mlx-dspark update significantly accelerates model inference on Apple Silicon. Gemma-4 12B now runs 2.1x faster (up from 1.8x) with zero loss in output quality, thanks to new kernels in mlx 0.32.
Additionally, v0.4 introduces the first effectively working speculative decoding on Mac for the ternary model Bonsai-27B, achieving a 93% acceptance rate on coding tasks.
More from Infra
- Two CVSS 9.9 Wasmtime flaws allow sandbox escape, one ARM64-only since 2020 — basedjensen · 2026-10-27
- AI Infra Meme: While Countries Need TW-Scale Power for Datacenters, People Argue About Lightbulbs — mgostIH · 2026-10-27
- Legora runs 2,000 parallel agent evals on Modal Sandboxes for legal AI — blelbach · 2026-10-27
- Cloud release velocity scores: AWS 95, Azure 90, Google Cloud 82 — DavidLinthicum · 2026-10-27
- Selling a 5090 to scale local inference: one business weighs 5 hardware paths — Anarchaotic · 2026-10-27
- AWS tutorial: fleet-wide edge CV model lifecycle with SageMaker SDK v3, ~$0.07 per run — AWS ML Blog · 2026-10-27