Gemma 4 speed doubled on MLX, achieving 130.7% performance gain
TheMoonMidas · x · 2026-09-02
Gemma 4 optimization on the MLX framework has reached 560 tps decode and 7k tps prefill across 8 concurrent requests, representing a 130.7% performance gain over the baseline. These improvements are set to be integrated into @darkbloomai.
Related event: Gemma 4 26B Doubles Inference Speed on Mac(3 posts)→
More from Infra
- Auction-based LLM routing paper finds fixed token pricing wastes 10%-71% in costs — _onionesque · 2026-10-18
- SGLang Summit sponsors jump from 11 to 36 in one week — ying11231 · 2026-10-18
- Oracle CDS hits record 300bps, called first AI trade domino after Barclays sell downgrade — arthurcolle · 2026-10-18
- Agent Coding Workflow Would Cost ~$40k/Month on API Pricing, Dev Reveals — ChrisRackauckas · 2026-10-18
- PS5LM: llama.cpp port turns a jailbroken PS5 into a home LLM server (500+ GitHub stars) — wateriscoding · 2026-10-18
- DFB laser heterogeneously coupled to LNOI: 170 mW output, 45 mA threshold — jwt0625 · 2026-10-18