Nex-N2.5-mini-MLX-4bit hits 133.6 tok/s on Apple M5 Max
DerTomsn · reddit · 2026-09-13
Benchmarks of the newly released Nex N2.5 Mini (MLX 4bit quant) on Apple M5 Max show 133.6 tok/s generation with recommended settings (temp 0.7, topp 0.95, topk 40, reasoningeffort high), plus fast prompt processing, reasonable memory footprint, and solid quality. Full results are on llm-bench.io, quant on Hugging Face. Author plans to use it for agents and coding.
More from Infra
- effect-harness on Cloudflare: run agent loops, tools and credentials on separate VMs — samgoodwin89 · 2026-10-31
- Google's Project Suncatcher boots TPU in orbit and beams back first AI response — sundarpichai · 2026-10-31
- Together AI launches Post-Training platform for agentic RL with tool-use environments — togethercompute · 2026-10-31
- General Compute raises $100M for inference capacity as CoreWeave stock hits 12-month low — YvesMulkers · 2026-10-31
- Analyst warns of unstable AI compute feedback loop as Kioxia's NAND price warning triggers flash crash — bookwormengr · 2026-10-31
- SOMA launches enterprise prompt-compression layer claiming 20%+ inference savings — markjeffrey · 2026-10-31