Qwen3.8-Flash-Next Benchmarked Locally: First Model to Break 94% on 128GB Mac
tolitius · reddit · 2026-08-27
A developer tested Qwen3.8-Flash-Next on an M4 Max 128GB Mac Studio with oMLX and llama.cpp — the first model this year to break 94% on their custom cupel benchmark.
- The qwen4exp architecture isn't supported yet, so oMLX K/V caching had to be disabled; the full 4-bit quant takes 100GB, a tight fit
- On a mixed coding/general-knowledge/science benchmark, Qwen 3.8 27B led in coding but lost on general knowledge to Gemma 31B and Qwen 3.6
- Best quant: pipenetwork's MLX mixed-4/8bit build (perplexity 4.5286 vs 4.4708 bfloat16); Unsloth's GGUF UD-IQ4XS is weaker but smaller
The author plans to add more coding toolchains (pi/opencode) as models get too good to differentiate.
More from Models
- Google says teams across the company are using Gemini 4 Argon on its hardest engineering problems — CurieuxExplorer · 2026-10-15
- Perplexity's new embedding models: index with a 9B model, search with 0.6B — antoine_chaffin · 2026-10-15
- 797GB of n-gram counts in CPU RAM let 1B models match 57% more compute — PangWeiKoh · 2026-10-15
- Leak: Moonshot's Kimi flagship 'x4' done with pre-training, K3.1 in internal testing — lyraxana · 2026-10-15
- Unsloth ships GGUF quants for Nemotron 3.5: Bolt-74B runs in 24GB RAM — danielhanchen · 2026-10-15
- NVIDIA ships two open Nemotron 3.5 Bolt models: a 74B-A9B MoE and a mobile-friendly E4B — HankYeomans · 2026-10-15