Qwen3.8 Flash hits 45 tok/s on M4 Max, matching Qwen3.8 27B speed on Apple Silicon
DerTomsn · reddit · 2026-09-06
- A Reddit user benchmarked Qwen3.8 Flash Next local inference via llm-bench.io: 45 tok/s on M4 Max and 25 tok/s on M2 Ultra.
- The author reports it delivers similar speed to Qwen3.8 27B on Apple Silicon, signaling better small-model usability on-device.
More from Infra
- Meta researcher: horrifying infra, not talent, is why OSS can't catch closed frontier — A_K_Nain · 2026-10-23
- Jane Street and NVIDIA speed up Mamba-2 with custom cuTile kernels — blelbach · 2026-10-23
- LatentLoop: asymmetric compute allocation cuts looped-MoE training cost by 19% — pmttyji · 2026-10-23
- Same AI request emits 8.5x more CO2 in Texas than in Sweden — jlundberg · 2026-10-23
- SK Hynix Pulls Plug on Solidigm US IPO as Chip Stocks Slide, Shares Down ~30% This Quarter — rohanpaul_ai · 2026-10-23
- Designer mocks Nvidia: buy idle GPUs or lose access to new ones—definitely not a bubble — michalmalewicz · 2026-10-23