Qwen 3.8 Flash Next runs at 65 t/s on M3 Ultra, Q2 weights released on Hugging Face
ivanfioravanti · x · 2026-09-07
Developer ivanfioravanti shows Qwen 3.8 Flash Next running locally on Apple Silicon via DwarfStar, hitting 65 tokens/s on an M3 Ultra in a video demo.
He uploaded Q2 quantized weights to Hugging Face (ivanfioravanti/Qwen3.8-Flash-Next-DS4-IQ2) and opened a PR branch, looking for volunteers with 64GB Apple Silicon machines to test. The model's chat template exposes reasoning effort levels of xhigh (default), medium, and low.
More from Infra
- Nearly half of Claude revenue now flows through cloud marketplace commitments, up from 11% — BenBajarin · 2026-10-26
- Anthropic ARR goes vertical after price cuts: tokens up 4x, $100B+ ARR back in play — GavinSBaker · 2026-10-26
- Alex Banks argues power caps GPU supply, real risk is demand cooling first — thealexbanks · 2026-10-26
- Analyst: Ant has the most fungible AI workload of any model provider today — BenBajarin · 2026-10-26
- Anthropic S-1: training infra edge cut per-task cost 40% and doubled revenue growth — BenBajarin · 2026-10-26
- Rewriting scaling law study: optimal synthetic data share rises from 10% to 32% with compute — heghbalz · 2026-10-26