Crowdsourced Effort Speeds Up Qwen 3.8 on Mac by 235%
julianharris · x · 2026-08-22
A crowdsourced challenge improved the median decode speed of Qwen 3.8 27B on Mac from 26 tok/s to 87.9 tok/s in just one week, achieving a 235% speedup. 31 solvers contributed 67 improvements, primarily using custom MTP heads for speculative decoding that draft and accept 3.9 tokens per round while matching serial output exactly.
More from Infra
- Fluidstack hires Electrical Engineer for Modular R&D to build frontier AI infrastructure — MxMnr · 2026-10-16
- Jensen Huang joins BG2 podcast: does AI revenue justify capex, '27 bottlenecks — elonmusk · 2026-10-16
- Mistral's on-device infra rack revealed: DGX Spark, Mac Studio and more — gregmushen · 2026-10-16
- NVIDIA and Sweden's Wallenberg launch Sferical One, a shared AI supercomputer — nvidia · 2026-10-16
- Next infra frontier: self-evolving systems that adapt and self-verify — _shreya_s · 2026-10-16
- Xiaomi's MiMo RL dashboard reveals $3.47M spent on just 30 training steps — bycloud · 2026-10-16