Pruning Qwen3 MoE to 65GB Fits a 180B-Class Model on a 128GB Laptop
EyalToledano · x · 2026-08-27
- Early results pruning Qwen3.8-Flash-Next experts with REAP look very promising:
- REAP-384 (25% experts pruned): 80GB vs. 97GB stock, 89% accuracy retained;
- REAP-256 (50% pruned): 65GB vs. 97GB, 81% accuracy, and loads twice as fast.
- Interesting tidbit: REAP-256 became chattier and did more thinking than stock.
- Bottom line: a 128GB laptop can now load a 180B-class model at 65GB with 40GB+ headroom for long context — potentially daily-driver territory.
Related event: Developer Prunes 180B-class Qwen MoE to Fit in 48GB of Mac Memory(9 posts)→
More from Infra
- MiniCPM-V 4.7 runs a 35B MoE multimodal model on phones with just 3GB memory — nevrekaraishwa2 · 2026-10-15
- Nvidia Is Now Worth More Than the Entire Indian Stock Market — theteknosaur · 2026-10-15
- NVIDIA joins EU's AI in Science Enablers, offering compute, training and cloud resources — nordicinst · 2026-10-15
- Open source's hardware trap: data centers crowd out consumer GPUs, local LLMs become a privilege — Dante_77A · 2026-10-15
- NVIDIA backs EU AI in Science push as 35 supercomputers to serve 3M researchers — NVIDIA Blog · 2026-10-15
- Jensen Huang: 2027 AI bottleneck is 35GW of power, revenue justifies the capex — BG2 Pod · 2026-10-15