Enthusiasts Discuss Running Massive Qwen3.8-2.4T Models Locally
segmond · reddit · 2026-08-13
As open-source model parameter sizes hit new highs, Reddit users are discussing the feasibility of running massive models like Qwen3.8-2.4T locally. The poster notes that despite the enormous size of these new models, hardcore enthusiasts are still looking to push hardware limits to find ways to deploy them on local machines.
More from Infra
- Nebius AI Infra Economics: Contract Value Exceeds $20M per MW — kevinsxu · 2026-08-13
- AMD Earnings Analysis & Future of Memory Summit Trends — BenBajarin · 2026-08-13
- Dev Complains About Broken GPU Rentals: Finding Instances Already in Use — abacaj · 2026-08-13
- Glean Claims Its Agent Costs 4x Less Per Task Than Claude Cowork — Scobleizer · 2026-08-13
- Running DeepSeek V4 Flash Locally on 2x DGX Sparks Delivers Prosumer-Grade Performance — andrewchen · 2026-08-13
- Is Local Generative AI Worth It Anymore? Developers Struggle Against Closed Cloud Models — ImaginaryEffective63 · 2026-08-13