Enthusiasts Discuss Running Massive Qwen3.8-2.4T Models Locally
segmond · reddit · 2026-08-13
As open-source model parameter sizes hit new highs, Reddit users are discussing the feasibility of running massive models like Qwen3.8-2.4T locally. The poster notes that despite the enormous size of these new models, hardcore enthusiasts are still looking to push hardware limits to find ways to deploy them on local machines.
More from Infra
- New hardware day: local LLM deployment the moment it arrives — lxfater · 2026-10-16
- Together AI's score centering fixes RL training collapse under quantized inference — nrehiew_ · 2026-10-16
- Inference is splitting prefill and decode across specialized chips, not just H100s — AccBalanced · 2026-10-16
- Rebasely launches in beta: Git hosting built for humans and coding agents — handotdev · 2026-10-16
- Drama3 TTS lands in audio.cpp: up to 5x real-time on RTX 5090, <8GB VRAM mode too — Acceptable-Cycle4645 · 2026-10-16
- Three CoreWeave co-founders have sold $3.3B in shares since IPO amid credit worries — SumitGup · 2026-10-16