Qwen 30B MoE on RTX 3050 6GB: 30+ tps with 90k context
Bakkario · reddit · 2026-08-14
Reddit user Bakkario shares experience running Qwen 30B MoE on an RTX 3050 6GB GPU. Previously getting under 10 tps with 22GB DDR4, they achieved 20-25 tps with 90k context after switching inference harness, and even 30-35 tps. Author plans to add details and encourages others with low-end rigs to share optimizations.
More from Infra
- Three CoreWeave co-founders have sold $3.3B in shares since IPO amid credit worries — SumitGup · 2026-10-16
- Cherry pi on a Raspberry Pi: the tiny-model rumor developers are watching — sull · 2026-10-16
- CoreWeave's debt costs falling: DDTL spreads tightened from S+9.62% to S+2.25% — BenBajarin · 2026-10-16
- SoftBank lines up US IPOs for SB Energy and AI robotics spinoff Roze, valuations top $50B — nordicinst · 2026-10-16
- TRL reproduces Modal's mixed-precision async RL: plain GRPO collapses, SC+MIS holds 0.72 — QGallouedec · 2026-10-16
- Hugging Face scales Indic pretraining with 2.8T tokens and an open data pipeline — Hugging Face Blog · 2026-10-16