Running Qwen 27B with 200K Context on a Single RTX 3090
Top_Outlandishness78 · reddit · 2026-07-05
A user purchased their first RTX 3090 and used the community-driven club-3090 configuration to run Qwen 27B with a 200K context window. Highly satisfied with the experience, they recommended this setup to the community.
More from Infra
- NVIDIA Plans ~$2,000 Per GPU Per Year Software Fee for Running AI Agents — LinusEkenstam · 2026-10-26
- 12 DevOps concepts to learn in order, from Linux to SRE — _jaydeepkarale · 2026-10-26
- Killed our Vector DB for SQLite BM25 and wrote a 3.6ns Rust sentinel: lessons from multi-agent loops — OpenComplaint524 · 2026-10-26
- Gemma 4 26B-A4B runs offline on a 16 GB Mac: 33/40 on TypeScript tasks at 31 tok/s — Mission-Sir-1614 · 2026-10-26
- How thousands of GPUs train one AI: a breakdown of 5D parallelism — jbhuang0604 · 2026-10-26
- Stratechery: endgame for the open web, and a coming AI startup credit crunch — tushaarmehtaa · 2026-10-26