Two $115 ex-mining APUs run Qwen 35B at 60 tok/s with 64K context for ~$300
Ok-Breadfruit-3523 · reddit · 2026-09-24
A Reddit user built a budget local LLM rig from two ex-mining BC-250 APUs ($115 each, 27GB combined GPU memory), linked via llama.cpp with Vulkan and RPC over 1Gb Ethernet on Bazzite. The setup runs Qwen3.6-35B-A3B at Q4KM, reaching 60 tok/s with 64K context — roughly $300 total including PSU. The author plans to expand to six boards to try running Qwen 3.8 Flash. A replicable reference for budget local deployment.
More from Infra
- Anthropic paid $5B for short-term compute in Q3 as spot prices run ~2x long-term deals — tengyanAI · 2026-11-11
- UK Sovereign AI invests in Fractile to build next-gen frontier AI chips — charlieharris01 · 2026-11-11
- What happened when I moved vector retrieval into Snowflake SQL instead of orchestrating RAG outside — dima806_dima · 2026-11-11
- AI chip startup Fractile raises $720M Series C for DRAM-on-processor design — Tom_Westgarth15 · 2026-11-11
- Mobile AI Factory: agentic pipeline builds on-device SLMs that beat 5-shot frontier models — kalyan_kpl · 2026-11-11
- Vivo's Starlink direct-to-cell service hits 10M users in two weeks across Brazil — XFreeze · 2026-11-11