What $70-100K of hardware buys for local GLM5.3 and DeepSeek with 10-20 concurrent users
whoami-233 · reddit · 2026-10-24
A Redditor asks for hardware recommendations with a $70-100K budget to run GLM5.3 and DeepSeek flash 1017 locally for 10-20 concurrent users doing agentic tasks with 500K-token contexts, preferably in an extensible setup as model sizes keep growing.
More from Infra
- Lightspeed's Amber Yang Calls for Startups to Build the "Standard Oil of Compute" — theamberyang · 2026-10-24
- LTX 2.5 distilled 22B Q4 runs locally on an 8GB M1 MacBook Air — 36s of video per ~32min render — iJohnnyRobert · 2026-10-24
- Directionally Local launches private coding-agent infra that runs on edge hardware you own — sahilypatel · 2026-10-24
- Musk says no H100s to rent; experts urge banning Chinese firms from renting US AI chips — chrisrohlf · 2026-10-24
- Amazon scraps Northern Virginia data center plans after local opposition, donates land — Polymarket · 2026-10-24
- Stripe reportedly buying OpenRouter for ~$7.5B as AI usage billing becomes the prize — FinanceYF5 · 2026-10-24