What would you do with an A30, an A40, and a new 48GB Pro5000?
OvertaxedOne · reddit · 2026-09-16
A developer about to buy a 48GB Pro5000 is figuring out how to combine it with an existing A30 (running a 9B model) and A40 (running 27B) that the company won't let him sell. Use case: Hermes + OpenWebUI corporate chat assistant, concurrency ≤2, happy with Gemma 27B 8-bit quality. Options under consideration: keep A40 as failover, or pool 96GB across cards.
More from Infra
- MLPerf v6.1 debuts agentic benchmark and first 1T+ parameter model run — TheZachMueller · 2026-09-16
- Third study finds no significant pollution increase around xAI's Colossus 1 data center — chrisgrayson · 2026-09-16
- Anthropic inks first Australian data center deal: 2.16 GW campus near Brisbane, online 2027 — mark_k · 2026-09-16
- vLLM self-hosting guide: quantize an 8B model to quarter size with 98-100% accuracy — vllm_project · 2026-09-16
- Earendil launches Radius, an inference layer bringing tokens, routing and search to Pi — HankYeomans · 2026-09-16
- Multi-turn agent RL training at scale on HF Hub: 9,523 sandboxes in 14h, zero crashes — vanstriendaniel · 2026-09-16