Skipping a second RTX 5090 for two more Sparks: local inference user explains why
ideamaker321 · reddit · 2026-09-15
A local deployment enthusiast planned to buy a second RTX 5090 but opted for two more Spark units instead. The 5090 is fast for training small models, but running Qwen3.8 27B inference means constant optimizations and compaction issues—never a 'set and forget' experience. His existing two Sparks running Qwen Flash Next just work, and with two more he'll be able to run the larger DSF v4.1. He's asking others about their 5090 inference experiences.
More from Infra
- To dethrone Postgres, new databases must prioritize ecosystem integrations from day one — mgill25 · 2026-11-02
- ESP32-powered 4-inch touchscreen builds a TUI dashboard for monitoring a DGX inference cluster — CATLLM · 2026-11-02
- OpenRouter crosses 10 quadrillion annualized token run rate, doubling every 10.5 weeks — deedydas · 2026-11-02
- Palmer Luckey asks: can you use datacenter RAM for things prohibited by the operator's terms of service? — avaitopiper · 2026-11-02
- Disable MTP for 20-30% faster local LLM inference on limited RAM — InternalMode8159 · 2026-11-02
- Kioxia up 216% in a year but down 68% from its June 2026 peak — zephyr_z9 · 2026-11-02