Can a ternarized DeepSeek run on a single RTX 3090? Open problem: agent accuracy
casper_hansen_ · x · 2026-10-17
Casper Hansen proposes running DeepSeek v4.1 Flash 1017 on a single RTX 3090 + 64GB RAM via ternarization. The open problem: keeping enough agent accuracy to avoid noticeable degradation. He notes a DGX Spark could also work but is far more expensive, and says he's actively researching the ternarization approach.
More from Infra
- Durable PTY: Open-Source Tool Keeps AI Coding Agents Alive Across Crashes and Reboots — jasonkneen · 2026-10-17
- AMD Radeon AI Pro R9700 prices jump €1000 after RTX 5090 discontinuation — BreadUndPeeTears · 2026-10-17
- LeRobot streams 10.7TB robot dataset during training with just 0.52% idle time — RemiCadene · 2026-10-17
- Millions of cloud-resident AI agents could trigger a compute demand surge — Thionne_WTZ · 2026-10-17
- Gartner's Neocloud Call Confuses Financial Exposure With Architectural Reality — DavidLinthicum · 2026-10-17
- FLUX 3 Klein INT8 tested on RTX 3090/5090: 2x speedup, better accuracy than FP8 — CeFurkan · 2026-10-17