llama-modchip runs 284B DeepSeek on 64GB RAM with no GPU
joshcsimmons · hn · 2026-11-08
The GitHub project llama-modchip by synchopate hit Hacker News, claiming to run the 284B-parameter DeepSeek model on a machine with just 64GB of RAM and no GPU. It targets drastically lowering the hardware bar for local LLM inference, sparking discussion on quantization and memory-bandwidth feasibility for GPU-less setups.
More from Infra
- Batch APIs: the 50% LLM discount only pays off after model choice and prompt caching — arpit_bhayani · 2026-11-13
- RTX Pro 6000 bricks mid-Qwen run, owner jokes it "died of a broken heart" over Jensen news — wine_dark · 2026-11-13
- Bittensor's Chutes Handles 256 Concurrent Requests on a Single RTX 5090 at ~18k tok/s — markjeffrey · 2026-11-13
- Google expands TPU v8 lineup: 8tx cuts latency 2x, 8i Max doubles silicon per rack — Beth_Kindig · 2026-11-13
- Horace He to share two mental models for reasoning about inference at SGLang Summit — cHHillee · 2026-11-13
- Used A100 prices fall another 20-30% as sellers rush ahead of a collapse — Bascilian · 2026-11-13