DeepSeek 4.1 Flash runs mostly off SSD: antirez demos fast inference on a 128GB M5 Max
PMinervini · x · 2026-09-11
antirez showed his DwarfStar project running DeepSeek v4.1 Flash on a 128GB M5 Max, far faster than he expected with SSD streaming. He credits recent SSD-streaming changes that retain the right experts, and possibly higher expert reuse in DS4.1 itself. Others note the model can run mostly from the SSD. Release will come after QA rather than ASAP.
More from Infra
- Anthropic's noncancelable compute commitments hit $430B, per S-1 filing — Hesamation · 2026-10-27
- AI chip startup Tenstorrent raises $1.5B at $6.2B valuation, more than doubling — Beth_Kindig · 2026-10-27
- Anthropic discloses up to $120.5B SpaceX compute deal, ~$3.1B monthly at full capacity — XFreeze · 2026-10-27
- Satire: swapping Raft for an LLM-style decision model tanks write throughput 99.98% — irombie · 2026-10-27
- Cadence joins the domain-specific AI model camp for chip design — karlfreund · 2026-10-27
- Qdrant builds Universal I/O to run vector search mmap code on object storage — qdrant_engine · 2026-10-27