antirez runs DeepSeek v4.1 Flash locally on a 128GB M5 Max, SSD streaming surprisingly fast
antirez · x · 2026-09-11
antirez demonstrated DeepSeek v4.1 Flash running locally via DwarfStar on a 128GB M5 Max, with SSD-based expert streaming delivering surprisingly fast inference. He credits recent SSD streaming changes that retain the right experts, and possibly DS4.1 reusing the same experts more. He plans to open QA online when ready.
More from Infra
- AI chip startup Tenstorrent raises $1.5B at $6.2B valuation, more than doubling — Beth_Kindig · 2026-10-27
- Anthropic discloses up to $120.5B SpaceX compute deal, ~$3.1B monthly at full capacity — XFreeze · 2026-10-27
- Satire: swapping Raft for an LLM-style decision model tanks write throughput 99.98% — irombie · 2026-10-27
- Cadence joins the domain-specific AI model camp for chip design — karlfreund · 2026-10-27
- Qdrant builds Universal I/O to run vector search mmap code on object storage — qdrant_engine · 2026-10-27
- Nebius secures $3.5B Citi financing facility for GPU purchases and AI data centers — Beth_Kindig · 2026-10-26