DeepSeek in a backpack: two Mac Studios hit 220 tok/s fully offline
Stefania_druga · x · 2026-11-13
A developer demoed a fully offline, battery-powered portable inference rig: an e-bike battery plus two 256GB M5 Ultra Mac Studios linked via RDMA over Thunderbolt 5 using exo labs, running DeepSeek at 220 tok/sec. He highlighted Apple Silicon's memory density and power efficiency; the demo was billed as the best at the sglang conference.
Related event: Wearable Mac-based compute backpacks steal the show at SGLang conference(2 posts)→
More from Infra
- Dukoi Turns Your Old Android Phone Into a Free App Server in 2 Minutes — Scobleizer · 2026-11-13
- DeepSeek Has ~20,000 H-Class GPUs and Wants More: 'Cash Into Nvidia Cards Beats Bank' — teortaxesTex · 2026-11-13
- Over 1,600 comments on internal Nvidia post urging board to bring back Jensen Huang — rohanpaul_ai · 2026-11-13
- Texas A&M Builds One of the Strongest US Academic Supercomputers, Hiring 10 — yuz9yuz · 2026-11-13
- Tencent Reportedly DeepSeek's Biggest Backer as China Compute Centralizes — teortaxesTex · 2026-11-13
- Data Architecture 101: one infographic covering terms, models and patterns — nevrekaraishwa2 · 2026-11-13