Buy 4 Mac Studios and run a 1T-param FP4 model locally to beat API pricing
DimitrisPapail · x · 2026-09-30
ML researcher Dimitris Papailiopoulos responds to the debate over "salary-level" agent subscription/API costs with an alternative: buy 4 Mac Studios with 512GB RAM each ($40k total, an O(1) amortized cost) and run the best FP4-quantized 1-trillion-parameter model locally. For power users, he argues this is serious long-run competition to API subscriptions. The original thread adds that >250B-parameter models become viable if priced at salary level, though how that translates to market cap remains unclear.
Related event: Professor: 4 Mac Studios running a 1T model beats burning salary on tokens(3 posts)→
More from Infra
- India's Sarvam launches Token Factory, hosting top open models on local infra — HarveenChadha · 2026-11-16
- Gemini 3.5 Flash now runs on air-gapped Google Distributed Cloud, offline up to 12 months — shashib · 2026-11-16
- Gemma.c: full Gemma 1/2/3 multimodal inference in a single C file, ~72 tok/s on CPU at INT8 — This-Purchase-3325 · 2026-11-16
- BIS Issues Interim Final Rule Addressing Remote Access to Advanced AI Chips — apples_jimmy · 2026-11-16
- Jailbroken PS4 runs a 9B open-source model at up to 43 tok/s by talking directly to its 2013-era GPU — AIFlow_ML · 2026-11-16
- Mobile AI Factory: agents auto-build on-device SLMs with 19x less GPU time — pmttyji · 2026-11-16