Local LLM Hardware Dilemma: M1 Max 64GB vs M3 Max 128GB vs 24GB GPU Build
Guilty-Support-584 · reddit · 2026-09-16
A Reddit user running Qwen3.6 35B A3B locally on an M2 Max 32GB hits severe bottlenecks—4-10 tks via SSD streaming and 20-60 minutes prompt processing for 40-60k tokens. They weigh a €1500 used M1 Max 64GB, €3500 M3 Max 128GB, or a DIY 24GB GPU + 128GB RAM build.
More from Infra
- Palmer Luckey asks: can you use datacenter RAM for things prohibited by the operator's terms of service? — avaitopiper · 2026-11-02
- Disable MTP for 20-30% faster local LLM inference on limited RAM — InternalMode8159 · 2026-11-02
- Kioxia up 216% in a year but down 68% from its June 2026 peak — zephyr_z9 · 2026-11-02
- Intel plunges 29%, worst day since the 1970s, wiping $12B off US government stake — emmanuelvivier · 2026-11-02
- Researcher hoards nearly 1TB of DRAM, refuses to sell a stick to data centers — kevinnbass · 2026-11-02
- Self-Hosting LLMs at a Law Firm: Infra and Data Governance Harder Than the Model — EducationalGroup7245 · 2026-11-02