Mac Mini for 24/7 Local LLMs: Prioritize RAM or a Faster Chip?
secsilm · reddit · 2026-10-13
A Redditor plans to buy a Mac mini to run local LLMs and agents 24/7, targeting Q4-quantized models up to 27B for everyday tasks. Choosing between M4 with 32GB RAM and M4 Pro with 24GB RAM: more memory fits larger models, while the Pro chip speeds inference. Which matters more?
More from Infra
- Sipeed teases MaixStation, claims it beats Nvidia DGX Spark — AIFlow_ML · 2026-10-13
- OpenAI reportedly used internal math model to improve itself, halving inference costs — VraserX · 2026-10-13
- Taiwan's Apollo Power orders 260 Tesla Megapacks (~1 GWh) for AI-era data centers — XFreeze · 2026-10-13
- QLoRA: fine-tuning a 65B model on a single GPU via 4-bit quantization — alex_verem · 2026-10-13
- 10 Papers to Run a Serious AI Model Locally on Your Own Computer Today — alex_verem · 2026-10-13
- Just how hard is it to get a GPU on spot right now? — Xianbao_QIAN · 2026-10-13