Mac mini tested as an Agent server: smooth local 27B models, 70B unusable
APPSO · wechat · 2026-09-21
APPSO ran an in-depth hands-on with the new Mac mini as an "AI PC," concluding it works best as an always-on agent server rather than a heavy local-model workstation.
- Local model benchmarks: a 4-bit 27B Qwen model summarizes long docs at 32 token/s; 70B Llama 3.1 is effectively unusable (a single reply took 3 minutes). On a 48GB M5 Pro, the sweet spot is 20-30B models. GGUF is cross-platform; MLX is built for Apple Silicon's unified memory — which is faster depends on the model and runtime.
- Agent workflows: LM Studio Bionic detects device memory and flags "Full GPU Offload Possible" vs "Likely too large," and can read files, run commands, and execute multi-step tasks. In tests, an agent drove Blender via its Python API to build and render a 3D model, then made a landing page. Video generation is heavy: a 15s clip took nearly 90 minutes.
- New usage pattern: the author used the Mac mini as a Codex agent server, with four agents simultaneously writing an Xcode app, compiling Chromium, processing 100GB of media, and rendering in Blender — while the human kept using the machine. The classic "multitasking" PC is turning into a "multi-agent" machine, and a small always-on box is arguably the earliest PC form factor to fit that shift.
More from coding & agent
- Google's RRSI regularizes recursive self-improvement of agent harnesses, +4.7 OOD points — google · 2026-09-22
- 53 harness bugs: an engineering team's field notes on building eval harnesses — DrDatta_AIIMS · 2026-09-22
- atuin 18.23 ships infinite searchable scrollback — shell history now keeps command output — aronchick · 2026-09-22
- Kev: open-source 0.8B/4B/9B judge models on Qwen3.5, the 9B fits a 32GB Mac — khiladi1729 · 2026-09-22
- Open-source coding-agent skills for Google ADK on Google Cloud, distilled from real engineering lessons — Difficult_Design6676 · 2026-09-22
- After trimming his Claude Code harness, a Max 20x user now has 9 spare hours of quota a week — carlito_17 · 2026-09-22