Running Qwen 3.8 27B on M2 MacBook Pro 32GB: full tutorial and benchmarks
boutell · reddit · 2026-08-17
The author successfully runs Qwen 3.8 27B on an M2 MacBook Pro with 32GB RAM, sharing a step-by-step guide: build llama.cpp from source, download GGUF and vision adapter, close apps to free memory, and launch with specific flags. Benchmarks: 21.9 t/s prompt, 8.6 t/s generation. Includes aliases, API server setup, and integration with coding tools.
More from coding & agent
- 14 open-source LLM observability tools to know in 2026, from Langfuse to Laminar — TheTuringPost · 2026-10-16
- Reddit debate: What are autonomous AI agents actually doing in production today? — hangman_111111 · 2026-10-16
- Kernel-Level Agent Sandboxing With macOS Seatbelt, No Docker Needed — mostly_deterministic · 2026-10-16
- Moving agent work from GPUs to CPUs for durable, predictable actions — cramforce · 2026-10-16
- Jev tutorial: 106x cheaper, 180ms yes/no gates replace PASS/FAIL string matching — max_paperclips · 2026-10-16
- Stop giving agents raw API keys: prepaid balances and per-credential caps — Cold_Hall_5384 · 2026-10-16