A DIY micro-cluster: M5 Max 128GB plus Linux box with RTX 6000 for local AI
pcuenq · x · 2026-10-07
The author shows his DIY micro-cluster for local AI: an M1 Max (64GB, unused), an M5 Max (128GB), and a Linux box with an RTX 6000 Blackwell, with Macs linked via Thunderbolt and the M5-Linux pair on 10 GbE for distributed inference.
More from Infra
- Ollama v0.40.0 auto-runs supported models on Apple's MLX runtime — lmoroney · 2026-10-07
- Running Qwen-Image-2.1 on a 48GB Mac: staged loading cuts peak memory from 43.6GB to 19GB — nefayran · 2026-10-07
- Sweden's housing boom collides with roaring datacenter appetite in the AI age — nordicinst · 2026-10-07
- Nvidia pegs NVLink Fusion opportunity near $250B by decade's end as AWS, Intel adopt the tech — Beth_Kindig · 2026-10-07
- OpenAI's New $500 Tier Sends CTOs Scrambling to Contain Token Costs — labeveryday · 2026-10-07
- B70 Launcher 0.4.8 Brings vLLM XPU Support to Intel Arc Pro B70 Local LLM Serving — vllm_project · 2026-10-07