M5 MacBook Pro vs Linux for on-device LLMs
walkingriver · x · 2026-08-22
The author is considering an M5 MacBook Pro with 48GB RAM. Despite the trend of developers like DHH moving to Linux for better devex, the author notes that Apple Silicon remains arguably the best platform for on-device LLMs, making it a key consideration in the platform choice.
Related event: Apple Silicon Still Considered Best for On-Device LLMs(2 posts)→
More from Infra
- H100 Shortage Driven by Power, Cooling, and Talent, Not Chip Fabrication — ingliguori · 2026-08-22
- Parsewave's work suggests a shift towards high-quality synthetic data in AI training — trashnash007 · 2026-08-22
- GLM 5.2 runs at 35t/s via DwarfStar mixed RAM/VRAM inference — antirez · 2026-08-22
- Data center pause may push AI jobs overseas amidst power bottleneck fears — Dan_Jeffries1 · 2026-08-22
- GLM-5.3 hits 21.4x speedup on RTX PRO 6000 via Kimi-Linear Decode kernel — teortaxesTex · 2026-08-22
- Why I'm traveling to India to build a dual-RTX 3090 rig for local LLMs — Ubunta · 2026-08-22