MacBook Pro M5 Max runs AMD Radeon AI PRO R9700 over Thunderbolt 5 for local LLMs
TheOriginalG2 · reddit · 2026-09-24
A developer got an AMD Radeon AI PRO R9700 running LLM inference on a MacBook Pro M5 Max (128GB) via Thunderbolt 5 in a Razer Core X V2 enclosure. They ported the amdgpu driver to macOS (open-sourced as mac-amdgpu) and built LSE (LemonSeed-Engine), supporting Qwen3.6-3.8 Dense/MoE with MTP. The engine offers HIPC and Loom/HRX backends — HRX being a new AMD system for running kernels on amdgpu, with Loom the only Mac-compatible path and HIPC best on Linux. Drivers and engine are on GitHub; iPad support is the next goal.
More from Infra
- Alibaba's Banma ships AutoOmni 2.0: 3B-active edge model nears 10x-larger cloud models — 机器之心 · 2026-09-24
- Huang and Musk: China reaches advanced lithography in 2-3 years; chip bans only buy time — beffjezos · 2026-09-24
- A real-time voice agent with zero US servers: Gladia STT, Gemma 4 on Scaleway, KugelAudio TTS — tobowers · 2026-09-24
- Running MiniCPM5-2B as a local agent on M4 16GB: trimming, tool-call adapter and benchmarks — 面壁智能 · 2026-09-24
- WSJ: The AI build-out is becoming the biggest economic bet in U.S. history — GeneReddit123 · 2026-09-24
- Context compaction, measured: FutureOS vs Codex vs OpenCode — Icy-Stay-1004 · 2026-09-24