Running 397B Model on MacBook Pro at 4.4 tok/s with Pure C and Metal
tom_doerr · x · 2026-08-17
Developer runs Qwen3.5-397B-A17B on a 48GB MacBook Pro at 4.4+ tok/s using pure C and Metal shaders. The flash-moe project is open-sourced with technical details and 90+ experiments.
More from coding & agent
- Using LLMs to Auto-Fill Forms and Streamline Onboarding — threepointone · 2026-08-17
- Build a Listener Agent with Claude Code for Audience Insights and Competitor Analysis — EXM7777 · 2026-08-17
- How to Decide What to Use Grok Bot For: Core Agent Workflows Explained — alex_verem · 2026-08-17
- Built a Deepgram Flux voice testing studio in 30 minutes with Claude Code — CodeByPoonam · 2026-08-17
- Google's A2A Protocol Joins AAIF to Standardize Cross-Framework Agent Communication — iamKierraD · 2026-08-17
- Zapier report: Automation reduces AI costs by up to 90% in workflows — TawohAwa · 2026-08-17