M3 Max achieves 70 tok/s locally with 20GB RAM free after 32k task
mayfer · x · 2026-08-28
A user reported benchmark data for running LLMs locally on an M3 Max (128GB). The inference speed hit 70 tok/s with a prefill speed of around 300 tok/s. Despite thermal throttling issues, the setup remained usable for agents, completing a 32k token task while still retaining 20GB of free memory.
Related event: M3 Max Runs 125B Qwen Model Locally at 70 tok/s(3 posts)→
More from coding & agent
- YC F26's Praxis launches AI agents to run law firm ops end to end — ycombinator · 2026-10-16
- Codex's year-long rise: 40M+ weekly users and its leader now runs all of OpenAI's core products — danshipper · 2026-10-16
- Developer builds inter-agent messaging for his AI agents — complete with message undo — baditaflorin · 2026-10-16
- How Codex Happened: inside OpenAI's comeback in coding — danshipper · 2026-10-16
- iOS 'dots' workflow: one Siri command turns screenshots into a background shopping and saving agent — nickbaumann_ · 2026-10-16
- Your widget tree is already a list of options: where Jev fits in Flutter — rseroter · 2026-10-16