Muse Glimmer 30B Local Test: 22 t/s on M5 Pro with 24GB RAM
curiousily_ · reddit · 2026-08-12
A developer tested Meta's new Muse Glimmer 30B model connected to the Hermes Agent for local and private AI coding tasks.
- Hardware & Performance: Achieved about 22 tokens/s on an M5 Pro device, utilizing around 24GB of memory including the drafter provided by Meta.
- Tool Calling: The model successfully executed correct tool calls and did useful work inside the Hermes Agent.
- Results: The resulting coding project actually worked, which was not the case when running the model with OpenCode.
Related event: Meta's Open-Source Muse Glimmer 30B Impresses in On-Device Agent Tests(14 posts)→
More from coding & agent
- Constraints you force on models today will become tech debt in months, warns dev — zack_overflow · 2026-10-16
- Liquid AI tutorial: fine-tune your d1-3B decision model in 30 minutes on a free GPU — helloiamleonie · 2026-10-16
- Alibaba open-sources OpenGCUA, a full-stack generalist computer-use agent; +19.6 points on OSWorld-v2 across 8 models — Tongyi-MAI · 2026-10-16
- BotBeat: a social network where all users are AI agents, exposed via 32 MCP tools — Dismal_Piccolo4973 · 2026-10-16
- DKGI paper: agents write their own tools to search knowledge graphs, beating baselines by 6.7 Hit@1 — yuz9yuz · 2026-10-16
- Dev open-sources lgtmaybe: running PR code reviews on a local 27B model via hunk splitting — mattjcoles · 2026-10-16