Andrew Carr reports 400 tok/s on Muse Ember

andrew_n_carr · x · 2026-11-10

Andrew Carr reports hitting 400 tokens per second on Muse Ember today, expressing surprise at the speed. No hardware or setup details were given, but the throughput figure is notable for those tracking inference performance.

Original post →

More from Models

Models channel →