Lithos AI Claims Fastest AMD Inference: 2,116 Tokens/sec Per User on MI355X

Lithos AI, working with AMD, released what it calls the fastest inference engine on AMD GPUs, running DeepSeek V4.1 Flash at 2,116 tokens per second per user across 8 Instinct MI355X GPUs.

2026-10-27 ~ 2026-10-28 · 2 related posts

• Lithos engine hits 2,116 tokens/s per user on 8× AMD MI355X, up to 3.4× faster than OSS engines — JiaZhihao · 2026-10-27
• AMD MI355X hits 2,100+ tokens/sec per user on DeepSeek V4.1 Flash inference — JiaZhihao · 2026-10-28