Comparing 1000 tok/s vs 85 tok/s
Yamapama · x · 2026-07-16
The quoted post visualizes a stark contrast in generation speeds: 1000 tok/s versus 85 tok/s.
While the original post is merely a brief exclamation, the core insight comes from the quoted content, highlighting an order-of-magnitude difference in model/inference output speeds—a notable performance benchmark.
More from Infra
- Marker will get more accuracy improvements, while Chandra remains the high-accuracy option — VikParuchuri · 2026-07-21
- Nebius says SlimSpec speeds speculative decoding 8–9% without shrinking the vocabulary — Arindam_1729 · 2026-07-21
- NVIDIA brings its Cosmos 3 Edge world model to Jetson for on-device robot control — liu_mingyu · 2026-07-21
- A silicon photonic reservoir chip compensates fiber distortion in real time at 28 Gbps — bravo_abad · 2026-07-21
- Chamath says open-sourcing Grok would push AI margins from models to infra and apps — Dan_Jeffries1 · 2026-07-21
- EU AI competitiveness is under pressure as firms double down on chips, ethics, and talent — nordicinst · 2026-07-21