Qwen 2.5 27B Runs at 100+ tok/s on RTX 5090
Hesamation · x · 2026-08-18
A demonstration shows Qwen 2.5 (mistakenly labeled Qwen 3.8 in the tweet) 27B model running locally on an NVIDIA RTX 5090 gaming GPU, achieving over 100 tokens per second. This highlights how frontier AI performance from six months ago is now accessible on consumer hardware.
More from Infra
- Phison CEO calls CXMT memory scare a 'ghost story', warns of materials shortage — BenBajarin · 2026-10-16
- Ben Bajarin: The Future of Compute Is Fungible as Hyperscalers Design for Workload Flexibility — BenBajarin · 2026-10-16
- AirLLM runs frontier-size models layer-by-layer: 671B on 12GB VRAM — Aiden_Tech_Ai · 2026-10-16
- NVIDIA Launches cuPotential in CUDA-X to Bring AI Agents to Semiconductor Materials Simulation — tomaszbednarz · 2026-10-16
- Q4-quantized coder model on 8-core CPU builds interactive solar system demo in one shot — IntrepidMindExplorer · 2026-10-16
- TokenSpeed MLA 2 ships for Vera Rubin: up to 3.44× faster Kimi K3 decode — zhyncs42 · 2026-10-16