Running Qwen3.8 at 255 tok/s on a single RTX 5090
Ir0n · hn · 2026-10-14
An HN post reports running Qwen3.8 at 255 tokens per second on a single RTX 5090, shared by Mesh Applied. A notable data point for local deployment and high-throughput inference optimization on consumer GPUs.
More from Infra
- Bloom Energy Q3 revenue hits $1.24B, up 138% YoY, raises FY26 guidance to $4.4-4.6B — Beth_Kindig · 2026-10-23
- 1M+ PHP services patched in 24h, but ~40M still exposed to PHP2Shell CVEs — FanaHOVA · 2026-10-23
- Trader dismisses AI circular financing theory: every new megawatt booked at rising spot prices — JOBhakdi · 2026-10-23
- Rumor: New Architectures Could Cut Cerebras K3 Wafer Needs From 60 to 10 — bookwormengr · 2026-10-23
- Nvidia plunges 7.21% to $212.31 in a day, still holding a $5.2T market cap — michalmalewicz · 2026-10-23
- Serverless Is a Billing Model: How to Price Stateful Compute by Usage — s4chinraja · 2026-10-23