87GB Qwen3.8 Flash Next runs at 120-150 t/s on a single RTX 5090
CurieuxExplorer · x · 2026-10-01
A Japanese user tested the local inference tool Strata: Qwen3.8 Flash Next (87GB) runs at 120-150 t/s on a single RTX 5090 with 4K t/s prefill. Hooked into LibreChat with web search, it retrieves properly and has relaxed guardrails. The takeaway: Qwen-class models are now a desktop sport, undercutting the "you need a data center" era.
More from Infra
- Ascend output could hit ~20M chips next year; memory and packaging, not logic, are the bottleneck — teortaxesTex · 2026-11-19
- AMD Loom boosts Qwen3.5-4B prefill up to 2.6x on Radeon 890M laptops — jfowers_amd · 2026-11-19
- Dev submits PR adding periodic checkpoints to GKE sandboxes so agents don't lose progress — yoimnotkesku · 2026-11-19
- AWS Lambda Adds GPU Support via Managed Instances for Inference and Media Workloads — DavidWells · 2026-11-19
- Nvidia Allegedly Made GPUs Artificially Scarce to Keep Prices Sky-High — GaryMarcus · 2026-11-19
- AWS adds private CA support to Bedrock AgentCore Identity for connecting agents to self-hosted IdPs — AWS ML Blog · 2026-11-19