Qwen 27B hits nearly 100 tokens/s on a local RTX 4090 via Ollama and Pinokio
cocktailpeanut · x · 2026-08-16
User zast57 ran a Qwen 3-series 27B model (written as "Qwen 3.28:27b" in the original post) locally on an RTX 4090 through Ollama + OpenWebUI, deployed via Pinokio. Measured generation speeds:
- Proofreading a text: 90.26 response tokens/s
- Generating Connect 4 game code: 96.77 response tokens/s
He was impressed by how fast it runs. Pinokio creator cocktailpeanut retweeted the benchmark.
Related event: Qwen3.8-27B local benchmarks: from RTX 4080 Super to RTX 6000 Pro(7 posts)→
More from Infra
- Phison CEO calls CXMT memory scare a 'ghost story', warns of materials shortage — BenBajarin · 2026-10-16
- Ben Bajarin: The Future of Compute Is Fungible as Hyperscalers Design for Workload Flexibility — BenBajarin · 2026-10-16
- AirLLM runs frontier-size models layer-by-layer: 671B on 12GB VRAM — Aiden_Tech_Ai · 2026-10-16
- NVIDIA Launches cuPotential in CUDA-X to Bring AI Agents to Semiconductor Materials Simulation — tomaszbednarz · 2026-10-16
- Q4-quantized coder model on 8-core CPU builds interactive solar system demo in one shot — IntrepidMindExplorer · 2026-10-16
- TokenSpeed MLA 2 ships for Vera Rubin: up to 3.44× faster Kimi K3 decode — zhyncs42 · 2026-10-16