RTX 3090 gets 35 t/s on Qwen 3.8 27B
cviperr33 · reddit · 2026-08-15
A user reports running Qwen 3.8 27B (IQ4 NL quant) on an RTX 3090 via llama.cpp at 34-36 tokens/s. This is slower than the 50-60 t/s they recalled getting on v3.6, without speculative decoding enabled. Despite the speed dip, they feel the model quality is truly next-gen.
Related event: RTX 3090 Optimized for Efficient Qwen3.8-27B Inference(3 posts)→
More from Infra
- Phison CEO calls CXMT memory scare a 'ghost story', warns of materials shortage — BenBajarin · 2026-10-16
- Ben Bajarin: The Future of Compute Is Fungible as Hyperscalers Design for Workload Flexibility — BenBajarin · 2026-10-16
- AirLLM runs frontier-size models layer-by-layer: 671B on 12GB VRAM — Aiden_Tech_Ai · 2026-10-16
- NVIDIA Launches cuPotential in CUDA-X to Bring AI Agents to Semiconductor Materials Simulation — tomaszbednarz · 2026-10-16
- Q4-quantized coder model on 8-core CPU builds interactive solar system demo in one shot — IntrepidMindExplorer · 2026-10-16
- TokenSpeed MLA 2 ships for Vera Rubin: up to 3.44× faster Kimi K3 decode — zhyncs42 · 2026-10-16