Qwen 3.8 27B hits 70 t/s with specific config parameters
dsdt · reddit · 2026-08-20
Shared a "perfect config" for running Qwen3.8-27B-UD-Q6K on dual RTX 5060 Ti (32GB), achieving 68-70 t/s generation speed and 80% draft acceptance rate via parameters like speculative decoding, flash-attn, and batch size tuning.
More from Infra
- Stripe's leaked investor letter explains OpenRouter acquisition logic — IanAndrewsDC · 2026-08-20
- Local data centers face NIMBY backlash as 'dystopian betrayal' — ai · 2026-08-20
- Dockerlings: Interactive terminal app to practice Docker — tom_doerr · 2026-08-20
- Cerebras unveils CS-4 system amid AI chip gluttony — TiernanRayTech · 2026-08-20
- oMLX 0.6.3rc1 Released: Faster ANE Tuner, DFlash 2 Support — alexcovo_eth · 2026-08-20
- Deep dive: a16z infra team bets on OpenRouter & Cursor — nmasc_ · 2026-08-20