Running Qwen3.8-27B on RTX 5060 Ti 16GB: IQ4 Quantization and Full Feature Benchmark
Tema_Art_7777 · reddit · 2026-08-22
The author tested Qwen3.8-27B on an RTX 5060 Ti 16GB to validate 64K context, vision, and agentic tool use on a single card. Comparing jpetrina IQ4XS-pure, Unsloth UD-IQ4XS, and Q80, results show Unsloth UD-IQ4XS with MTP-1 maintains 45 tok/s at 64K context with perplexity very close to Q8. Vision (F16 projector) works but strains VRAM when combined with max context, suggesting profile separation. In BFCL tool-use benchmarks, the 27B models significantly outperformed Qwen3.5-9B in multi-turn workflows, handling complex scenarios like dependent calls and prompt injection resistance.
More from coding & agent
- Photon 2.0 launches unified messaging API for AI agents across iMessage and more — Scobleizer · 2026-10-16
- Claude Opus 5.5 effort levels tested: low reasoning iterates 9x faster than max — tom_doerr · 2026-10-16
- Figma launches Guidelines and Code Sources so AI agents can follow your design system — JaynitMakwana · 2026-10-16
- Ex-DeepMind Eng Lead's AI Calling Agent Fo Cut Hang-Up Rate from 80% to 20-30% — julianweisser · 2026-10-16
- SPACE Open-Sources Its Sandbox Platform for Agentic Code Execution — marktenenholtz · 2026-10-16
- Cognition Launches Devin OnCall to Auto-Investigate Production Alerts — DevinAI · 2026-10-16