LlamAmpere v0.6.3 Runs Qwen Flash Next on 3090+64GB at 120+ TPS, 50% Lower Error
Brief-Tap-6616 · reddit · 2026-11-07
LlamAmpere v0.6.3 quantizes Qwen Flash Next for Ampere GPUs (3090 + 64GB):
- 50% lower error than Strata 3XS, 27% lower than Unsloth UD v3.1 3XXS
- 120+ TPS at 100K depth, prefill >3000/s
- Original Strata 3XS/2XS shipped with poor quality (.17+ KLD), so the author rebuilt on AmpereInteger+ quantization over Unsloth v3.1
- A 10% faster 3XS file exists but only 15% better quality — not recommended; configs under 54GB total memory should avoid QFN quants
More from Infra
- Reactor co-founder publishes 'The real-time manifesto' on serving real-time AI at scale — smtabatabaie · 2026-11-07
- Clairvoyance's new hivemind feature lets you share your GPU with anyone — draginol · 2026-11-07
- zml/llmd inference server runs on NVIDIA, AMD, Intel, TPU and Metal with images as small as 142MB — siwu · 2026-11-07
- Sequoia's Maguire models SpaceX taking inference compute share as neoclouds struggle — shaunmmaguire · 2026-11-07
- Musk teases 'Starmind computer' details next year, promising it will 'blow people's minds' — ns123abc · 2026-11-07
- Airbnb fine-tuned Gemma 4 E2B to match frontier quality at 1% of the cost — DynamicWebPaige · 2026-11-07