K2 Horizon Lineup Hits Artificial Analysis, but Awful KV Cache Design Misleads Its Charts
crusaderky · reddit · 2026-09-14
The full K2 Horizon lineup is on Artificial Analysis (3.7B/7B SOTA, 36B-A4B good for low-bandwidth hardware), but the author argues its terrible KV cache design makes parameter counts misleading: with 128k context the 3.7B uses 5 GiB for context vs Qwen3.6-35B-A3B's 0.7 GiB. Practical picks: 36B-A4B only on exactly 16GB VRAM + ≥32GB RAM; on 24GB, Qwen3.8-27B is faster, smarter, and supports 256k context.
More from Infra
- Your AI agent would cost 260% more without prompt caching, Arena data shows — arena · 2026-10-30
- Nebius runs auction-driven GPU pricing, lifting rates ~20% amid tight supply to 2028 — BenBajarin · 2026-10-30
- macOS update silently re-adds eMudhra root certs users had removed — steipete · 2026-10-30
- Bittensor's Terza Inference routes one API across miners' models on subnet 103 — const_reborn · 2026-10-30
- SGLang Summit 2026 sells out sponsor booths and Full Passes ahead of Nov 12–13 event — ying11231 · 2026-10-30
- OpenRouter rebuilds provider routing: 46% fewer capacity errors, 16.9% faster TTFT — steipete · 2026-10-30