TinyLeague drops Artificial Analysis scores, adds KV cache efficiency ratings for local models
nunodonato · reddit · 2026-10-28
Tiny League maintainer nunodonato removed Artificial Analysis as a metric, citing that many small models lack scores and AA is moving toward closed benchmarks. The site adds a KV cache efficiency metric estimating GB usage at 128K context, rated 0-100%, aimed at VRAM-constrained local users. A unified TinyLeague-Index is still in the works.
More from Infra
- HUMAIN details site and power groundwork behind its AI infrastructure buildout — HUMAIN · 2026-10-28
- llama.cpp PR fuses MoE matmuls and GLU, boosting Qwen3 CUDA throughput up to 17% — jacek2023 · 2026-10-28
- A 5-minute visual explainer of what happens when you call an LLM API — HowDevelop · 2026-10-28
- GenieX brings any GGUF model to Snapdragon's Hexagon NPU, with real benchmarks — SkyFeistyLlama8 · 2026-10-28
- Cached tokens explained: how prefix caching cuts agent costs to 2% and what breaks the hit rate — Arindam_1729 · 2026-10-28
- Hojo-TTS-Light: open-source 40M/80M TTS benchmarked on a 2-core CPU, no GPU — HeyZoyaKhan · 2026-10-28