Cloudflare's open-weights decision model Clef scores all answers in one pass, 53ms per decision on RTX 5090
michellechen · x · 2026-10-04
Cloudflare has released Clef, a new open-weights decision model. A user benchmarked it on an RTX 5090: each decision takes just 53 ms.
The architecture is unusual:
- It never generates text — no token output at all
- It reads the input once, then scores every allowed answer in parallel, emitting a decision directly
The author shared a 2-minute explainer covering how it works, where it beats Jev, and where it doesn't. Score-based (rather than generative) architectures like this are especially interesting for low-latency classification and routing tasks.
Related event: Cloudflare Open-Sources Decision Models Clef, Now on Ollama(3 posts)→
More from Infra
- Anthropic's compute spend grows 4x/year, $10B in Q3 alone, set to overtake OpenAI by May 2027 — scaling01 · 2026-11-19
- Thailand data center association cites $18B in GPU/hardware cancellations after SE Asia lending halt — SumitGup · 2026-11-19
- Gridline launches one-API fine-tuning, distillation and batch inference for open models — Scobleizer · 2026-11-19
- Ascend output could hit ~20M chips next year; memory and packaging, not logic, are the bottleneck — teortaxesTex · 2026-11-19
- AMD Loom boosts Qwen3.5-4B prefill up to 2.6x on Radeon 890M laptops — jfowers_amd · 2026-11-19
- Dev submits PR adding periodic checkpoints to GKE sandboxes so agents don't lose progress — yoimnotkesku · 2026-11-19