Probability-only model tested as LLM judge: 25x faster, 600x cheaper than Fable-class
danshipper · x · 2026-09-16
Dan Shipper (Every) says his team spent a week testing a new foundation model that outputs probabilities instead of text, making it an efficient LLM judge — in their tests 25x faster and 600x cheaper than a Fable-level model. Commenters see it as a "perfect workflow model" for agent skills needing evaluation, with Shipper calling it indispensable within 6-12 months.
More from coding & agent
- GitHub Actions has a lesser-known ubuntu-slim runner: 1 CPU, 5GB RAM, cheaper CI — DanielLockyer · 2026-11-02
- Before automating a workflow with AI, ask if anyone understands it end to end — djgoel123 · 2026-11-02
- One stale date silently broke a WhatsApp reply agent: 19 messages unanswered — petrusenko_max · 2026-11-02
- The 10X engineer is now just a SKILLS.md: 6 workflow rules for AI coding agents — mdancho84 · 2026-11-02
- Auditing my MCP credential broker: the worst hole was the config file — Relevant_Mousse_9117 · 2026-11-02
- AWS's open-source Strands Harness claims 45% cheaper than Claude Code, reigniting harness debate — blaizedsouza · 2026-11-02