Every Builds Internal Platform for Personal Benchmarks Based on Real Work, Not Leaderboards
danshipper · x · 2026-09-12
Every's Dan Shipper argues benchmark scores say little about how a model performs on your actual work, which is why for three years the team has done "vibe checks": hands-on long-form reviews based on real work. Now they're doubling down quantitatively — @hammermt and @nityeshaga built an internal platform so everyone can create personal benchmarks from their day-to-day work, turning vibes into measurable checks.
Related event: Every Ditches Leaderboards, Builds Personal Benchmarks for Real Work(2 posts)→
More from Models
- ToneBench eval: GPT-6.1 Terra ranks #23 at writing — cheaper, not better, than GPT-5.6 Terra — OnlyProggingForFun · 2026-10-28
- Cursor user complains it silently switches to Grok, which fails basic tasks — kylegawley · 2026-10-28
- Musk says Grok Bot keeps improving, calls Vault feature a game changer — beffjezos · 2026-10-28
- Claude refuses to gather legitimately public information, sparking guardrail backlash — mkheck · 2026-10-28
- DesignArena launches Code to Video Arena: models direct 15-45s films purely in code — yshan2u · 2026-10-28
- ChatGPT's 'yes, but with an important clarification' often precedes pure nonsense — Crixusgannicus · 2026-10-28