EveryCut videos reveal real experiment costs: 12.3B tokens, roughly $20K spent
danshipper · x · 2026-11-11
Dan Shipper and friends show actual experiment costs in their vibe check videos: a screenshot of EveryCut's EAP build tracks 12.3 billion tokens, costing $11K–14K on Fable 5.1 and $9K–11K on Fable 5.2 — a refreshing dose of transparency in an eval landscape that rarely talks money.
More from Models
- MKA deep dive: top models cluster at 95-97% on basics but split 28-57% on hard tasks — ArtificialAnlys · 2026-11-11
- Same MKA task: Gemini Carbon does it in 1 hour for $8, Fable takes 3 hours and $68 — ArtificialAnlys · 2026-11-11
- MKA Benchmark by Output Type: No Model Tops 52% on Word or Text Files — ArtificialAnlys · 2026-11-11
- DeepMind-backed MKA benchmark crowns Claude Fable 5.2 at 57%, with 30x cost spread — ArtificialAnlys · 2026-11-11
- Claude Fable 5.2 hits 94.9% on SimpleBench, 0.5% shy of top human score — koltregaskes · 2026-11-11
- Google AI Plus student plan briefly unlocked Gemini Pro before access vanished — KelrimLover · 2026-11-11