Sentry CEO Mocks "One-Shot a Crappy Game" as a Meaningless Model Benchmark
zeeg · x · 2026-11-18
Sentry CEO David Cramer takes aim at a common AI eval trope: if your review of a coding model amounts to "it one-shot a shitty mock game," that tells us more about your capabilities than the model's.
He caps it with a self-deprecating jab at one-prompt-demo hype: "anyway I typed doom into a DOS prompt in 1994 and it made doom."
More from Fun
- The viral "put me in my era" AI portrait prompt takes over feeds — zeeg · 2026-11-18
- Elon Musk recounts how a fish nearly grounded Starship launches — RachelVT42 · 2026-11-18
- AI-generated video drops Pip into Hyrule Castle's tavern — Mattapeh · 2026-11-18
- Grok Imagine short film: a 1986 Houston cop-drama pilot made entirely with AI video — Kyrannio · 2026-11-18
- Claim: Anthropic investors funding coordinated influencer campaign to downplay OpenAI release — mark_k · 2026-11-18
- AI support agent called three times just to fail connecting to a human — generativist · 2026-11-18