Built new infra, ran a sanity check on evals, and found the eval tasks are broken af
xeophon · x · 2026-11-17
A relatable AI engineering rant: after building new stuff to better utilize infra, the author ran a sanity check on eval tasks — only to discover the eval tasks themselves are badly broken. The attached image is the classic smoking Ben Affleck meme, capturing the exhaustion of eval work.
More from Fun
- JAXA scraps 1998 KY26 intercept a day after Avi Loeb suggested the 'dark comet' may be artificial — examachine · 2026-11-17
- Vision AI watches a garage door for ~$1.50/year, replacing a hardware sensor — SuB8u · 2026-11-17
- Viral quip: 'vibecoder will soon become a fancy word for unemployed' — examachine · 2026-11-17
- 'Bald Faced Liar': surreal AI video of a razor growing out of shower tiles goes viral — heresalexandria · 2026-11-17
- Supercomputer pioneer Seymour Cray dug a tunnel where 'elves' brought him design solutions — bratton · 2026-11-17
- Prompt injection attacks for GOFAI: deterministic code is reverse-engineerable — _lewtun · 2026-11-17