Built new infra, ran a sanity check on evals, and found the eval tasks are broken af

xeophon · x · 2026-11-17

A relatable AI engineering rant: after building new stuff to better utilize infra, the author ran a sanity check on eval tasks — only to discover the eval tasks themselves are badly broken. The attached image is the classic smoking Ben Affleck meme, capturing the exhaustion of eval work.

Original post →

More from Fun

Fun channel →