Dev: I trust Discord vibe checks over benchmarks now — and that's terrible science

burny_tech · x · 2026-11-18

burnytech says his trust in "benchmaxxed" leaderboards has collapsed and he now relies on collective X/Discord vibe checks — then self-mockingly notes that this is data with zero statistical rigor, plenty of bias and selection effects. A candid take on how community sentiment is replacing public benchmarks.

Original post →

More from Models

Models channel →