A code-based AI-slop score and 2,621 blind human votes disagree across 70 models

penguinothepenguin · reddit · 2026-11-20

The Slop Index benchmark scores 70 models across 77,943 outputs (emails, Slack messages, social posts, short essays) two ways: a reproducible pure-code mechanical score (padding, templating, sentence rhythm, known AI tells, measured against pre-2022 human writing) plus a 40%-weighted crowd Elo from a blind arena with 2,621 votes.

The disagreements are the interesting part (models with 190+ votes):

The author's read: people react to something the mechanical axes miss, likely repeated constructions and a "helpful assistant" stance. Limitations: the code misses repeated constructions and everything is short-form, no fiction. Leaderboard, methodology, open dataset, and code are public; the project started as internal model selection for the Slashy email client.

Original post →

More from Models

Models channel →