"Someone should train LLMs to approximate human writing distribution" backfires

AaronBergman18 · x · 2026-10-15

A post complaining that "LLMs are so bad at writing" and calling for "a training objective that makes them approximate the distribution of human writing, even before post-training" went viral as an AI-community joke.

The punchline: that objective already exists — it's essentially next-token pretraining itself. The critic unknowingly proposed the very paradigm behind LLMs, and the irony is what made it shareable.

Original post →

More from Fun

Fun channel →