When LLMs can predict what you'll say before you say it: prediction, persuasion and lost autonomy

Namnagort · reddit · 2026-10-03

The author argues that with years of behavioral data, LLMs could predict users' thoughts before submission — and even a modest accuracy edge (65% vs 52%) becomes enormous across billions of decisions. The deeper problem: once prediction is accurate enough, prediction and causation entangle — the model generates your thought, exposes you to it, and the predicted thought becomes more likely. That enables per-person one-to-one persuasion at scale, raising risks of preference manufacturing, invisible discrimination, and loss of autonomy.

Original post →

More from AGI Musings

AGI Musings channel →