Study: LLMs are Mode Seekers, Failing to Capture Full Distribution

MengdiWang10 · x · 2026-08-25

A PNAS paper reveals that LLMs act as effective "mode seekers." When generating sample trajectories, their outputs tend to cluster around high-probability modes rather than faithfully reproducing the underlying distribution. Plausible outputs do not equate to capturing the full distribution.

Original post →

More from Models

Models channel →