Bayesian thinking left room in LLM sampling, but the field spent three years on structured generation

remilouf · x · 2026-07-25

The author argues that, coming from Bayesian inference, they always knew LLM sampling still had untouched upside.

Instead of exploring that frontier earlier, the field spent about three years on structured generation because, as the post jokes, “nobody else was going to do it.”

Related event: Exploring LLM Sampling Potential vs Structured Generation(2 posts)→

Original post →

More from AGI Musings

AGI Musings channel →