Do typos discomfort LLMs? Tokenization quirk sparks debate

menhguin · x · 2026-11-11

menhguin theorizes that typos cause slight "discomfort" to LLMs by disrupting tokenization. Quoting Dorialexander: Claude happily corrects typos unprompted, unaware that amid a deluge of spotless AI-generated text, typos are no longer a signal — models were trained in a world where they had no widespread effects. A fun take on model behavior vs. shifted data distributions.

Original post →

More from Fun

Fun channel →