Experiment restricts Qwen to Wikipedia's 250 most common tokens plus rare ones

cephaloform · x · 2026-10-01

An experiment constrains Qwen's output to only the 250 most common tokens in Wikipedia, plus any tokens rarer than the 14,000th — a probing of how the model behaves under an extreme vocabulary restriction.

Original post →

More from Models

Models channel →