Fixing Qwen Repetition Loops with typical_p
Long_comment_san · reddit · 2026-07-18
The author discusses the typicalp sampling parameter and the repetition loop issue in Qwen.
They point out that typicalp has long been merged and was originally designed to suppress repetition loops. Theoretically, this makes it a more rational approach than advice like "cranking presence penalty to 1.5," and it's better suited for creative tasks. Anecdotally, they recall a typicalp value around 0.92 working well, though it may need to be combined with other sampling parameters, such as minp, to reduce hallucinations.
More from Models
- GPT-6 Astra beats Factorio with enemies in 44 in-game hours at ~$4,500 API cost — liminal_bardo · 2026-09-11
- 105 hidden bugs, 2 repos: DeepSeek V4.1 Flash fixes 24 at $1.80 vs Opus 5's 27 at $51.33 — ChartsJournalX · 2026-09-11
- awesome-llm-leaderboards: an open-source directory of LLM leaderboards, pricing tables, comparison tools — Last_Establishment_1 · 2026-09-11
- Anthropic claims it works to keep eval environments unidentifiable to models — MaxKannen · 2026-09-11
- Nex N2.5 Pro released on Hugging Face with 407GB of weights — jinnyjuice · 2026-09-11
- RoMa v2 image matching model unveiled in the usual black poster — ducha_aiki · 2026-09-11