Fixing Qwen Repetition Loops with typical_p
Long_comment_san · reddit · 2026-07-18
The author discusses the typicalp sampling parameter and the repetition loop issue in Qwen.
They point out that typicalp has long been merged and was originally designed to suppress repetition loops. Theoretically, this makes it a more rational approach than advice like "cranking presence penalty to 1.5," and it's better suited for creative tasks. Anecdotally, they recall a typicalp value around 0.92 working well, though it may need to be combined with other sampling parameters, such as minp, to reduce hallucinations.
More from Models
- Google says information agents are coming to AI Pro and Ultra this summer — gaganghotra_ · 2026-07-22
- Google DeepMind launches Gemini 3.5 Flash Cyber for faster, cheaper code security — ralucaadapopa · 2026-07-22
- Poolside’s Laguna S 2.1 gets a two-week free run on Nous Portal — NousResearch · 2026-07-22
- Qwen3.8 Max Preview looks substantially better in a side-by-side test with Kimi K3 — curiousily_ · 2026-07-22
- Moonshot’s Kimi K3 reaches #5 on MathArena as the top open model — xeophon · 2026-07-22
- Google launches Gemini 3.5 Flash Cyber for CodeMender, with limited access for governments — GoogleAI · 2026-07-22