Liquid AI's FTPO training cuts small-model "doom loops" from 10.2% to 1.4%
helloiamleonie · x · 2026-09-15
Liquid AI published a blog and open-source repo for "Antidoom", a training method that fixes the "doom loop" failure mode in small reasoning models, which repeat spans like "Wait, let me reconsider…" until the context window fills up.
How it works
- The usual fix, repetitionpenalty, is a band-aid that can hurt performance; RL targeting loops needs carefully calibrated rewards and costly online rollouts.
- FTPO (Final Token Preference Optimization): identify the exact token that starts a loop and train the model to prefer a coherent alternative at just that position via chosen/rejected pairs, leaving the rest of the distribution untouched. The method adapts Antislop.
- Implemented as a custom DPOTrainer in TRL; tutorial and code are open source.
Results: on an early LFM2.5-2.6B checkpoint, the loop rate on hard math/coding prompts dropped from 10.2% to 1.4%, with eval scores improving across the board as a direct result.
Related event: Liquid AI Open-Sources FTPO to Fix Small Models' Doom Loops(2 posts)→
More from Models
- Atria Dawn Preview open-sourced: 744B MoE agent model tops BrowseComp at 92.5 — alexcovo_eth · 2026-09-16
- Rumor: SSI shelved its latest model as Ilya refuses to fuel the AI race — iruletheworldmo · 2026-09-16
- OpenAI Cuts ChatGPT Voice Price by 60%, Launches Gift Cards — borowcy · 2026-09-16
- A long-form explainer on why local inference matters — and why you need uncensored models — HankYeomans · 2026-09-15
- KoboldCpp v1.121 Released for Local LLM Inference — Fcking_Chuck · 2026-09-15
- Benchmark errors found in CritPt; GPT-5.6 hits 94.4% pass@4 after fixes — bookwormengr · 2026-09-15