wyat-2: first decision model built on a looped transformer, trained on a single RTX 4070 Ti
Fit_Strawberry8480 · reddit · 2026-10-28
The author released wyat-2, a fine-tune of Ouro-1.4B (a looped transformer) that scores answer options as a decision model, trained on a single RTX 4070 Ti. Per the author, it is the first decision model built on a looped transformer — not the best, but the first.
He notes making it competitive would require heavy data work, so he's deprioritizing it for now unless it catches interest. The report (PDF) and Hugging Face weights are both public.
More from Models
- Liquid AI launches LFM3 family: 6 compact models plus d1 decision models in a single pass — antoine_chaffin · 2026-10-28
- Follow-up: GPT-5.6 terra would be a hit if OpenAI cut its price 80% instead of 20% — JoshPurtell · 2026-10-28
- Dev calls out OpenAI's messy GPT-5.6 pricing: mini/nano hiked, luna reverted, terra left behind — JoshPurtell · 2026-10-28
- LFM3-VL-2B Runs Real-Time Video Captioning In-Browser via WebGPU — xenovatech · 2026-10-28
- Liquid AI LFM3's hybrid architecture: 6 global attention layers, 256K context, 25% faster inference — cneuralnetwork · 2026-10-28
- Dev names GLM 5.5 Flash and Qwen 4 27B as the models he's most excited about — victormustar · 2026-10-28