TwIL-LM2 1.7B outperforms larger models in strict formal reasoning
HopefulMode429 · reddit · 2026-08-23
TwIL-LM2, a 72M param LoRA adapter on SmolLM2-1.7B, specializes in converting English to verifiable first-order logic. It achieves a score of 0.2386 on strict-7 (no partial credit), beating Qwen3-8B (0.2093) and Gemma-4-26B (0.2050). This demonstrates the value of specialized small models for precise tasks (like formal translation) within pipelines, complementing larger general models. Licensed under webAI Non-Commercial License.
Related event: Tiny 1.7B TwIL-LM2 Beats Larger Models at Formal Logic Reasoning(2 posts)→
More from Models
- Opus 5 might be a very deep model or use looping, commentator speculates — scaling01 · 2026-10-16
- GPT-6.1 Sol audit finds 6% of arXiv papers had false main theorems, down to 1.5% recently — nitarshan · 2026-10-16
- Nvidia-backed post-training pushes Nemotron 3.5 VL past frontier on dermatology diagnosis — LoganGrasby · 2026-10-16
- Gemini 4 Argon scores 97.5% on ARC-AGI-3, second lab above 95% — patience_cave · 2026-10-16
- Microsoft MAI claims SOTA 3T-param in-house base models, post-training results coming — soldni · 2026-10-16
- Datadog's Scout 1.0: post-trained GLM-5.3 Flash matches frontier models for AI SRE at lower cost — Tim_Dettmers · 2026-10-16