Paradigma's 1B model scores 74.25% on BeyondAIME, trained on under 300B tokens
tensorqt · x · 2026-09-22
Paradigma released Limite 1B (Violetto), a 1B-parameter dense autoregressive transformer trained from scratch on under 300B curated tokens with 131k context. Using synthetic data, curated SFT and RL post-training — plus an architecture inspired by pre-training speedrun advances — it averages 74.25% on BeyondAIME, beating the 30B MUSE-Glimmer at 70%. Deliberately lightly instruction-tuned for single-turn math use, it ships with model weights, a training value model, and a custom vLLM inference plugin; a tech report is coming.
More from Models
- Why Is Inkling 2 Small Trained on So Few Tokens Yet Still Competitive? — georgejrjrjr · 2026-11-12
- OpenAI's five biggest failures laid out: pretraining decline, alignment fears, enterprise lost to Claude — teortaxesTex · 2026-11-12
- Fable 5.2 Hits 41.3% on Remote Labor Index, Up From 2.5% a Year Ago — alliekmiller · 2026-11-12
- Beaker automates MIT's weight-space programming: one-neuron edit lifts MATH-500 from 7% to 37% for under $4 — VictorSanh · 2026-11-12
- Researcher says Anthropic dodged questions on Mythos false positive rate; 37,966 findings, 2 exploited — OwariDa · 2026-11-12
- Grok spotted building meeting "Listen to Conversation" feature with live transcript — nima_owji · 2026-11-12