SOOFI’s updated report still looks contaminated, and Nemotron 3 Nano may still be ahead
JJitsev · x · 2026-07-26
The author argues that the updated SOOFI report still misrepresents the comparison with Nemotron 3 Nano.
- The report labels Nemotron 3 Nano as “open-weights,” even though its data and training stack are open.
- SOOFI is accused of presenting contaminated benchmark numbers as evidence for a “frontier-level champion” claim.
- The author says it is still unclear whether SOOFI actually matches the original Nemotron 3 Nano, despite being trained on 2T more tokens.
More from Models
- Kimi-K3 claims a perfect 6/6 on IMO 2026 Lean 4 proofs — songhan_mit · 2026-07-26
- OpenAI’s “5.6 Pro” is said to beat Fable 5 on math-heavy rebuttal work — MParakhin · 2026-07-26
- Claude keeps defending Opus 5 instead of writing a critical review — sethlazar · 2026-07-26
- Unsloth’s Qwen3.6-35B-A3B GGUF is trending on Hugging Face — unsloth · 2026-07-26
- SOOFI may still only be tying Nemotron 3 Nano despite 2T extra tokens — JJitsev · 2026-07-26
- A simple “ask clarifying questions first” prompt gets Claude to surface missing assumptions — Commercial-Most3081 · 2026-07-26