Soofi Unproven to Match Nemotron 3
JJitsev · x · 2026-07-16
The author concludes by emphasizing the need to stop over-claiming, as it damages the credibility of open-source releases.
They believe there is currently no evidence that Soofi matches its source model, Nemotron 3, because both its training and evaluation processes suffer from significant contamination, rendering comparative conclusions unreliable.
Related event: SOOFI benchmark claims challenged over leakage and baseline reporting(13 posts)→
More from Models
- KOL defends B-tier rating for GPT-6.1 Sol, blames OpenAI's botched release naming — Angaisb_ · 2026-10-27
- php2shell exploit benchmark: only 2 of 5 frontier models can port the bug — xeophon · 2026-10-27
- Qwen Code v0.26.2-preview.0 adds session permission rules and experimental shared agent loop — qwen-code-review-bot · 2026-10-27
- GPT-6.1 Terra cuts factual error rate from 22.3% to 4.3%, an ~81% drop — haider1 · 2026-10-27
- GPT-6.1 Terra lands: early users praise speed, value and subagent performance — BenBajarin · 2026-10-27
- Leaked GPT-6.1 Terra benchmarks: cheap but 'boring', still far behind Astra and Claude — Angaisb_ · 2026-10-27