DeepSeek V4.1 Flash accused of public benchmark contamination, Kimi K3 possibly too
teortaxesTex · x · 2026-09-13
A user alleges DeepSeek V4.1 Flash shows benchmark contamination based on model-card data, with Kimi K3 possibly affected too. The claim: contaminated models rank disproportionately lower on later benchmarks unseen during training. Even if unintentional, the model's value reportedly lies in architectural innovation rather than raw output quality. Allegations unverified.
Related event: Debate Erupts Over Alleged Benchmark Contamination in DeepSeek V4.1 Flash(2 posts)→
More from Models
- Leak: Google Reportedly Has Another 'Hella Chonky' Model After Carbon — iruletheworldmo · 2026-10-30
- Users report across-the-board GPT quality drop: weaker writing and broken instruction following — Kyrannio · 2026-10-30
- Leak claims Gemini Argon hits Pro trial from November 2nd (unverified) — Emotional-Company847 · 2026-10-30
- OpenAI retiring waves of legacy models: GPT-5 family dies Dec 11, GPT-4.1 by Jan 2027 — ThePeterMick · 2026-10-30
- DeepMind CEO Demis Hassabis tells Musk: testing with trusted partners, coming soon — demishassabis · 2026-10-30
- Adobe stands firm on not training on customer data, using licensed stock instead — omooretweets · 2026-10-30