Debate Erupts Over Alleged Benchmark Contamination in DeepSeek V4.1 Flash
A user alleged benchmark contamination in DeepSeek V4.1 Flash (and possibly Kimi K3) based on its model card, but later offered a cooler take: old benchmarks may simply be saturated and serving as synthetic training fodder rather than being directly contaminated.
2026-09-13 ~ 2026-09-13 · 2 related posts
- DeepSeek V4.1 Flash accused of public benchmark contamination, Kimi K3 possibly too — teortaxesTex · 2026-09-13
- Benchmark "saturation" isn't contamination — old benchmarks become synthetic training fodder — teortaxesTex · 2026-09-13